Senior Engineer (SA1 DES - Azure Data Engineer)

oraclecloud

Bangalore, 4 Years Exp Posted 47d ago

Job Description

·Azure data engineer expertise having experience working on all major Azure resources including expertise in development and debugging of programs using Databricks expertise.

·Utilize Azure Databricks notebooks to build and manage data transformations, create tables, and ensure data quality and consistency. Leverage Unity Catalog for data governance and maintaining a unified data view across the organization.

·Design, develop, and maintain scalable and efficient data pipelines to process large datasets from various sources using Azure Data Factory (ADF).

·Integrate data from multiple data sources and ensure data consistency, quality, and accuracy, leveraging Azure Data Lake Storage (ADLS).

·Develop and manage data warehouses to store and organize large volumes of structured and unstructured data using Azure Synapse Analytics and other relevant Azure services.

·Design and implement ETL (Extract, Transform, Load) processes to ensure seamless data flow across systems using Azure cloud platform

·Work experience on Microsoft Fabric experience is an added advantage

·Professional should be enthusiastic to learn, adapt and integrate Gen AI into the business process and should have experience working in Azure AI services

·Optimize data storage and retrieval processes to enhance system performance and reduce latency.

Power BI (Secondary Skills)

·Design and develop visuals, reports, and dashboard solutions in Power BI with RLS and other features as per business needs.

·Hands on experience connecting to various data sources to load and transform data and Implement complex joins with multiple tables, using power query.

·Highly skilled in writing DAX expressions to implement complex business calculations and data modeling needs.

·Capable of developing standard data models like star schema or snowflake schema considering multiple fact and dimension tables.

·Strong understanding of data structures, Data Analysis skills in identifying different trends, patterns, and other data issues within dataset and a good story telling skill using the given data.

·Prepare technical specifications and documentation for solutions.

·Understand business process & translate business logic into visual representations in a quick and accurate manner, perform end to end data validations.

·Being proactive and engaged in bringing new ideas and solutions

Similar Openings for You