Data Engineer - Azure

• Design, develop, and maintain data pipelines for ingesting, transforming, and loading data from various sources.
• Build and optimize ETL/ELT workflows using Azure-native tools.
• Work with structured and unstructured data across multiple platforms.
• Ensure data quality, integrity, and accuracy through validation and monitoring.
• Implement data modeling solutions for analytics and reporting.
• Collaborate with business analysts, data scientists, and stakeholders to understand data requirements.
• Optimize performance and scalability of data pipelines and storage.
• Ensure data governance, security, and compliance standards are met.
• Troubleshoot data issues and provide solutions proactively.

Required Skills & Experience

Core Azure Services

• Azure Data Factory (ADF) – data integration and orchestration
• Azure SQL / Azure SQL Database
• Azure Data Lake Storage Gen2
• Azure Databricks (PySpark / Spark SQL)

Programming & Querying

• Strong SQL skills 
• Python (for data processing and automation)
• PySpark / Spark (for big data processing)

Data Engineering Concepts

• ETL/ELT design patterns
• Data warehousing concepts (Star/Snowflake schema)
• Incremental loads and CDC (Change Data Capture)
• Data modeling (dimensional & normalized models)

DevOps & Automation

• Azure DevOps / CI-CD pipelines
• Git version control

Additional / Preferred Skills

• Experience with Power BI for data visualization integration
• Knowledge of data governance tools (e.g., Purview)
• Experience working in Agile/Scrum environments

Education & Experience

• Bachelor’s degree in Computer Science, Engineering, or related field
• 2-4 years of experience in data engineering or related role
• Hands-on experience with Azure data platform is required

Key Competencies

• Strong analytical and problem-solving skills
• Ability to work with large datasets efficiently
• Excellent communication and collaboration skills
• Attention to detail and data quality focus

Nice-to-Have Certifications

• Microsoft Certified: Azure Data Engineer Associate (DP-203)
  • Azure Fundamentals (AZ-900)