Associate II - Data Engineering

Key Responsibilities

• Develop, maintain, and support data pipelines using Azure Data Factory (ADF)
• Ingest data from SQL databases, flat files (CSV/JSON), and REST APIs
• Perform data cleansing and transformations using Azure Databricks (PySpark)
• Store and manage data in Azure Data Lake Storage (ADLS Gen2)
• Support loading of curated data into Azure Synapse / Azure SQL
• Monitor data pipelines, troubleshoot failures, and ensure data accuracy
• Follow standard coding practices, documentation, and version control
• Collaborate with data analysts, BI developers, and senior data engineers

Required Technical Skills

• Azure Services: Azure Data Factory, Azure Databricks, ADLS Gen2
• Programming: Python (basic PySpark), SQL
• Data Concepts: Basic ETL/ELT, data warehousing fundamentals
• Tools: Git (basic), exposure to Azure DevOps

Good to Have

• Basic knowledge of Azure Synapse / Azure SQL
• Exposure to Power BI
• Awareness of Delta Lake / Medallion architecture
• Basic understanding of data security and access controls

Soft Skills

• Strong learning attitude and problem-solving skills
• Good communication and teamwork abilities
• Ability to work in an agile environment
  • Self-motivated and detail-oriented