Azure Data Engineer
hirewand
Job Description
Key Responsibilities
- Design, build, and maintain scalable data storage solutions using Azure SQL Database, Azure Data Lake, and Azure Blob Storage
- Develop and manage robust data pipelines for ingestion, processing, and transformation
- Create optimized data models to support analytics and reporting needs
- Build and maintain ETL/ELT pipelines using Azure Data Factory or similar tools
- Process and transform large-scale datasets using Azure Databricks and Apache Spark
- Implement data validation, cleansing, and quality checks to ensure data accuracy and reliability
- Ensure data security, governance, and compliance across the data platform
- Collaborate with data engineers, architects, and business stakeholders to translate requirements into scalable Azure data architectures
- Support CI/CD processes using Azure DevOps
Required Skills & Qualifications
- 5+ years of experience as a Data Engineer, with strong focus on Azure
- Hands-on expertise in:
- Azure Data Factory
- Azure Databricks
- Azure Data Lake & Blob Storage
- Strong coding skills in:
- PySpark
- Python
- SQL
- Solid understanding of Apache Spark (core concepts & performance tuning)
- Experience with Big Data technologies
- Exposure to Azure DevOps (CI/CD, pipelines)
- Strong analytical and problem-solving skills
- Good communication skills and ability to work with cross-functional teams