Azure Data Engineer
infiligence
Job Description
- Design, develop, and maintain scalable data pipelines for batch and real-time data processing using Azure (preferred) or AWS cloud platforms.
- Build and optimize ETL processes to ensure high-quality, secure, and efficient data flow across systems.
- Collaborate with cross-functional teams to translate business requirements into robust data models and solutions.
- Implement data quality, data governance, and data security standards throughout the data lifecycle.
- Develop and maintain documentation, including design and mapping documents.
- Conduct code reviews, unit testing, and peer reviews to ensure code quality and compliance.
- Troubleshoot, monitor and resolve data pipeline and infrastructure issues to minimize business impact.
- Stay updated with new technologies and evaluate their organizational impact.