Senior Data Engineer
happiestminds
Job Description
- Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure Data Factory.
- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality data solutions.
- Implement data integration processes to ingest, transform, and store data from various sources into data lakes and warehouses.
- Optimize data workflows and ensure data quality, reliability, and performance.
- Utilize Palantir for data analysis and visualization, providing actionable insights to the business.
- Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal downtime.
- Stay updated with the latest industry trends and technologies related to data engineering and cloud computing.
- Mentor junior data engineers and contribute to team knowledge sharing.