Muoro - Senior Data Engineer

Key Responsibilities :

- Design and implement scalable and robust data pipelines using ETL processes to ingest, transform, and load data from various sources into our data warehouse.

- Develop and maintain data models that support business requirements and ensure data consistency and integrity.

- Build and optimize data solutions using Azure Databricks and Spark/PySpark for large-scale data processing and analysis.

- Implement and enforce data governance policies and procedures to ensure data quality, security, and compliance.

- Collaborate with data scientists and analysts to understand their data needs and provide them with the necessary data infrastructure and tools.

- Monitor and troubleshoot data pipeline performance, identify bottlenecks, and implement solutions to improve efficiency and reliability.

- Contribute to the development of data architecture standards and best practices.

- Mentor junior data engineers and provide technical guidance.

Required Skillset:

- Demonstrated ability to design, develop, and maintain complex data pipelines using ETL tools and techniques.

- Strong proficiency in SQL and experience working with relational databases.

- Hands-on experience with Python and Spark/PySpark for data processing and analysis.

- Solid understanding of data modeling principles and experience designing data warehouses and data marts.

- Experience with Azure Databricks and other Azure data services.

- Knowledge of data governance principles and practices.

- Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

- Ability to solve complex problems and think critically about data-related challenges.

- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 6-10 years of experience in data engineering or a related role.