Senior Lead Data Engineer
fisglobal
Job Description
What you will be doing:
-
Work jointly with other team members to meet deliverables under tight deadlines.
-
Very good analytical, prioritization and problem solving skills
-
Ability to learn quickly and adapt to new situations, directives, and priorities
-
Good interpersonal skills.
What you bring:
- Having 6- 10 years’ experience in Data warehouse/ETL/ELT/CLOUD projects.
- Design and implement data pipelines using Snowflake/DBT, ensuring scalability, reliability, and performance.
- Develop ELT processes to extract, Load and transform data from various sources into Snowflake.
- Develop Python script to processes/Load/transform data from various sources into Snowflake.
- Collaborate with stakeholders to understand data requirements and translate them into technical solutions.
- Utilize DBT (Data Build Tool) and Airflow for orchestration, scheduling, and monitoring of data workflows.
- Optimize and tune existing data pipelines for improved efficiency and performance.
- Implement best practices for data modeling, ensuring data consistency and accuracy within Snowflake.
- Troubleshoot issues related to data pipelines, identifying and resolving bottlenecks or discrepancies.
- Stay updated with the latest advancements in Snowflake, DBT, Airflow, and other relevant technologies.
- Document processes, workflows, and configurations for reference and future improvements.