Senior Data engineer

• As a Senior Data Engineer, you will be involved in data Lakehouse development including requirements gathering, database modeling, ETL job design & development, and dashboard/report development activities.
• You will be working with the Customer Experience team to build and enhance a cloud-based warehouse of operational data to drive analytics.
• You will be responsible for developing ETL/data pipelines using Talend, SQL, and Python, and ingesting data from various external sources into large MPP data warehouses like Azure Synapse, Hive, Snowflake or similar.
• You will frequently conduct data analysis, ingest data from various external & internal sources, write advanced database queries, and optimize data storage needed by business and/or executive operations.
• You will enable daily business activities by providing the foundation of all federated querying and analysis produced by the BI and Data Science teams.
• You will have the opportunity to work with modern data stack components and continuously grow by learning new tools and technologies in a collaborative, data-driven environment.

Position Requirements

Basic Qualifications:

· Bachelor’s/Master’s degree in Computer Science, Mathematics, or Science.

· Minimum 5 years of experience in ETL development and coding, including validation of complex data mappings.

· Hands-on experience with ETL Tool Talend (minimum 5 years).

· Proficient in SQL with at least 8 years of experience in developing complex SQL queries for data validation.

· Experience in Python for data processing and transformation tasks.

· Strong experience with data warehouse databases such as Azure Synapse, Hive, Snowflake, SQL Server, or Redshift.

· Experience and knowledge in ingesting data from various external sources is a must have.

· Excellent oral and written communication skills.

· Experience working with cloud-based data platforms.

Preferred Qualifications:

· Exposure to Databricks for big data processing and orchestration.

· Experience with BI tools like Tableau or Power BI.

· Familiarity with Agile Scrum development methodologies.

· Experience working in or exposure to Data science / Machine learning / Gen AI based projects