Data Engineer

morganstanley

Bengaluru 4 Years Exp Posted 2h ago

Job Description

  • Designing, implementing, managing scalable data solutions using Snowflake environment for optimized data storage and processing.

  • Migrate existing data domains/flows from relational data store to cloud data store (Snowflake).

  • Identify and optimize new/existing data workflows.

  • Identify and implement data integrity practices.

  • Integrate data governance and data science tools with Snowflake ecosystem as per practice.

  • Support the development of data models and ETL processes to ensure high quality data ingestion in cloud data store.

  • Collaborate with team members to design and implement effective data workflows and transformations.

  • Assist in the maintenance and optimization of Snowflake environments to improve performance and reduce costs.

  • Contribute to proof of concept, documentation and best practices for data management and governance within the Snowflake ecosystem.

  • Participate in code reviews and provide constructive feedback to improve team deliverables quality

  • Design and develop data ingestion pipeline using Talend/Informatica using industry best practices.

  • Writing efficient SQL and Python scripts for large dataset analysis and building end to end automation process on a set schedule.

    • Design, implement data distribution layer using Snowflake REST API.

Similar Openings for You