Data Engineer
morganstanley
Job Description
-
Designing, implementing, managing scalable data solutions using Snowflake environment for optimized data storage and processing.
-
Migrate existing data domains/flows from relational data store to cloud data store (Snowflake).
-
Identify and optimize new/existing data workflows.
-
Identify and implement data integrity practices.
-
Integrate data governance and data science tools with Snowflake ecosystem as per practice.
-
Support the development of data models and ETL processes to ensure high quality data ingestion in cloud data store.
-
Collaborate with team members to design and implement effective data workflows and transformations.
-
Assist in the maintenance and optimization of Snowflake environments to improve performance and reduce costs.
-
Contribute to proof of concept, documentation and best practices for data management and governance within the Snowflake ecosystem.
-
Participate in code reviews and provide constructive feedback to improve team deliverables quality
-
Design and develop data ingestion pipeline using Talend/Informatica using industry best practices.
-
Writing efficient SQL and Python scripts for large dataset analysis and building end to end automation process on a set schedule.
-
Design, implement data distribution layer using Snowflake REST API.
-