Data Engineer
bain
Job Description
- Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities
- Work across workstreams to deliver high-quality, zero-defect deliverables and leverage manager’s support on complex pieces
- Gather requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users
- Provides tool based technical expertise to the junior team members when required
- Builds reusable capabilities that can be used by team members or across service lines
- Write advanced SQL and Python code to build and maintain backend data APIs and services; work hands-on with Snowflake for data transformation, query optimization, and pipeline development
- Ensure that the data architecture is scalable and maintainable
- Design and develop RESTful backend APIs and microservices using Python (FastAPI/Flask) to expose data products and support downstream consumers
- Work with the business in designing and delivering correct, high quality data
- Investigate data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions
- Prepare documentation for further reference
- Respond to onshore team/client questions around the data and insights
- Provide ongoing support for subscription customers, such as additional data cuts and responding to questions about the data/methodology
- The working style of the team would be to support product development , hence the pipelines and algorithm built should be scalable and automated