Senior Data Engineer

smartrecruiters

Hyderabad, India 8 Years Exp Posted 44d ago

Create and maintain optimal data pipeline architecture,
Assemble large, complex data sets that meet functional / non-functional business requirements.
Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS, Azure ‘big data’ technologies.
Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs
Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems
Document source-to-target mappings
Re-engineer manual data flows to enable scaling and repeatable use
Write ETL (extract, transform, load) scripts and code to ensure the ETL process performs optimally
Develop business intelligence reports that can be reused
Supporting the Lead Data Engineer providing day to day supervision of the Data Science and Engineering team
Provide in-country coordination for the team ensuring the India team adheres to processes and policy at the local level