Data Engineer III

thermofisher

Bangalore 6 Years Exp Posted 8d ago

Perform source to target data analysis and mappings.
Build, test, and optimize data pipelines for various use-cases, including real-time and batch processing, based on specific requirements.
Collaborate with admins, developers, data engineers and analysts for successful functionality delivery
Perform requirement analysis and co-ordinate with project managers and development team to drive the delivery cycle.
Collaborate with the scrum master on product backlogs and helps with sprint planning.
Supports the evolution of EDP architecture and takes part in roadmap activities around data platform architecture initiatives or changes.
Collaborate with leadership and stakeholders to ensure data quality and integrity in DWH & AWS platforms for BI/Analytical reporting.
Pre-meditate any risks well in advance and communicate to stakeholders to formulate the plan of action to mitigate any risks.
Follow agile development methodologies to deliver solutions and product features by following DevOps practices.
Ensure the teams follow the prescribed development processes and approaches.
Knowledge of Large Language models and proven experience in developing LLM applications to improve the productivity of data engineering.

Must have skills and experience

6+ years of overall work experience with 4+ years exclusively in delivering data solutions.
3+ years of proven experience building Cloud BI solutions using AWS or Azure.
Experience with agile development methodologies by following DevOps, Data Ops and Dev Sec Ops practices.
4+ years of programming in SQL, Pyspark and Python.
Excellent written, verbal and interpersonal and partner communication skills.
Excellent Analysis and business requirement documentation skills.
Ability to work with multi-functional teams from multiple regions/ time zones by optimally demonstrating multi-form communication (Email, MS Teams for voice and chat, meetings)
Excellent prioritization and problem-solving skills.
GPT, Large Language Models, Retreival augmented Generation.

Hands on experience with Snowflake or Azure data engineering.
Knowledge of SQL and NoSQL databases like PostgreSQL, MySQL, MongoDB Cassandra.
Experience in building data pipelines in Databricks.
Data visualization experience using tools such as Power BI or Tableau.
Knowledge of data governance practices, data quality, and data security.
Relevant certifications in data engineering on cloud platforms.
- Basic understanding of machine learning and Generative AI concepts.