Data Engineer
allianz
Job Description
- Working with peers and senior colleagues on solutions design activity for items allocated to you in the backlog.
- Developing, implementing, testing and documenting scalable ETL (Extract, Transform, Load) data pipelines and workflows to efficiently ingest and transform data from various sources.
- Working collaboratively with internal customers to deliver high-quality fit for purpose solutions.
- Implementing data security measures to ensure compliance with data privacy regulations.
- Peer reviewing work of colleagues to ensure delivery of robust solutions and improve your understanding of the code base.
- Collaborating with stakeholders and analysts to understand their data requirements.
- Staying up-to-date with industry trends and best practices in data engineering to drive continuous improvement and innovation.
- Design and support data platforms that enable Generative AI, RAG, vector search, and semantic retrieval solutions.
- Develop and optimize data pipelines for embedding generation, document indexing, and AI-ready data products.
- Leverage Microsoft Copilot and other AI-assisted engineering tools to improve code quality, automate development tasks, accelerate troubleshooting, and increase delivery velocity.
- Continuously evaluate and adopt modern automation, orchestration, and AI technologies to optimize platform operations and engineering efficiency.
- Continuously evaluate and adopt modern automation, orchestration, and AI technologies to optimize platform operations and engineering efficiency.