Senior Data Engineer
swissre
Job Description
- Lead and design robust, scalable data pipelines and ETL processes using Python, PySpark, and other modern technologies
- Architect and implement complex data models and structures in various databases including MongoDB and SQL Server
- Build and optimize enterprise-level data workflows using Palantir / Azure AI Foundry platforms to ensure efficient data processing
- Drive collaboration with data scientists, analysts, and business stakeholders to understand data requirements and deliver appropriate solutions
- Establish data quality standards by implementing validation procedures, monitoring systems, and data governance practices
- Lead troubleshooting efforts for complex data issues while maintaining system performance
- Evaluate and recommend new data technologies to continuously improve our data infrastructure
- Create and maintain technical specifications, processes, and best practices for sharing knowledge
- Mentor and develop junior engineers and contribute to establishing engineering standards across the organization