Senior Data Engineer
kroll
Job Description
-
Design and build scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment
-
Develop robust, fault-tolerant ETL/ELT applications for seamless data ingestion, transformation, and distribution to enable analytics, reporting, and AI workloads
-
Work with different stakeholders and teams to assist with data related technical solutions and support their data infrastructure needs
-
Explore and experiment with new use cases, frameworks, and tools to enhance AI capabilities, ensuring data integrity, quality, and reliability
-
Identify and implement infrastructure re-designs to improve scalability, optimize data delivery, and automate manual workflows
-
Choose the best tools/services/resources to build robust data pipelines
-
Collaborate with cross-functional teams to understand data requirements, create robust data models, and deliver actionable insights
-
Monitor, troubleshoot, and optimize jobs for performance, addressing data pipeline bottlenecks and ensuring cost efficiency
-
Continuously improve engineering processes, balancing speed, quality, and business impact
-
Coach, mentor, and provide technical guidance to junior engineers, fostering a culture of continuous learning and development
-
Stay updated on emerging technologies and trends in data engineering, recommending and implementing innovative solutions
-