Senior Data Engineer

kroll

Hyderabad 5 Years Exp Posted 15d ago

Job Description

  • Design and build scalable organizational data infrastructure and Medallion architecture within a Lakehouse environment

  • Develop robust, fault-tolerant ETL/ELT applications for seamless data ingestion, transformation, and distribution to enable analytics, reporting, and AI workloads

  • Work with different stakeholders and teams to assist with data related technical solutions and support their data infrastructure needs

  • Explore and experiment with new use cases, frameworks, and tools to enhance AI capabilities, ensuring data integrity, quality, and reliability

  • Identify and implement infrastructure re-designs to improve scalability, optimize data delivery, and automate manual workflows

  • Choose the best tools/services/resources to build robust data pipelines

  • Collaborate with cross-functional teams to understand data requirements, create robust data models, and deliver actionable insights

  • Monitor, troubleshoot, and optimize jobs for performance, addressing data pipeline bottlenecks and ensuring cost efficiency

  • Continuously improve engineering processes, balancing speed, quality, and business impact

  • Coach, mentor, and provide technical guidance to junior engineers, fostering a culture of continuous learning and development

    • Stay updated on emerging technologies and trends in data engineering, recommending and implementing innovative solutions