Engineer 3, Data Engineering
comcast
Job Description
- Design, develop, and optimize enterprise-scale data pipelines and ETL/ELT frameworks using Python, PySpark, and Apache Spark.
- Build and support scalable data platforms on AWS using services such as S3, Glue, Athena, Redshift, and Lambda.
- Lead development of robust data ingestion, transformation, and integration solutions for large-scale datasets.
- Design and implement data quality frameworks, validation controls, monitoring mechanisms, and remediation processes.
- Drive metadata management, data cataloging, data lineage, and business glossary initiatives across data platforms.
- Collaborate with Data Stewards, Data Owners, Architects, Product Teams, and Engineering teams to implement governance requirements.
- Define and promote data governance standards, controls, and best practices across data engineering teams.
- Support governance adoption through automation, engineering standards, and reusable framework development.
- Develop and maintain data models supporting reporting, analytics, and business intelligence requirements.
- Build solutions based on Medallion Architecture and Lakehouse design principles.
- Contribute to Common Data Engineering frameworks, standards, accelerators, and reusable components.
- Analyze and resolve complex data quality, reliability, and performance issues across data platforms.
- Ensure compliance with enterprise security, privacy, regulatory, and governance requirements.
- Review code, mentor junior engineers, and contribute to the overall technical growth of the team.
- Drive operational excellence through monitoring, optimization, automation, and continuous improvement initiatives.