EY - GDS Consulting - AI And DATA - AWS Data Engineer - Senior
ey
Job Description
- Develop, optimize, and deploy scalable ETL/ELT pipelines using PySpark, SQL, and AWS services.
- Build and manage data lakehouse solutions leveraging AWS S3, Glue, Iceberg, and other AWS-native components.
- Migrate on premises ETL workloads to modern AWS-based architectures with a focus on performance, reliability, and cost efficiency.
- Implement metadata-driven ingestion frameworks and medallion/layered architecture (Bronze/Silver/Gold).
- Work on orchestration frameworks such as Astronomer (Airflow), AWS Step Functions, or AWS-managed workflows.
- Design and optimize Spark-based data processing jobs for high throughput.
- Follow data warehouse (DW) concepts and best practices for modeling and data integration.
- Collaborate with data analysts, data scientists, and BI engineers for seamless data delivery.
- Perform code reviews, troubleshoot issues, and ensure end-to-end data quality.
- (Optional) Leverage Databricks for PySpark, Delta Lake, Lakehouse, or workflow orchestration where applicable.