Data/ETL Engineer

ascendion

Bangalore NM Years Exp Posted 29d ago

Job Description

Design, develop, and maintain scalable ETL pipelines using Python and PySpark 

Build and optimize data workflows on AWS services such as S3, Glue, Lambda, Redshift, and EMR 

Perform data ingestion, transformation, and validation from multiple data sources 

Optimize data processing performance and ensure data quality and integrity 

Implement data lake and data warehouse solutions 

Collaborate with cross-functional teams to understand data requirements 

Automate data workflows and scheduling using tools like Airflow or AWS Step Functions 

Monitor and troubleshoot data pipeline issues 

Ensure security, governance, and compliance of data systems