Data/ETL Engineer
ascendion
Job Description
Design, develop, and maintain scalable ETL pipelines using Python and PySpark
Build and optimize data workflows on AWS services such as S3, Glue, Lambda, Redshift, and EMR
Perform data ingestion, transformation, and validation from multiple data sources
Optimize data processing performance and ensure data quality and integrity
Implement data lake and data warehouse solutions
Collaborate with cross-functional teams to understand data requirements
Automate data workflows and scheduling using tools like Airflow or AWS Step Functions
Monitor and troubleshoot data pipeline issues
Ensure security, governance, and compliance of data systems