Data Engineer (AWS+Pyspark)
oraclecloud
Job Description
- Design, develop, and maintain scalable data pipelines using PySpark and AWS services.
- Optimize and manage data workflows for performance and reliability.
- Write efficient and maintainable SQL queries for data extraction, transformation, and analysis.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure data quality, integrity, and security across all stages of the pipeline.
- Participate in code reviews, testing, and documentation.
- Take ownership of tasks and drive them to completion with minimal supervision.