Tech Lead - Databricks + AWS Job
yash
Job Description
- Note: Resources should be familiar with Iceberg Tables.
- Design, develop, and maintain scalable data pipelines using AWS services.
- Build and optimize ETL/ELT workflows for structured and unstructured data.
- Implement data ingestion solutions using AWS Databricks.
- Develop and manage data lakes and data warehouse solutions on AWS.
- Create and maintain data models, transformations, and processing frameworks.
- Implement data governance, data quality, security, and compliance controls.
- Monitor and optimize data platform performance, scalability, and cost.
- Develop reusable frameworks and automation for data orchestration and deployment.
- Troubleshoot data-related issues and provide production support.
Data Engineering and Data Builder :
• Build Bronze, Silver and Gold data assets
• Develop reusable enterprise data products
• Create pipelines, transformations and data integrations
• Implement CI/CD, monitoring and operational support of use cases through MVP
• Operationalize MVP solutions into production-ready assets