Sr.Azure Databricks Engineer
persistent
Job Description
- Design and develop scalable data pipelines using Azure Databricks (PySpark)
- Build and maintain robust ETL/ELT workflows for large-scale data processing
- Develop and optimize complex SQL queries in Snowflake for analytics and reporting
- Integrate data pipelines using Azure services such as ADF, ADLS, and Synapse
- Design and manage Snowflake data warehouse structures (tables, views, pipelines)
- Perform performance tuning of Spark jobs and Snowflake workloads
- Implement data quality, validation, governance, and monitoring mechanisms
- Collaborate with business stakeholders to gather requirements and deliver data solutions
- Troubleshoot and resolve data pipeline and production issues