Databricks Developer

Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.

• Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.

• Develop data transformation and ingestion processes from multiple data sources, including databases, APIs, and third-party systems.

• Collaborate with business analysts, data architects, and stakeholders to understand data requirements and deliver effective solutions.

• Write efficient and maintainable code using Python, PySpark, SQL, and related technologies.

• Monitor, troubleshoot, and optimize data processing jobs to ensure performance, reliability, and scalability.

• Implement data quality checks, validation processes, and governance best practices.

• Work with cloud platforms such as Azure, AWS, or Google Cloud to support data engineering initiatives.

• Participate in code reviews, testing, deployment, and documentation activities.

• Stay updated with the latest Databricks features, data engineering practices, and industry trends.