Data Engineer-Data Platforms-Databricks
ibm
Job Description
Develop Databricks Platform: Implement Data and AI use cases on the Databricks platform, ensuring seamless integration and optimal performance.
• Enhance Data Engineering: Design and develop data engineering solutions on Databricks, aligning with client requirements and industry best practices.
• Collaborate on Cloud Solutions: Work with stakeholders to deliver cloud-based data solutions, leveraging Databricks and data engineering expertise.
Required education
Bachelor's Degree
Preferred education
Bachelor's Degree
Required technical and professional expertise
• Databricks Platform Expertise: Experience with designing and implementing Data and AI use cases on Databricks platform, with a strong understanding of its architecture and components.
• Data Engineering Knowledge: Experience with data engineering principles, methodologies, and tools, including data warehousing, ETL, and data governance.
• Cloud Computing Skills: Experience with cloud-based data solutions, including migration, deployment, and management of data workloads on cloud platforms.
• Technical Implementation: Experience with implementing data engineering solutions on Databricks, including data pipeline development, data quality, and data security.
• Use Case Development: Experience with developing and deploying Data and AI use cases on Databricks platform, including data preparation, model training, and model deployment.
Preferred technical and professional experience
• Cloud Migration Expertise: Experience with migrating data workloads to cloud platforms, including assessing existing infrastructure and applications for cloud readiness.
• Advanced Data Engineering: Experience with designing and implementing complex data engineering solutions on Databricks, including data pipeline development and data quality.
• AI Use Case Development: Experience with developing and deploying AI use cases on Databricks platform, including data preparation, model training, and model deployment.