EY - GDS Consulting - AI and DATA - MS Fabric DE
ey
Job Description
Key Responsibilities:
- Design, develop, and manage data solutions using Microsoft Fabric, including Lakehouse, Data Engineering, Pipelines, Spark, Notebooks, and KQL Database.
- Implement ETL/ELT processes to ensure efficient data integration and transformation.
- Create and maintain data models to support business intelligence and analytics initiatives.
- Utilize Azure data storage services (e.g., Azure SQL Database, Azure Blob Storage, Azure Data Lake Storage) for effective data management.
- Collaborate with cross-functional teams to gather requirements and deliver data solutions that meet business needs.
- Write and optimize code in SQL, Python, PySpark, and Scala for data processing and analysis.
- Implement DevOps practices and CI/CD pipelines for seamless data deployment and version control.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Communicate effectively with diverse teams to foster collaboration and knowledge sharing.