MODULE LEAD
happiestminds
Job Description
- Design, develop, and maintain scalable data pipelines using Azure Data Lake (ADLS), Azure Data Factory (ADF), Microsoft Fabric, and Apache Spark
- Build and optimize data processing solutions using Python (PySpark preferred)
- Implement Medallion Architecture (Bronze, Silver, Gold layers) for structured data processing
- Develop restartable, fault-tolerant pipelines with robust audit and logging frameworks
- Develop and manage source control and CI/CD pipelines in Azure DevOps (ADO)
- Write and optimize complex SQL queries, stored procedures, and data transformations
- Design and manage shared and certified Power BI datasets for enterprise reporting
- Design and deliver interactive and performant Power BI dashboards and reports
- Implement data modeling techniques (star schema, snowflake schema)
- Ensure data quality, governance, and security
- Collaborate with cross-functional teams
- Troubleshoot performance issues
- Support, maintain, and enhance legacy MSBI solutions using SQL Server, SSIS, SSAS, and SSRS
- Design and develop ETL workflows using SSIS and manage data models in SSAS
- Develop and maintain enterprise reports using SSRS
- Participate in modernization and migration of MSBI solutions to Microsoft Fabric architecture