Senior Azure DevOps Engineer

Key Responsibilities

Azure DevOps & CI/CD Engineering

• Design, build, and maintain CI/CD pipelines using Azure DevOps for data engineering and analytics workloads
• Automate build, release, and deployment of Azure Data Factory pipelines, Databricks notebooks, Power BI artifacts, and configurations
• Implement Git-based branching, versioning, and release strategies across multiple environments
• Reduce manual deployment effort through automation, standardization, and reusable templates

Azure Cloud & Infrastructure Management

• Provision and manage Azure infrastructure supporting big data and analytics platforms using DevOps practices
• Support and maintain Azure Data Factory, Azure Databricks, ADLS Gen2, and related services
• Design scalable and high-performance Azure environments for batch and near real-time data processing
• Optimize resource utilization, performance, and cloud costs

Data Platform DevOps & Administration

• Administer and support Azure Databricks workspaces at enterprise scale
• Implement and manage Unity Catalog for centralized governance, security, and access control
• Enforce data governance, encryption, RBAC, and compliance standards across environments
• Partner with data engineering teams to improve pipeline reliability, performance, and uptime

Automation & Scripting

• Develop automation using Python, PySpark, SQL, and shell scripting
• Automate environment provisioning, data migrations, and artifact deployments
• Build reusable frameworks for repeatable, auditable, and controlled releases

Monitoring, Security & Reliability

• Implement monitoring and alerting for data pipelines and Azure services
• Ensure high availability and SLA adherence for batch and streaming workloads
• Embed DevSecOps practices, including secrets management and secure access patterns

Collaboration, Governance & Delivery

• Work closely with data engineers, BI developers, cloud architects, and business teams
• Provide platform guidance and DevOps best practices to cross-functional teams
• Document CI/CD standards, deployment processes, and operational runbooks
• Drive continuous improvements that enhance delivery efficiency and reduce operational overhead

Required Technical Skills

• Azure DevOps (Repos, Pipelines)
• Azure Data Factory, Azure Databricks, ADLS Gen2
• CI/CD automation for data and analytics platforms
• Python, PySpark, SQL
• Git-based source control and release management
• Power BI deployment and migration automation
  • Data governance, security, and access control (Unity Catalog preferred)