DevOps Engineer

Azure DevOps & CI/CD Automation:

• Design, implement, and maintain CI/CD pipelines using Azure DevOps and GitHub Actions.
• Automate deployment processes for Azure Databricks, Azure Data Factory, Terraform, and related Azure services.
• Develop reusable deployment frameworks and automation scripts to reduce manual intervention.
• Support release management and deployment validation across Sandbox, Non-Prod, and Production environments.
• Troubleshoot deployment failures, pipeline issues, and Git merge conflicts.
• Implement infrastructure-as-code (IaC) solutions using Terraform.

Azure Databricks Administration & Automation:

• Implement and maintain Azure Databricks CI/CD solutions.
• Automate Databricks repository synchronization and notebook deployments.
• Support Databricks workflow migration and environment onboarding.
• Configure Databricks Access Connectors, networking, and managed identity integrations.
• Collaborate with Databricks solution teams to implement Service Principal-based CI/CD approaches.
• Support Databricks networking, private endpoints, firewall configurations, and serverless integrations.

Azure Data Factory (ADF) Support:

• Design and implement custom ADF deployment automation solutions.
• Develop selective ADF deployment frameworks supporting linked services, datasets, pipelines, and triggers.
• Support ADF CI/CD implementation using Microsoft recommended approaches.
• Perform ADF environment refactoring and migration activities.
• Support deployment validation and production release activities.

Cloud Infrastructure & Terraform:

• Develop and maintain Terraform modules for Azure infrastructure provisioning.
• Provision and manage Azure networking components including VNets, NSGs, route tables, subnets, and private DNS zones.
• Manage Azure resource locks, firewall rules, private endpoints, and DNS integrations.
• Perform Terraform state management, imports, refactoring, and environment migrations.

Collaboration & Operational Support:

• Work closely with Data Engineering, Cloud Infrastructure, and Solution Architecture teams.
• Conduct DevOps knowledge-sharing sessions and technical walkthroughs.
• Support environment monitoring, issue resolution, and production deployments.
• Participate in change management, deployment approvals, and operational support activities.
  • Provide recommendations to improve platform reliability, security, and deployment maturity.