Senior DevOps Engineer

Design, build, and maintain GitLab CI/CD pipelines for EDP data engineering assets, Databricks jobs, workflows, notebooks, SQL assets, and platform configurations.

Infrastructure as Code

Build, maintain, and improve Terraform modules for AWS infrastructure, Databricks workspace configuration, networking, IAM, storage, and platform components.

Databricks Deployment Automation

Implement and standardize Databricks Asset Bundles (DAB) for deploying Databricks workflows, jobs, notebooks, permissions, and environment-specific configurations.

AWS Platform Engineering

Support AWS-native platform components including S3, IAM roles, KMS, STS, VPCs, subnets, security groups, route tables, VPC endpoints, PrivateLink, and cross-account access patterns.

Release Management

Support structured release governance across Dev, QA, QA2, Prod, and DR environments, including release tagging, deployment validation, rollback planning, and production readiness checks.

Monitoring & Observability

Improve monitoring and alerting for Databricks jobs, workflows, pipelines, SQL warehouses, batch SLAs, cloud services, and platform health using Databricks system tables, cloud logs, dashboards, and alerts.

Security & Access Controls

Automate and govern least-privilege access using IAM roles, service principals, Unity Catalog permissions, storage access controls, secrets, KMS encryption, and audit logging.

Network & Connectivity

Support secure connectivity patterns involving Databricks on AWS, S3, PrivateLink, VPC endpoints, enterprise network inspection, DNS, controlled ingress/egress, and cross-cloud transition scenarios.

Operational Excellence

Partner with AMS and engineering teams to improve incident triage, root cause analysis, batch monitoring, SLA visibility, production support handoffs, and operational runbooks.

Engineering Standards

Help define and enforce standards for GitLab workflows, merge request checks, deployment approvals, unit testing, release validation, and reusable deployment patterns.

Platform Modernization

Contribute to EDP’s AWS migration and modernization roadmap, including platform automation, environment consistency, scalable deployment patterns, and improved operational resilience.