Cluster DevOps / SRE Engineer
recrew
Job Description
- Design, deploy, and manage large-scale GKE (Google Kubernetes Engine) clusters for AI/ML training and inference workloads
- Build and maintain CI/CD pipelines using Cloud Build and ArgoCD to automate model training, evaluation, and deployment workflows
- Monitor cluster health, performance, and reliability using Google Cloud Monitoring and Grafana; drive incident response and root cause analysis (RCA)
- Optimize GPU utilization across multi-node training jobs on GCP, managing resource scheduling and job queuing systems
- Collaborate with AI researchers to provision GCP infrastructure for large-scale distributed training experiments
- Implement and enforce security, IAM access control, and compliance standards across GCP compute infrastructure
- Automate infrastructure provisioning and configuration management using Terraform on GCP