Senior DevOps Engineer

recrew

Bengalor 5 Years Exp Posted 9d ago

Job Description

  • Design, provision, and operate production-grade multi-region GCP infrastructure — owning the full stack from VPCs, IAM, and networking to compute, storage, and cloud security posture management
  • Architect and operate multi-cluster GKE environments: cluster lifecycle management, autoscaling (HPA, VPA, KEDA, Cluster Autoscaler), workload scheduling, network policies, and upgrade strategies
  • Build and maintain high-velocity CI/CD pipelines with blue-green, canary, and rolling deployment strategies; own GitOps workflows via ArgoCD or Flux for declarative, auditable Kubernetes delivery
  • Provision, schedule, and optimise GPU node pools for ML training, fine-tuning, and real-time inference — including MIG/time-sharing configurations, spot/preemptible handling with checkpointing, and cost-aware autoscaling
  • Build and own the full observability stack — metrics (Prometheus, Cloud Monitoring), structured logs, distributed traces (OpenTelemetry), and SLI/SLO dashboards — and lead end-to-end incident response including PIR documentation and preventive automation
  • Implement and maintain full IaC coverage using Terraform at module/workspace scale — including state backend management, drift detection, and automated plan/apply pipelines
  • Own cloud cost governance: resource tagging, utilisation monitoring, rightsizing, commitment-based discount strategies, and automated waste detection across GPU and general compute

 

Must Have Criteria

  • 5–8 years in DevOps, SRE, or platform engineering with hands-on ownership of production systems at scale — not tooling maintenance or pipeline-only roles
  • Deep GCP expertise (mandatory): GKE, Cloud Run, GCS, VPC, IAM, Secret Manager, Cloud Monitoring, Pub/Sub, and Artifact Registry in production environments
  • Production-grade Kubernetes: multi-cluster lifecycle management, autoscaling architectures (HPA/VPA/KEDA/Cluster Autoscaler), RBAC, network policies, and workload isolation
  • Terraform ownership at module/workspace scale: state backend management, drift detection, and automated apply pipelines in a multi-engineer team environment
  • CI/CD pipeline design and ownership for multi-service, high-velocity environments including GitOps delivery with ArgoCD or Flux
  • Hands-on GPU compute provisioning for ML workloads: NVIDIA node pools, device plugin configuration, MIG or time-sharing strategies, spot/preemptible handling, and cost-aware autoscaling
  • Observability engineering from scratch: Prometheus, Grafana, structured logging, distributed tracing (OpenTelemetry), alerting policy design, and production incident response with RCA documentation and follow-through
  • Working proficiency in at least one scripting/programming language — Python (preferred), Node.js, or Java — for automation, tooling, and infrastructure utilities; this is not primarily a coding role but technical depth matters

 

Nice to Have

  • AI serving infrastructure experience: Triton Inference Server, vLLM, or Ray Serve — including model versioning and A/B traffic routing
  • Service mesh implementation: Istio or Cilium for mTLS, traffic management, and zero-trust networking in production
  • FinOps tooling: Kubecost, Infracost, or equivalent for granular GPU and cloud cost attribution and rightsizing
  • Container security: image scanning (Trivy/Snyk), admission controllers (OPA Gatekeeper/Kyverno), and runtime security (Falco)
  • Chaos engineering facilitation: Litmus, Chaos Monkey, or structured game-day exercises for platform resilience validation

 

What We Offer

  • Foundational infrastructure ownership at India-scale — systems built for 100M+ users from day one, with a clear path to 1B-ready architecture
  • Direct exposure to cutting-edge AI compute infrastructure: GPU clusters, real-time inference serving, and multimodal ML pipelines
  • Startup-pace execution within the company's high-scale ecosystem — small pod, high autonomy, fast iteration, and outsized impact on a category-defining consumer AI product
    • Collaboration with ML engineers, platform architects, and product leadership on systems that matter to hundreds of millions of Indian users

Similar Openings for You