Global IT Platform Engineer Expert Senior Manager - Gen AI/ LLM Ops

bcg

Gurgaon 12 Years Exp Posted 500d ago

Job Description

 

Bachelor's degree in computer science engineering (or equivalent degree or experience)  Proven building and supporting scalable, reliable Gen AI or LLM powered applications in production.  Proven experience in building & enabling self-serve observability tools, dashboards for engineering teams. 12+ years of relevant experience in delivering and maintaining platform or complex technology solutions with strong technical background, preferably in global organization/ enterprise. 1+ years of experience in develop, deploy, test, and maintain production-grade access to LLMs and related services.  Strong expertise in Modern Engineering, DevOps / GitOps, Infra as a Code practices - Strong understanding of CI/CD, AI/ ML pipelines and automation tools. Experience & Skills (Mandatory)¿ Strong knowledge and experience in Generative AI/ LLM based development.  Strong experience in building and integrating LLM observability tools  Strong experience in optimizing LLM performance, usage and cost Strong experience in building CI/CD pipeline templates for AI SDLC (ML Ops, RAG pipelines, Data Ingestion pipelines)  Proficiency in cloud platforms (AWS, Azure, GCP) and infrastructure as code (Terraform, Terraform Cloud, Github Actions, ArgoCD and equivalent).  Experience with containerization and orchestration technologies (Kubernetes, Docker). Strong experience working with and enabling key LLM models APIs (e.g. AWS Bedrock, Azure Open AI/ OpenAI) and LLM Frameworks (e.g. LangChain, LlamaIndex).¿ Expertise in building enterprise grade, secure data ingestion pipelines for structured/ unstructured data – including indexing, search, and advance retrieval patterns.¿ Proficiency in Python, Go, Terraform (and equivalent)  Experience in LLM Testing and Evaluation is preferred  Experience with security related to LLM integration is preferred  

Similar Openings for You