Expert Senior Manager, AI Engineering
bain
Job Description
- Design, build, and deploy end-to-end generative AI systems, including multi-agent workflows and production-grade AI applications.
- Architect multi-component pipelines, including:
- Retrieval-Augmented Generation (RAG)
- Fine-tuning and parameter-efficient tuning
- Embedding generation and optimization
- Hybrid retrieval strategies (vector, graph, keyword)
- Integrate reasoning, tool use, function calling, and orchestration across complex workflows
- Engineer advanced agentic systems, ensuring clear separation of concerns, robust memory architecture, and scalable tool ecosystems
- Lead everything from early-stage research, model experimentation, and evaluation design to production system deployment
- Oversee API development, microservices, CI/CD pipelines, observability, and cloud-native deployment
- Build scalable GenAIOps processes for automated testing, regression evaluation, latency monitoring, and continual improvement
- Balance performance, safety, responsible AI principles, and cost across system design:
- Implement guardrails, fallbacks, red-teaming strategies, and human-in-the-loop (HITL) workflows
- Partner with global ethics teams to ensure alignment with Bain’s Responsible AI standards
- Build automated evaluation suites integrating user signals, continual learning cycles, and ongoing model updates
- Design and implement evaluation frameworks covering:
- Hallucination rate and factual consistency
- Relevance and precision/recall
- Latency, throughput, and system-level performance
- Cost tracking and efficiency
- Partner closely with product, engineering, data science, ethics, and infrastructure teams to build robust, compliant AI systems
- Act as a thought partner to executives and clients on AI strategy, architecture decisions, emerging capabilities, and implementation roadmaps
- Mentor and upskill technical teams on best practices including RAG, agents, prompt engineering, and AI safety