Senior AI/ML Engineer — Agentic Systems
keka
Job Description
- Build the governance engine — reasoning against business rules, compliance validation with green/red-line thresholds, and action execution
- Design multi-agent orchestration across the 6-n stage pipeline with structured reasoning chains and tool-use patterns
- Implement multi-format document extraction (PDF, TIFF, JPG, structured data) using OCR, layout analysis, and table extraction models
- Build the decision graph / context graph that accumulates institutional knowledge from human-in-the-loop interventions
- Develop the Evals Engine for A/B testing across LLM providers (GPT-4, Claude, Llama, Mistral) with regression testing
- Implement responsible AI guardrails — bias detection, confidence calibration, explainability layers
Optimize inference cost and latency through quantization, caching, and intelligent model routing
Must-Have Technical Skills
- Production LLM experience —Anthropic, Bedrock APIs + open-source models (Llama, Mistral)
- Agentic frameworks — Strands Agents, LangChain, LangGraph, CrewAI, AutoGen, or custom multi-agent systems
- Document AI — OCR, layout parsing (LayoutLM), table extraction, Textract/Unstructured.io
- Vector databases — OpenSearch, Pinecone, Weaviate, pgvector; RAG architecture design
- Strong async Python engineering — production-grade, not notebook-level
- AWS ML services — SageMaker, Bedrock, Lambda, S3, EKS
- Model evaluation methodologies — accuracy metrics, A/B testing, LLM regression suites