AI Engineer, AVP
db
Job Description
- Design and build complex agentic systems with multiple interacting agents.
- Implement robust orchestration logic (state machines / graphs, retries, fallbacks, escalation to humans).
- Implement RAG pipelines, tool calling, and sophisticated system prompts for optimal reliability, latency, and cost control.
- Apply core ML concepts to evaluate and improve agent performance, including dataset curation and bias/safety checks.
- Lead the development of agents using Google ADK and/or LangGraph, leveraging advanced features for orchestration, memory, evaluation, and observability.
- Integrate with supporting libraries and infrastructure (e.g., LangChain/LlamaIndex, vector databases, message queues, monitoring tools) with minimal supervision.
- Define success metrics, build evaluation suites for agents (automatic + human evaluation), and drive continuous improvement.
- Curate and maintain comprehensive prompt/test datasets; run regression tests for new model versions and prompt changes.
- Deploy and operate AI services in production, establishing CI/CD pipelines, observability, logging, and tracing.
- Debug complex failures end-to-end, identifying and document root causes across models, prompts, APIs, tools, and data.
- Work closely with product managers and stakeholders to shape requirements, translate them into agent capabilities, and manage expectations.
- Document comprehensive designs, decisions, and runbooks for complex systems.