Software Engineer 4
global
Job Description
- Design and develop LLM APIs (chat, generate, search, ingest)
- Manage end-to-end API lifecycle including deployment and monitoring
- Implement and operate AI Gateway capabilities (streaming, rate limits, quotas)
- Build telemetry and observability frameworks using OpenTelemetry and tracing
- Develop SDKs using LangGraph / ADK frameworks
- Create and manage agent-based workflows
- Implement batch and async API patterns with promotion gates
- Ensure AI safety and governance through guardrails and content safety tools
- Collaborate with cross-functional teams to integrate AI solutions at scale
- Optimize performance, reliability, and scalability of AI platforms