AI Infrastructure Engineer

AI Infrastructure Architecture :

- Design and implement asynchronous multi-agent orchestration

- Own end-to-end latency from user message to AI response

- Build resilient inference pipelines that gracefully degrade under load

- Implement intelligent request routing and load balancing for AI workloads

- Migrate critical AI conversation flow from monolith to dedicated services

- Implement WebSocket/streaming infrastructure for real-time chat

- Design circuit breakers and fallback strategies for AI model failures

- Build comprehensive observability for AI system performance

- Optimize credit data retrieval and caching strategies