Sr. Software Engineer

• Build and operate the production AI platform that supports model serving, inference, and AI services.
• Develop scalable retrieval, knowledge management, and data ingestion pipelines to support AI-driven operations.
• Build APIs, platform services, and automation that integrate AI capabilities into ClusterWareAI.
• Implement AI observability, monitoring, evaluation, and operational tooling for production AI services.
• Optimize inference performance, scalability, reliability, and operational efficiency.
• Build and maintain CI/CD pipelines and deployment automation for AI applications.
• Partner with AI, platform, and software engineering teams to deploy AI capabilities into production.
• Contribute to platform security, reliability, and operational excellence.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• 7+ years of software engineering, platform engineering, or infrastructure engineering experience.
• Strong programming skills in Python.
• Experience developing and operating production AI or LLM-powered applications.
• Experience with Kubernetes, Docker, and cloud-native architectures.
• Experience with model serving technologies such as vLLM, NVIDIA Triton Inference Server, or similar platforms.
• Experience building REST APIs, microservices, and distributed systems.
  • Familiarity with vector databases, retrieval systems, and RAG architectures.