SR AI ENGINEER CONSULTANT I
lumen
Job Description
- Solutioning using new technologies with a fail-fast, learn-fast mindset; own PoCs and pilot deployments.
- Architect composable pipelines across LLMs and core ML; design reusable components (RAG, embeddings, prompt chains).
- Lead technical discovery, map high-impact use cases, and translate them into modular designs.
- Implement robust MLOps: standardized experiment tracking, model registries, automated CI/CD, and Kubernetes-based serving.
- Integrate vector stores, retrieval services, and policy/guardrails for safety and compliance.
- Establish observability baselines (tracing, metrics, drift/alignment dashboards) for both agents and models.
- Perform advanced agent evaluation (task success, tool-use correctness, groundedness, hallucination checks) and RAG evals.
- Collaborate with product and platform teams to drive adoption and handover to production.
- Experience in quality assurance solutioning and automation tools exposure would be an added advantage