Software Engineer/AI-ML
jointhehartford
Job Description
- Responsible for design and implementation of AI/ML solutions, enabling comprehensive end-to-end transformation and process reimagination in underwriting, claims, operations, and corporate functions.
- Collaborate with Data Science Practitioners, LOB IT leads, EA, Data, and AI architects to develop solutions and integrate into operational processes and systems supporting various functions.
- Design, build and maintain scalable Agentic AI systems, including multi-agent workflows, remote Agent orchestration, tool calling, and human-in-the-loop (HITL) feedback.
- Implement Evaluation-driven development harness, grading logic, rubrics for evaluating AI Agents and tuning it for quality, safety, and reliability.
- Design and implement AI Agent memory systems to support hyper personalized multi-turn conversation, and self-improvement from HITL feedback (Episodic memory).
- Build full stack AI Agents with latest Agentic AI/UI frameworks & standards. Such as A2A, AAIF, A2UI, Agent skills, and MCP.
- Leverage AI Platform and agent and model operations frameworks (e.g., AgentOps, AIOps, FMOps) to automate and streamline build, deployment, monitoring and maintainance of agentc solutions, AI/ML pipeline, machine learning and data science models.
- Contribute to our starter packs (ADK/MCP), Horizontal Agents, and SDKs to tailor and deploy solutions across various use cases accelerating time to market.
- Apply advanced context engineering techniques like context splitting, advanced coordination, UX negotiation, checkpointing, and context offloading to build complex multi-agent systems using A2A and Agent fabric.
- Design and implement adaptive/dynamic prompting using various techniques like automated prompt optimizer, DSPy etc. Hands-on expertise with prompt management libraries using Vertex AI SDK is a plus.
- Collaborate with AIOps, Platform, and Cloud teams to set up infrastructure and deploy Cloud services and tools on the HIG AI platform, while integrating DevOps tools and release management workflow. Troubleshoot platform issue along with AIOps engineer.
- Develop advanced RAG systems, such as Agentic RAG, and use advanced techniques & methodology like HyDE, RAPTOR, and GraphRAG to enhance accuracy and relevancy.
- Build production grade ML/DL models using PyTorch, TensorFlow, scikit learn for anomaly detection, segmentation, risk scoring, recommendation system, rating & pricing models.
- Develop and deploy backend inference services for machine learning models using FastAPI/REST to the LOB-serving MLOps platform.
- Write high-quality Python code using advanced libraries such as asyncio, FastAPI, and Pydantic that complies with our HIG coding standards and passes all quality checks.
- Collaborate closely with MLOps, Cloud and infrastructure teams to ensure seamless deployment, operation, and maintenance of AIML systems.
- Instrument AI observability using OpenTelemetry (OTel) tooling. Set up offline evaluation (LLM-as-a-judge, RAGAS scoring, ROUGE/BLEU where applicable), drift monitoring and playbacks in our Observability platform.
- Build robust ETL/ELT pipelines using Python and PySpark for training ML Models and AI Agents.
- Apply AIML system architecture and design patterns by selecting the blueprint that best fits use case needs. Contribute to AI Architecture by suggesting new patterns, identifying innovative approaches, and improving existing ones.
- Build scalable, fault-tolerant solutions on AWS and/or GCP in a multi cloud ecosystem.
- Apply modern distributed system design patterns when suitable, including architectural sagas, Command Query Responsibility Segregation (CQRS), event-driven architectures, publish-subscribe models, and point-to-point messaging.
- Required Skills & Experience:
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, Data Science, or a closely related discipline.
- Experience Range – 4 to 6 Years
- Professional experience in Machine Learning, Software Engineering, or a related field, with