AI Engineer
ycombinator
Job Description
What You’ll Do
- Create accurate and reliable systems to extract and analyze knowledge from documents
- Architect, implement, and deploy AI agents for email and phone communications between freight accounting parties (payer/payee), leveraging language and vision LLMs for automation and analysis.
- Design and refine high-impact prompts, templates, and evaluation harnesses to ensure robust, reliable agent behavior.
- Build scalable pipelines for preprocessing, training, inference, and feedback loops, including evaluation and integration of VLMs.
- Monitor and diagnose agent performance in production, rapidly addressing failures and refining prompts, workflows, and models.
- Create and maintain high-quality training, evaluation, and test datasets.
- Enhance the AI stack through creative prompting, fine-tuning, and continuous iteration.
- Productionize models within Lighthouz’s intelligent automation platform.
- Collaborate with product and engineering teams to integrate AI outputs into document, email, and voice workflows, delivering polished, production-ready solutions.
- Continuously improve model performance in real-world conditions.
What We’re Looking For
- 2+ years in ML/AI roles, ideally in document AI
- Deep learning expertise with PyTorch, TensorFlow
- Prompting wizardry — skilled at crafting precise, reliable prompts for VLMs & LLMs, translating complex tasks into actionable instructions
- Experience fine-tuning VLMs
- Strong knowledge of OpenAI, Claude, and other agentic toolkits
- Hands-on with OCR, visual transformers, multimodal models
- Background in conversational AI, voice AI, NLP research, and LLM training
- Proven track record of training & deploying models to production
- Problem-solver & builder mindset — fast to prototype, faster to iterate
- Comfortable with ambiguity and evolving datasets