AI Prompt Engineer
rex
Job Description
Own prompt lifecycle management including prompt writing, prompt debugging, prompt versioning, and prompt library maintenance. Design prompt evaluation plans using rubrics for accuracy, completeness, instruction following, tone, and policy compliance. Produce high-quality preference data and rationales to support RLHF and instruction tuning workflows. Collaborate with stakeholders to translate product requirements into system prompts, developer prompts, and user prompt patterns. Improve grounding and reduce hallucinations using retrieval-augmented generation (RAG) strategies and citation/traceability constraints. Create and maintain annotation guidelines compliance for evaluators, including edge-case handling and escalation paths. Monitor quality metrics such as pass rate, inter-annotator agreement, and regression failures across releases. Support content safety labeling and red-teaming prompts to prevent policy violations, sensitive data leakage, and jailbreak behaviors.