Principal QA Engineer(Python, Pytest and ML)
greenhouse
Job Description
- Lead, mentor, and grow a team of high-performing AI QA Engineers.
- Define and drive the overall QA strategy for our AI/ML models, with a focus on time-series forecasting.
- Oversee the design, development, and maintenance of automated test frameworks.
- Guide the team in implementing and executing robust test cases for our AI-powered features and APIs.
- Champion the use of BDD frameworks, such as Gherkin, to create clear, concise, and maintainable tests.
- Ensure the team effectively tests and validates RESTful APIs to meet high standards of quality and performance.
- Collaborate with product managers, data scientists, and engineering leads to align on quality standards and release criteria.
- Oversee the identification, documentation, and tracking of bugs and inconsistencies in our AI/ML systems.
- Drive improvements to our CI/CD pipeline to ensure that our AI models are continuously tested and deployed with confidence.
Required Qualifications
- Extensive experience in automating QA systems, with a strong proficiency in Python.
- Proven experience leading or mentoring a QA team in a fast-paced technical environment.
- Deep understanding of machine learning concepts and a proven track record of testing ML models, particularly in the domain of time-series forecasting.
- Expertise with testing frameworks such as pytest.
- Strong experience with Behavior-Driven Development (BDD) and Gherkin.
- In-depth knowledge of API testing and validation.
- Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
- Experience with agentic frameworks and autonomous agent architectures.
- Proficiency in modern software development practices (testing, code review, CI/CD).
- A proven track record of delivering complex technical projects on time with high quality.
- Excellent leadership, communication, and interpersonal skills.
Preferred Qualifications
- Experience with performance, scalability, and security testing of AI systems.
- Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their AI/ML services.
- Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes.
- Experience with strategic planning and roadmap development for a QA function.
- A Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
What Makes This Role Exciting
- You will lead a talented team at the forefront of AI innovation, working on a platform that is transforming how businesses make decisions.
- You will have a strategic impact, shaping the future of quality for our AI-powered products.
- You will be part of a collaborative and creative leadership team that values openness, authenticity, and inclusivity.
- We are a fast-growing company, and you will have ample opportunities for professional growth and to define your team's trajectory.