Principal QA Engineer(Python, Pytest and ML)

greenhouse

Gurugram, IN NM Years Exp Posted 67d ago

Job Description

  • Lead, mentor, and grow a team of high-performing AI QA Engineers.
  • Define and drive the overall QA strategy for our AI/ML models, with a focus on time-series forecasting.
  • Oversee the design, development, and maintenance of automated test frameworks.
  • Guide the team in implementing and executing robust test cases for our AI-powered features and APIs.
  • Champion the use of BDD frameworks, such as Gherkin, to create clear, concise, and maintainable tests.
  • Ensure the team effectively tests and validates RESTful APIs to meet high standards of quality and performance.
  • Collaborate with product managers, data scientists, and engineering leads to align on quality standards and release criteria.
  • Oversee the identification, documentation, and tracking of bugs and inconsistencies in our AI/ML systems.
  • Drive improvements to our CI/CD pipeline to ensure that our AI models are continuously tested and deployed with confidence.

Required Qualifications

  • Extensive experience in automating QA systems, with a strong proficiency in Python.
  • Proven experience leading or mentoring a QA team in a fast-paced technical environment.
  • Deep understanding of machine learning concepts and a proven track record of testing ML models, particularly in the domain of time-series forecasting.
  • Expertise with testing frameworks such as pytest.
  • Strong experience with Behavior-Driven Development (BDD) and Gherkin.
  • In-depth knowledge of API testing and validation.
  • Deep knowledge of LLM APIs, prompt engineering, and conversational AI patterns.
  • Experience with agentic frameworks and autonomous agent architectures.
  • Proficiency in modern software development practices (testing, code review, CI/CD).
  • A proven track record of delivering complex technical projects on time with high quality.
  • Excellent leadership, communication, and interpersonal skills.

Preferred Qualifications

  • Experience with performance, scalability, and security testing of AI systems.
  • Familiarity with cloud platforms (e.g., AWS, GCP, Azure) and their AI/ML services.
  • Knowledge of containerization technologies like Docker and orchestration tools like Kubernetes.
  • Experience with strategic planning and roadmap development for a QA function.
  • A Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

What Makes This Role Exciting

  • You will lead a talented team at the forefront of AI innovation, working on a platform that is transforming how businesses make decisions.
  • You will have a strategic impact, shaping the future of quality for our AI-powered products.
  • You will be part of a collaborative and creative leadership team that values openness, authenticity, and inclusivity.
  • We are a fast-growing company, and you will have ample opportunities for professional growth and to define your team's trajectory.

Similar Openings for You