Back Senior SDET IT Infrastructure & Operations

Responsibility

• Own end-to-end functional testing of AI-driven platform applications and business agents, which are built using Crew.ai

• Lead AI test strategy for platform and function

• Validate AI decision workflows, recommendations, and rule-based + ML-driven outcomes

• Design test strategies for multi-system integrations, APIs, and platform services

• Test agent-based chat bot systems (conversational AI)

• Perform data validation across upstream/downstream systems to ensure business accuracy

• Identify gaps in real-world business scenarios, edge cases, and failure handling

• Drive UAT support and stakeholder alignment for business-critical flows

• Partner with Product, Engineering, and Data teams to ensure release readiness
  Design and implement AI testing frameworks that support all different applications

Job Designation

Hybrid:Employee divides their time between in-office and remote work. Access to an office location is required. (Frequency: Minimum 2 days per week; may vary by team but will be weekly in-office expectation)

Positions at Docusign are assigned a job designation of either In Office, Hybrid or Remote and are specific to the role/job. Preferred job designations are not guaranteed when changing positions within Docusign. Docusign reserves the right to change a position's job designation depending on business needs and as permitted by local law.

What you bring

Basic

• 8+ years in QA / Functional Testing, with exposure to AI/ML-based systems 

• Strong experience in platform-level and end-to-end integration testing

• Hands-on with API testing (Postman/REST) and data validation (SQL)

• Experience testing AI agents, decision engines, and MCP servers

• Deep understanding of business process validation (Order-to-Cash, Billing, Subscriptions, etc.)

• Ability to validate AI outputs for accuracy, consistency, and business relevance

• Performance testing of AI applications

• Build the AI test-driven platforms for measuring accuracy, fact-checking, and efficiency

• Experience with Python automation and Arize tools 

• Exposure to LLMs, conversational AI, or GenAI-based agents

• Experience working in Agile / fast-paced platform environments

• Proficiency in cloud platforms such as AWS and Azure
   

Preferred 

• Arize tool testing experience

• Salesforce/ERP application knowledge

• JIRA knowledge

• deep understanding of the testing and execution life cycle

• One or more certifications such as Cloud, Solution Architect, Technical Architect, or GenAI-related certifications

• Understanding of performance, stress, and volume testing concepts

• Strong analytical, problem-solving, and communication skills

• Familiarity with performance testing tools such as JMeter, Gatling, Blazemeter

  • Understanding of performance, stress, and volume testing concepts