GenAi Test Lead
Role Summary: Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.
Key Resposibilities:
- Design and execute test plans covering AI model outputs, data correctness, and application functionality.
- Create automated tests for APIs and UI where appropriate; maintain regression suites.
- Validate business logic, edge cases, and non-functional requirements (performance, reliability).
- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
- Triage defects, document reproducible steps, and partner with engineers to resolve issues.
- Contribute to release readiness, quality gates, and continuous improvement of testing practices.
Required Qualifications:
- 3+ years in QA/Test Engineering for web/services-based applications.
- Experience with test automation tools (Selenium) and API testing (Postman or similar).
- Strong understanding of test case design, defect lifecycle, and agile QA practices.
- Familiarity with tracking tools (JIRA) and test documentation.
- Ability to reason about data quality and validate outputs against requirements.
Preferred Nice to have:
- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
- Performance testing experience (load, stress) and observability basics.
- Knowledge of accessibility testing for UI.
Core Skills:
Selenium, Postman, Test Cases, JIRA, Manual Testing
Key Resposibilities:
- Design and execute test plans covering AI model outputs, data correctness, and application functionality.
- Create automated tests for APIs and UI where appropriate; maintain regression suites.
- Validate business logic, edge cases, and non-functional requirements (performance, reliability).
- Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
- Triage defects, document reproducible steps, and partner with engineers to resolve issues.
- Contribute to release readiness, quality gates, and continuous improvement of testing practices.
Required Qualifications:
- 3+ years in QA/Test Engineering for web/services-based applications.
- Experience with test automation tools (Selenium) and API testing (Postman or similar).
- Strong understanding of test case design, defect lifecycle, and agile QA practices.
- Familiarity with tracking tools (JIRA) and test documentation.
- Ability to reason about data quality and validate outputs against requirements.
Preferred Nice to have:
- Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
- Performance testing experience (load, stress) and observability basics.
- Knowledge of accessibility testing for UI.
Core Skills:
Selenium, Postman, Test Cases, JIRA, Manual Testing