Senior QA Tester

Experience Level 5 to 8 years
Primary Skills Functional Testing UI Testing Integration Testing and Performance Testing

Key Responsibilities
Design develop and execute test strategies and test cases for GenAI based applications
Test LLM driven functionalities, including prompt based responses semantic search and AI-generated content
Validate data pipelines and backend logic involving PostgreSQL and GCP services BigQuery Vertex AI Cloud Functions etc
Develop robust test cases for API UI functional integration and performance testing
Ensure quality of AI model integration e.g., Google Gemini through test coverage of edge cases, bias handling, and content validation
Collaborate with developers data engineers and AI and ML teams to understand application logic and deliver end to end QA coverage
Implement test automation tools e.g., PyTest, Selenium, Postman REST Assured and CI/CD pipeline integrations
Analyze test results track defects and participate in root cause analysis and defect triaging
Ensure compliance with responsible AI practices and validate model outputs against business requirements

Required Skills and Qualifications
5 plus years of QA/testing experience with at least 2 years in AI/ML or GenAI application testing
Experience with Google Cloud Platform (GCP) services and cloud-native testing approaches
Strong knowledge of PostgreSQL, including writing queries for validation and data integrity testing
Familiarity with Generative AI, LLMs, or prompt-based systems like Google Gemini
Hands-on experience in API and UI testing
Experience with test management tools (e.g., JIRA, TestRail) and version control (e.g., Git)
Proficiency in scripting and automation using Python, JavaScript, or Java is preferrable
Strong analytical and debugging skills

Preferred Qualifications
Understanding of RAG (Retrieval-Augmented Generation), embeddings, and vector search testing
Experience with tools like LangChain, Vertex AI, or other LLM orchestration frameworks
Familiarity with AI performance testing and content validation frameworks
Experience in validating data privacy, ethical AI, and hallucination detection in GenAI systems