AI QA Lead
Looking for SDET profile with Python and hands on experience with business cases. Most importantly Conduct manual testing where necessary to complement automated tests.
- Design develop and execute automated tests using Python to ensure the functionality and performance of the product
- Conduct manual testing where necessary to complement automated tests
- Write simple SQL queries for data extraction and validation
- Test and validate the product developed by the developers ensuring it meets the specified requirements
- Understands the basics of GenAI related tools
- Basic understanding of LLM evaluation tools Ragas DepEval SAFE
- Define and implement testing strategies
- Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non technical stakeholders
- Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met
- Proficient in automating API responses including handling both authorized and unauthorized scenarios
- Strong expertise in using Postman and Jenkins
- Skills and Qualifications
- Proficiency in automated testing with Python
- Familiarity with manual testing processes
- Good knowledge of SQL for data manipulation and testing purposes
- Understanding in prompt engineering for LLMs including question generation and evaluation Good to have
- Experience with evaluating chatbot use cases and ensuring their effectiveness and relevance Good to have
- Exceptional communication and documentation abilities
- Strong analytical and problem solving skills