On behalf of our client, we are seeking a QA Analyst to join their team in Al Khobar. The QA Analyst will play a critical role in executing and automating functional and non-functional testing for Generative AI-driven applications, ensuring that AI models, APIs, and user interfaces are reliable, scalable, and secure. The role will cover end-to-end and integration testing, AI model and data validation, test automation, API testing, performance testing, and post-deployment testing. The position requires strong hands-on experience in QA and test automation, with Python as a must-have and additional emphasis on Playwright, Pytest, SQL, and coding experience in Python.

Responsibilities:

• Execute end-to-end and integration testing to validate AI-driven actions and ensure products function according to specified requirements.
• Validate workflows, user journeys, API interactions, and AI model outputs against business logic.
• Conduct UI/UX testing to validate accessibility, responsiveness, and usability across devices and browsers.
• Support user acceptance testing activities.
• Validate input datasets for training, testing, and fine-tuning of AI models.
• Ensure data integrity, preprocessing workflows, and real-world alignment of synthetic data.
• Validate data pipelines and data flow between AI models, backend services, and frontend applications.
• Test models against predefined scenarios, including edge cases and adversarial inputs.
• Support performance, load, and stress testing using tools such as JMeter.
• Automate test cases for regression and frequent deployments.
• Validate new builds, releases, and updates continuously.
• Track defects, log issues, and verify fixes in collaboration with development teams.
• Monitor production model performance and analyse results for quality improvements.
• Implement test automation for functional and regression testing.
• Conduct API testing using Postman and SoapUI.
• Assist in security and compliance validation and ensure data protection and regulatory adherence.

Desired Candidate Profile

3-5 years of experience in quality assurance, with a focus on functional and integration testing. Playwright experience — mandatory. Pytest experience. Hands-on SQL experience. Hands-on coding experience in Python. Proficiency in test automation tools including Selenium, Cypress, and Robot Framework. API testing experience using Postman and SoapUI. Strong knowledge of AI model validation techniques and data integrity testing. LLM evaluation experience is a plus. Familiarity with performance testing tools such as JMeter. Security testing experience is an advantage. Experience working in Agile environments with CI/CD pipeline integration. Strong analytical skills with attention to detail in test execution and reporting.