Role Purpose:
QA Engineer to ensure the functional quality, performance, and reliability of our intelligent agent platform. This position requires designing and automating comprehensive test cases to validate that user intents are accurately interpreted, correctly routed to workflows, and consistently rendered across diverse prompts, edge cases, and user scenarios. This role requires ownership of end-to-end functional testing of agent-driven interactions, from user input and agent reasoning to system behavior and UI response. In addition, leading performance and scalability testing to ensure stability under high load and multi-tenant environments. The role requires close collaboration with product and engineering teams to identify unclear, improve usability, and prevent defects from reaching production.
Responsibilities Design and maintain functional test cases across all agents and modules in HUMAIN ONE, ensuring accuracy, completeness, and coverage Create dynamic and prompt-driven test scripts to validate that agent behavior responds correctly to a wide variety of inputs and intents Automate large-scale test scenarios to simulate thousands of user prompts and interactions, covering both expected and edge cases Perform performance and load testing to ensure response times, throughput, and stability are within SLA across different environments Collaborate with product and engineering teams to understand each module’s expected outcomes and define test success criteria Identify inconsistencies in agent behavior, unclear error handling, or usability issues, and work with product managers to refine user experience accordingly Define system expectations for vague, ambiguous, or conflicting prompts, and support in improving agent clarification logic Own and enforce QA readiness criteria for production release, ensuring that quality gates are met before go-live Monitor test execution and maintain automated test pipelines using best-in-class tools and frameworks Establish clear documentation, dashboards, and reports to communicate test coverage, outcomes, and regressions
Requirements Minimum 5 years of QA or test engineering experience in enterprise software or intelligent systems Proven track record of building automated functional testing systems, preferably in AI, NLP, or prompt-based interfaces Strong experience designing test plans for user-intent systems, dialog agents, or dynamic form-based applications Hands-on expertise in writing, executing, and maintaining automated test suites using tools such as Selenium, Cypress, Playwright, Postman, or equivalent Familiarity with performance testing tools such as JMeter, k6, or Locust, and experience with tuning tests for throughput and latency Deep understanding of system behavior, workflows, and edge case validation Strong usability instincts and ability to evaluate whether system responses are clear, helpful, and logically sound Comfortable working closely with product managers to shape system clarification flows and quality criteria Ability to track quality metrics, generate reports, and escalate risks with clarity Experience with agent-based or AI-native platforms is a strong advantage Technical fluency sufficient to interact with backend engineers, data scientists, and Dev Ops teams