QA Engineer – AI

About

Tests AI model outputs and application functionality. Validates data accuracy, business logic and system performance.

Responsibilities

• Design and execute test plans covering AI model outputs, data correctness, and application functionality.
• Create automated tests for APIs and UI where appropriate; maintain regression suites.
• Validate business logic, edge cases, and non-functional requirements (performance, reliability).
• Establish evaluation criteria for AI components (accuracy, hallucination checks, guardrail adherence).
• Triage defects, document reproducible steps, and partner with engineers to resolve issues.
• Contribute to release readiness, quality gates, and continuous improvement of testing practices.

Required Qualifications

• 3+ years in QA/Test Engineering for web/services-based applications.
• Experience with test automation tools (Selenium) and API testing (Postman or similar).
• Strong understanding of test case design, defect lifecycle, and agile QA practices.
• Familiarity with tracking tools (JIRA) and test documentation.
• Ability to reason about data quality and validate outputs against requirements.

Preferred Qualifications

• Experience testing ML/LLM systems: evaluation datasets, prompt regressions, safety checks.
• Performance testing experience (load, stress) and observability basics.
• Knowledge of accessibility testing for UI.

Core Skills

• Selenium
• Postman
• Test Cases
• JIRA
• Manual Testing