Senior QA Engineer
Toloka
About the role
About the Role
We are looking for a Senior QA Engineer who thinks beyond test cases, who understands the product deeply, knows what actually matters, and helps the team move fast without breaking things that count. This isn't a role for someone who needs clear processes handed to them. You'll be working across frontend, backend, and ML teams — each with their own release flows — and your job is to find the right balance between speed and quality, and bring the team along with you.
What you’ll do
- Take end-to-end ownership of quality — from reviewing requirements and shaping test strategies to maintaining bug reports, tracking known issues, and surfacing bottlenecks to the team
- Own quality across the full system — from the AI agent and orchestration layer to the interfaces users and operators interact with
- Design and maintain automated tests that account for non-deterministic AI behavior
- Debug issues across a multi-component distributed system — and know how to find where in the chain something broke
- Identify the highest-risk areas, prioritize ruthlessly, and know when to stop
- Work with AI tools to write and maintain tests efficiently
- Shape QA culture across teams without imposing strict rules
What we're Looking For
- 5+ years of QA experience with a strong manual testing foundation
- Experience testing complex, multi-component distributed systems — you know how services talk to each other and you don't freeze when something breaks in an unexpected place
- Practical experience with test automation
- Familiarity with LLMs and AI-first products — you understand why non-determinism isn't a bug
- Experience using AI tools (Cursor, Copilot, etc.) in your daily workflow
- Strong prioritization skills — you can handle a high volume of changes without losing sight of what matters
- Comfortable operating in ambiguity and building structure where there isn't any
What we can offer
- Freelance collaboration via the Ontop freelance platform.
- Flexible, fully remote work schedule.
- You’ll have the opportunity to work on highly innovative projects at the leading edge of AI development, together with a genuinely dedicated and dynamic team of experts.
- You’ll also be working on projects with customers that are AI industry leaders and well-known household names.
- Friendly community.
Equal Opportunity Employer
Toloka is committed to providing equal opportunity and fostering an inclusive environment. We welcome applications from all qualified individuals and do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, gender identity, age, marital status, veteran status, disability, or any other characteristic protected by applicable law. Selection decisions are made based on qualifications, merit, and business need.
Skills
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free