Skip to content
mimi

Senior Engineer for AI Quality Assurance and Innovation

Roofr Inc.

Remote · Canada Full-time Senior 1w ago

About the role

About

Enhance AI quality engineering in a remote-first setting as a Senior Engineer. Take ownership of testing standards and integrate evaluation frameworks across teams for seamless product launches.

As a Senior AI Quality Engineer, you’ll define key evaluation standards and develop frameworks essential for AI product success. Your responsibilities will include training and guiding teams on best practices, ensuring robust quality integration from the ground up. This is an impactful role in a forward-thinking startup environment.

Key Responsibilities:

  • Define comprehensive testing standards for AI features
  • Build and own evaluation frameworks for AI performance
  • Integrate quality checks within CI/CD pipelines
  • Develop review processes for assessing AI outputs
  • Guide engineers in AI evaluation strategies

Requirements:

  • 5–8 years in software engineering or QA
  • Experience in LLM frameworks and tools
  • Proficient in automated quality assessment
  • Familiarity with APIs and agent frameworks
  • Strong interpersonal skills for team collaboration

Champion quality assurance for AI initiatives while establishing innovative testing standards and practices across the organization.

Skills

API

Don't send a generic resume

Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.

Get started free