Software Engineer - Code QA Expert
Mercor
About the role
About The Job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Software Engineer
Type: Freelance
Compensation: $70–$120/hour
Duration: 1–2 months
Commitment: 15–25 hours/week, with flexibility up to 40 hours/week
Role Responsibilities • Craft realistic developer prompts across multiple categories such as code review, debugging, and error diagnosis. • Source and adapt content from real PRs to create authentic scenarios. • Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality. • Collaborate with AI research teams to improve evaluation datasets for AI reasoning and technical judgment. • Work independently and asynchronously to meet deadlines while enhancing dataset quality.
Qualifications
Must-Have • 2+ years of experience in software engineering, technical research, or educational content development. • Bachelor's degree in Software Engineering, Computer Science, or a related field. • Strong proficiency in languages like Python, JavaScript, Java, or C++. • Experience with debugging, testing, and validating code. • Comfortable with technical writing and attention to detail.
Preferred • Advanced degree in a related field.
Start Date • Immediate
Application Process (Takes 20–30 mins to complete) • Upload resume • AI interview: A short, 15-minute conversational session to understand your background, experience, and interest in the role • Follow-up communication within a few days with next steps and onboarding details
Resources & Support • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome • For any help or support, reach out to: support@mercor.com
PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
,
Requirements
- 2+ years of experience in software engineering, technical research, or educational content development.
- Bachelor's degree in Software Engineering, Computer Science, or a related field.
- Strong proficiency in languages like Python, JavaScript, Java, or C++.
- Experience with debugging, testing, and validating code.
- Comfortable with technical writing and attention to detail.
Responsibilities
- Craft realistic developer prompts across multiple categories such as code review, debugging, and error diagnosis.
- Source and adapt content from real PRs to create authentic scenarios.
- Write clear, technically accurate model responses demonstrating strong reasoning and explanation quality.
- Collaborate with AI research teams to improve evaluation datasets for AI reasoning and technical judgment.
- Work independently and asynchronously to meet deadlines while enhancing dataset quality.
Skills
Don't send a generic resume
Paste this job description into Mimi and get a resume tailored to exactly what the hiring team is looking for.
Get started free