Software Engineer

About the Projects

• Building LLM evaluation and training datasets to train LLMs on realistic software engineering problems.
• Creating verifiable SWE tasks based on public repository histories using a synthetic approach with human‑in‑the‑loop.
• Expanding dataset coverage across different programming languages, difficulty levels, etc.

About the Role

• Seeking experienced software engineers (tech‑lead level) familiar with high‑quality public GitHub repositories.
• Hands‑on software engineering work including development environment automation, issue triaging, and evaluating test coverage and quality.

Why Join Us?

• Turing is a fast‑growing AI company accelerating the advancement and deployment of powerful AI systems.
• Work at the forefront of evaluating how LLMs interact with real code, influencing the future of AI‑assisted software development.
• Blend practical software engineering with AI research.

Day‑to‑Day Responsibilities

• Analyze and triage GitHub issues across trending open‑source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluate unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug‑fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
• Lead a team of junior engineers on project collaborations.

Required Skills

• Minimum 3+ years of overall experience.
• Strong experience with at least one of the following languages: Python.
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real‑world projects locally.
• Experience contributing to or evaluating open‑source projects is a plus.

Nice to Have

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks

• Fully remote work environment.
• Opportunity to work on cutting‑edge AI projects with leading LLM companies.

Offer Details

• Commitments Required: At least 4 hours per day and minimum 20 hours per week with a 4‑hour overlap with PST. (Options: 20 hrs/week, 30 hrs/week, or 40 hrs/week)
• Employment Type: Contractor assignment (no medical/paid leave).
• Contract Duration: 3 months; expected start date next