SWE Bench Engineer - C++

Turing

$25 لكل مهمة 35 من البلدان دوام كامل 40+ ساعة/أسبوع متقدّم

Triage GitHub issues in C++ projects, set up Dockerised environments and review test coverage to assess how models fix bugs. Suits tech-lead engineers who can run and change real-world codebases locally.

عن الوظيفة

About Turing
Turing is one of the world’s fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.

About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like :

  • Analyze and triage GitHub issues across trending open-source libraries.
  • Set up and configure code repositories, including Dockerization and environment setup.
  • Evaluating unit test coverage and quality.
  • Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.

- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

  • Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
  • Minimum 2+ years of overall experience
  • Strong experience with at least one of the following languages: C++
  • Proficiency with Git, Docker, and basic software pipeline setup.
  • Ability to understand and navigate complex codebases.
  • Comfortable running, modifying, and testing real-world projects locally.

- Experience contributing to or evaluating open-source projects is a plus.

  • Experience contributing to or evaluating open-source projects is a plus.
  • Previous participation in LLM research or evaluation projects.

- Experience building or testing developer tools or automation agents.

  • Experience building or testing developer tools or automation agents.
  • Work in a fully remote environment.

- Opportunity to work on cutting-edge AI projects with leading LLM companies.

  • Opportunity to work on cutting-edge AI projects with leading LLM companies.
  • Commitments Required : Minimum 40 hours per week with overlap of 4 hours with PST.
  • Employment type : Contractor assignment (no medical/paid leave)
  • Duration of contract : 2-3 weeks; [expected start date is next week]
  • Payment : $25 per approved task

- Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico, LATAM

  • Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico, LATAM
  • Assessment based review

وظائف مشابهة