SWE Bench Engineer - JAVA

About Turing
Turing is one of the world’s leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.

About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

What does day-to-day look like :

• Analyze and triage GitHub issues across trending open-source libraries.

• Set up and configure code repositories, including Dockerization and environment setup.

• Evaluating unit test coverage and quality.

• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.

• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.

- Opportunities to lead a team of junior engineers to collaborate on projects.

• Opportunities to lead a team of junior engineers to collaborate on projects.

• Minimum 3+ years of overall experience

• Strong experience with at least one of the following languages: Java

• Proficiency with Git, Docker, and basic software pipeline setup.

• Ability to understand and navigate complex codebases.

• Comfortable running, modifying, and testing real-world projects locally.

- Experience contributing to or evaluating open-source projects is a plus.

• Experience contributing to or evaluating open-source projects is a plus.

• Previous participation in LLM research or evaluation projects.

- Experience building or testing developer tools or automation agents.

• Experience building or testing developer tools or automation agents.

• Work in a fully remote environment.

- Opportunity to work on cutting-edge AI projects with leading LLM companies.

• Opportunity to work on cutting-edge AI projects with leading LLM companies.

• Commitments Required : At least 4 hours per day and minimum 40 hours per week with overlap of 4 hours with PST.

• Employment type : Contractor assignment (no medical/paid leave)

• Duration of contract : 3 month; [expected start date is next week]

• Payment : $25 per approved task

- Location : India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, LATAM

• Location : India, Pakistan, Nigeria, Kenya, Egypt, Ghana, Bangladesh, Turkey, LATAM

• Assessment based review