Design hard, expert-level problems from your own technical field as Linux terminal tasks that stump frontier AI models. Suits advanced practitioners with a master's degree, a decade of technical work and a publication record.
Sobre la vacante
Company Description
This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.
Job Description
Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.
The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.
Qualifications
Who we need:
- Masters degree or higher
- 10+ years of professional experience in a technical domain
- At least one publication (academic or professional)
- At least one publication (academic or professional)
- Coding
- Machine Learning
- Systems
- Security
- Hardware
Additional Information
- This is an ongoing project — at least 7 weeks
- Onboarding process is approximately 90 minutes total
Fuente oficial: jobs.smartrecruiters.com. Los detalles pueden cambiar; la página de la plataforma tiene la última palabra.¿Hay algún error en esta oferta? Avísanos.
Más trabajos de red teaming y seguridadMás trabajos de programación Todas las vacantes de Lifted, an Upwork Company Trabajos de red teaming y seguridad de IA en EE. UU. ¿Cuánto paga Lifted, an Upwork Company? Empleos en EE. UU.
