Design hard, expert-level problems from your own technical field as Linux terminal tasks that stump frontier AI models. Suits advanced practitioners with a master's degree, a decade of technical work and a publication record.
عن الوظيفة
Company Description
This enterprise client helps the world’s most innovative companies improve their AI models by providing human feedback.
Job Description
Help build a benchmark of real, expert-level problems that today’s best AI agents still can’t solve. Experts take a genuinely hard problem from their own field and turn it into a task an AI must solve from scratch in a Linux terminal.
The goal: stump the model. A task counts only if, when three frontier AI models each try it three times, they mostly fail. It’s not annotation — contributors design the problems that expose where AI still breaks.
Qualifications
Who we need:
- Masters degree or higher
- 10+ years of professional experience in a technical domain
- At least one publication (academic or professional)
- At least one publication (academic or professional)
- Coding
- Machine Learning
- Systems
- Security
- Hardware
Additional Information
- This is an ongoing project — at least 7 weeks
- Onboarding process is approximately 90 minutes total
المصدر الرسمي: jobs.smartrecruiters.com. قد تتغير التفاصيل؛ والكلمة الأخيرة لصفحة المنصة.هل في هذه الوظيفة خطأ؟ أخبرنا.
المزيد من وظائف الاختبار الهجومي والسلامةالمزيد من وظائف البرمجة كل وظائف Lifted, an Upwork Company وظائف الفريق الأحمر والسلامة في الذكاء الاصطناعي في الولايات المتحدة كم تدفع Lifted, an Upwork Company؟ وظائف في الولايات المتحدة
