Short project scoring AI responses against defined safety policies and writing concise, evidence-based justifications for each rating. Suits detail-oriented readers who can handle sensitive self-harm, violence and abuse content and write clear evaluations.
About the role
About Turing:
Turing is a leading AI company that accelerates the development of advanced AI systems. Turing works with frontier AI labs and global enterprises to improve AI capabilities in reasoning, safety, coding, tool use, multimodality, and real-world workflows.
Role Overview:
We are looking for Data Annotators to evaluate AI-generated responses against defined safety policies. This is a non-coding role for candidates with strong communication skills, native-level English proficiency, excellent attention to detail, close-reading ability, sound judgment, and the ability to write clear, concise evaluations.
Key Responsibilities:
- Evaluate AI-generated responses against defined safety policies and sub-policies.
- Review single-turn and multi-turn conversations for safety, accuracy, and policy compliance.
- Assign consistent 1–5 ratings based on established evaluation criteria.
- Write clear, concise, and evidence-based justifications for each rating.
- Identify subtle safety concerns involving self-harm, violence, abuse, and other sensitive topics.
Requirements:
- Strong interest in data annotation and AI evaluation with excellent English proficiency.
- Excellent reading comprehension and close-reading skills.
- Ability to write clear, concise, and objective evaluations.
- Excellent attention to detail and awareness of subtle nuances.
- Strong judgment and ability to follow detailed safety policies.
- Ability to work accurately under time constraints.
- Comfort with reviewing sensitive content involving self-harm, violence, and abuse.
- Familiarity with US-specific references, systems, and terminology.
- Familiarity with US-specific references, systems, and terminology.
- Experience in data annotation, content moderation, or policy review.
- Background in trust and safety, AI training, or response evaluation is preferred.
- Experience in editorial review, proofreading, compliance, or quality assurance.
- Familiarity with structured rating systems and evaluation rubrics.
- Experience reviewing single-turn and multi-turn conversations.
Project Details:
- Project Pay - Hourly
- Estimated start date - 23 october (or nearby dates)
- Duration - 1-2 weeks (with potential chances of extension)
- Duration - 1-2 weeks (with potential chances of extension)
- Submit an application with an updated resume and LinkedIn profile link.
- Talents will be selected based on internal team's and client's review
Official source: work.turing.com. Details can change; the platform's page is the final word. Something wrong with this listing? Tell us.
More AI evaluation and rating jobsMore data annotation jobs All Turing roles What AI trainers and AI tutors earn How much does Turing pay?
