Definición
Also called: pairwise comparison, side-by-side.
Comparing two or more model answers to the same prompt and saying which is better, often with a reason and a rating of how much better. These judgements are the main input to RLHF.
Used in: AI evaluator and rater roles.
En vacantes abiertas ahora mismo
116 of the open roles we list mention “preference ranking” or a word for it in the title or description, on 15 platforms (as of 3 November 2026). Of those that state an hourly rate (28 distinct postings), the median is $35/hr, and the middle half pay $20 to $50.
La mayoría en: Prolific (34), Mercor (30), Turing (17), RWS TrainAI (11), Anyone AI (8), micro1 (3) y 9 más.
Digital Artistmicro1·United States
$21–65/hhace 1 día
AI Data Specialist - French from CanadaRWS TrainAI·Canada·Horario flexible
$16.5/hhace 7 días
AI Agent Tester - Real-World TasksJT AI Labs·15 países·Horario flexible
$25–45/hhace 10 días
US Contract Attorney — LitigationMercor·United States·Horario flexible·Derecho
$100–120/hhace 11 días
Senior SWE - Python / TypeScriptWeekday·United States, Canada·Tiempo parcial
$100–150/hhace 15 días
Quality Evaluator – Fluent English (Brazil)Anyone AI·Brazil·Tiempo completo
$7–12/hhace 18 días
Términos relacionados
EvaluationTesting what a model can do by having it answer a set of questions and scoring the answers, often by people working from a rubric.Verificación de datosChecking each claim in a model's answer against reliable sources and marking what is wrong, unsupported or out of date.RLHFA way of training a model on people's judgements. ← Per approved hourTérmino anterior, de la A a la Z. Project pause →Término siguiente, de la A a la Z. Glosario completoTodos los términos en una página, de la A a la Z.Abrir →