التعريف
Also called: pairwise comparison, side-by-side.
Comparing two or more model answers to the same prompt and saying which is better, often with a reason and a rating of how much better. These judgements are the main input to RLHF.
Used in: AI evaluator and rater roles.
في الوظائف المفتوحة حاليًا
116 of the open roles we list mention “preference ranking” or a word for it in the title or description, on 15 platforms (as of 3 November 2026). Of those that state an hourly rate (28 distinct postings), the median is $35/hr, and the middle half pay $20 to $50.
معظمها على: Prolific (34)، Mercor (30)، Turing (17)، RWS TrainAI (11)، Anyone AI (8)، micro1 (3)، و9 أخرى.
Digital Artistmicro1·United States
$21–65/ساعةمنذ 1 يوم
AI Data Specialist - French from CanadaRWS TrainAI·Canada·ساعات مرنة
$16.5/ساعةمنذ 7 أيام
AI Agent Tester - Real-World TasksJT AI Labs·15 من البلدان·ساعات مرنة
$25–45/ساعةمنذ 10 أيام
US Contract Attorney — LitigationMercor·United States·ساعات مرنة·القانون
$100–120/ساعةمنذ 11 أيام
Senior SWE - Python / TypeScriptWeekday·United States, Canada·دوام جزئي
$100–150/ساعةمنذ 15 أيام
Quality Evaluator – Fluent English (Brazil)Anyone AI·Brazil·دوام كامل
$7–12/ساعةمنذ 18 أيام
مصطلحات ذات صلة
EvaluationTesting what a model can do by having it answer a set of questions and scoring the answers, often by people working from a rubric.التحقق من الحقائقChecking each claim in a model's answer against reliable sources and marking what is wrong, unsupported or out of date.RLHFA way of training a model on people's judgements. ← Per approved hourالمصطلح السابق، من A إلى Z. Project pause →المصطلح التالي، من A إلى Z. المسرد الكاملكل المصطلحات في صفحة واحدة، من A إلى Z.فتح →