Assess AI-generated text, images, widgets and side-by-side comparisons against quality rubrics, researching unfamiliar topics as needed. Suits experienced LLM evaluators with a degree who can make well-supported judgments across formats.
About the role
Company Description
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Job Description
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
Qualifications
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Additional Information
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Official source: jobs.smartrecruiters.com. Details can change; the platform's page is the final word. Something wrong with this listing? Tell us.
More AI evaluation and rating jobs All Lifted, an Upwork Company roles What AI raters and evaluators earn AI evaluator and rater jobs in the US How much does Lifted, an Upwork Company pay? Jobs in US
