Assess AI-generated text, images, widgets and side-by-side comparisons against quality rubrics, researching unfamiliar topics as needed. Suits experienced LLM evaluators with a degree who can make well-supported judgments across formats.
Sobre la vacante
Company Description
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Job Description
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
Qualifications
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Additional Information
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Fuente oficial: jobs.smartrecruiters.com. Los detalles pueden cambiar; la página de la plataforma tiene la última palabra.¿Hay algún error en esta oferta? Avísanos.
Más trabajos de evaluación y calificación de IA Todas las vacantes de Lifted, an Upwork Company Cuánto ganan los calificadores y evaluadores de IA Trabajos de evaluador y calificador de IA en EE. UU. ¿Cuánto paga Lifted, an Upwork Company? Empleos en EE. UU.
