Subject-matter experts design realistic shopping tasks for AI agents, write grading rubrics and review how well the agents complete them. It suits people with retail, e-commerce or consumer-domain expertise who write precise, low-variance criteria.
नौकरी के बारे में
What this role does
Design realistic, difficult shopping-related tasks (e.g. meal planning, restocking, gifting, travel prep) that stress-test AI models, then build the rubrics used to grade how well a model performs them.
Who we're looking for
- Subject-matter expertise in retail, e-commerce, consumer shopping behavior, or a related domain (nutrition, logistics, home/office management, etc.)
- Strong analytical and writing skills — able to define precise, low-variance grading criteria
- Comfortable working with AI outputs and evaluating them critically and objectively
- Prior experience in eval design, QA, tutoring, or curriculum/rubric design is a plus
Core responsibilities
- Author realistic shopping tasks with a clear, concrete end goal
- Build a grading rubric/verifier for each task that two independent reviewers would score consistently
- Review an AI agent's attempt at the task and grade it against the rubric
- Document where the AI succeeded or failed, with clear reasoning
Work style
- Independent, deadline-driven work
- High attention to detail and consistency
- Comfortable with ambiguity — tasks are self-directed with light guidelines
Pay: $60/hr
आधिकारिक स्रोत: verita-ai.com। जानकारी बदल सकती है; अंतिम बात प्लेटफ़ॉर्म के पेज की मानी जाएगी।इस लिस्टिंग में कुछ गड़बड़ है? हमें बताएँ.
AI इवैल्यूएशन और रेटिंग की और नौकरियाँ Verita AI की सभी नौकरियाँ AI रेटर और इवैल्यूएटर कितना कमाते हैं Verita AI कितना भुगतान करता है?
