Portuguese AI Evaluation Specialist (Brazil)

Opportunity Overview
Handshake is looking for Portuguese speakers based in Brazil to help make AI responses more personalized. This is not a traditional job — you'll use your Portuguese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users.
This is an ongoing, project-based opportunity you can take on alongside your current role.
What You'll Do

• Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools

• Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning

• Provide clear written feedback that helps AI better understand and personalize responses for individual users

• Complete tasks at your own pace with no set schedule or minimum hour requirement

Qualifications
Ideal candidates meet all of the following:

• Location — Based in Brazil and able to work remotely in an asynchronous, self-directed capacity

• Language — Fluent in Portuguese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English.

• Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle

Required for all applicants

• Must have a Bachelor's degree or higher

• Strong written communication in Portuguese and English at B-2 level proficiency

• Ability to work independently in a remote, asynchronous environment

About
Handshake AI

Terms of service