Portuguese AI Evaluation Specialist (Brazil)
About this role
Opportunity Overview Handshake is looking for Portuguese speakers based in Brazil to help make AI responses more personalized. This is not a traditional job — you'll use your Portuguese language skills to help evaluate and rank AI responses so future models can better tailor their answers to individual users. This is an ongoing, project-based opportunity you can take on alongside your current role. What You'll Do - Complete tasks on Handshake's annotation platform using your own real-world experience with AI tools - Compare and evaluate AI-generated responses, sharing your honest preferences and reasoning - Provide clear written feedback that helps AI better understand and personalize responses for individual users - Complete tasks at your own pace with no set schedule or minimum hour requirement Qualifications Ideal candidates meet all of the following: - Location — Based in Brazil and able to work remotely in an asynchronous, self-directed capacity - Language — Fluent in Portuguese, both written and spoken, with strong written communication skills for explaining your reasoning clearly. A minimum of B2-level English proficiency is also required, as all platform content, instructions, and training materials are provided in English. - Judgment — Comfortable forming and defending your own preferences between two AI-generated responses, even when the differences are subtle Required for all applicants - Must have a Bachelor's degree or higher - Strong written communication in Portuguese and English at B-2 level proficiency - Ability to work independently in a remote, asynchronous environment
Application listings
Choose a source listing and check its country requirements.