https://aitrainers.jobs/ai-training-jobs/rlhf-eval/country/au12 open AI evaluation and rating roles name Australia as a country they accept, and 8 more AI evaluation and rating roles are open worldwide. Among the 6 that state an hourly rate, the median is $25/hr.en Tue, 20 Oct 2026 16:05:40 GMT https://aitrainers.jobs/jobs/korean-voice-ai-evaluator-remote-flexible-6jm1x2https://aitrainers.jobs/jobs/korean-voice-ai-evaluator-remote-flexible-6jm1x2Wed, 14 Oct 2026 19:08:53 GMTRole-plays a patient in Korean phone calls with an AI healthcare receptionist, then grades whether it understands, responds and triggers the right actions. Suits native Korean speakers with a clear voice who are patient, detail-oriented and comfortable following scripted personas. https://aitrainers.jobs/jobs/ai-personalization-evaluator-australia-1ots0zhttps://aitrainers.jobs/jobs/ai-personalization-evaluator-australia-1ots0zWed, 14 Oct 2026 14:58:57 GMTRemote evaluation of how an AI assistant uses connected Google account data to answer personalised prompts. Suits Australia-based people with active Google app use who write careful, clear feedback. https://aitrainers.jobs/jobs/search-engine-evaluator-english-australia-1inhh3https://aitrainers.jobs/jobs/search-engine-evaluator-english-australia-1inhh3Fri, 02 Oct 2026 13:02:44 GMTRWS TrainAI · Australia · Up to $21/hr https://aitrainers.jobs/jobs/ai-trainer-fluent-macedonian-speakers-xbcm18https://aitrainers.jobs/jobs/ai-trainer-fluent-macedonian-speakers-xbcm18Sun, 13 Sep 2026 12:54:13 GMTRemote, task-based side-by-side evaluation of AI-generated Macedonian text, judging how natural and idiomatic it sounds. It suits fluent Macedonian speakers with a strong grasp of everyday written and spoken usage who work carefully. https://aitrainers.jobs/jobs/multilingual-ai-response-evaluator-and-prompt-writer-1dhtp3https://aitrainers.jobs/jobs/multilingual-ai-response-evaluator-and-prompt-writer-1dhtp3Mon, 20 Jul 2026 18:12:45 GMTEvaluate AI assistant responses in your native language, adapt them to sound natural for local audiences, and write prompts that improve outputs. Suits native French or Japanese speakers based in one of the listed countries who are comfortable with AI-generated text. https://aitrainers.jobs/jobs/maps-personalization-relevance-rater-english-australia-1ee6qehttps://aitrainers.jobs/jobs/maps-personalization-relevance-rater-english-australia-1ee6qeThu, 09 Jul 2026 03:12:47 GMTRates whether personalized place suggestions are relevant and useful against project guidelines, across a limited number of project rounds. Suits English speakers based in Australia who have an active Google Maps history and a desktop or laptop. https://aitrainers.jobs/jobs/ai-trainer-computer-science-expert-graphical-abstract-fully-remote-160ugehttps://aitrainers.jobs/jobs/ai-trainer-computer-science-expert-graphical-abstract-fully-remote-160ugeThu, 09 Apr 2026 09:37:44 GMTRemote, ad hoc work checking AI-generated graphical abstracts against computer science papers for factual and structural accuracy. It suits Master's or PhD-level computer science experts who have fact-checking experience and can read dense research. https://aitrainers.jobs/jobs/english-australian-language-specialist-freelance-ai-trainer-project-1q2ntchttps://aitrainers.jobs/jobs/english-australian-language-specialist-freelance-ai-trainer-project-1q2ntcSun, 22 Mar 2026 06:29:25 GMTTest an AI model's English grammar, idioms and pragmatics, documenting errors and suggesting prompt or rubric fixes. Suits English-language graduates or those with teaching, publishing or linguistic analysis experience. https://aitrainers.jobs/jobs/reinsurance-program-business-specialist-1i8t0khttps://aitrainers.jobs/jobs/reinsurance-program-business-specialist-1i8t0kWed, 16 Sep 2026 00:00:00 GMTThis contract role has reinsurance and program specialists write reference answers on treaty and fronting structures and grade AI outputs against rubrics. It suits practitioners with at least two years in reinsurance, delegated authority or captive insurance. https://aitrainers.jobs/jobs/policy-administration-insurance-operations-manager-2mrwo7https://aitrainers.jobs/jobs/policy-administration-insurance-operations-manager-2mrwo7Mon, 14 Sep 2026 00:00:00 GMTDesign policy-servicing scenarios and write reference responses for insurance operations, then grade AI outputs against procedural rubrics. Suits experienced carrier, MGA or TPA professionals with policy administration or billing background. https://aitrainers.jobs/jobs/ai-trainer-bosnian-1ix65jhttps://aitrainers.jobs/jobs/ai-trainer-bosnian-1ix65jFri, 11 Sep 2026 15:29:21 GMTRemote, task-based side-by-side evaluation of AI-generated Bosnian text, judging how natural and idiomatic it sounds. It suits fluent Bosnian speakers with a strong grasp of everyday written and spoken usage who work carefully. https://aitrainers.jobs/jobs/ai-tutor-design-7zfbzqhttps://aitrainers.jobs/jobs/ai-tutor-design-7zfbzqThu, 03 Sep 2026 21:07:35 GMTEvaluates and refines design work across graphics, interfaces, websites and games, writing critiques that separate weak design from well-resolved work. Suits professional designers with a strong portfolio in at least one discipline. https://aitrainers.jobs/jobs/ai-evaluator-english-1p5m85https://aitrainers.jobs/jobs/ai-evaluator-english-1p5m85Tue, 11 Aug 2026 17:29:57 GMTRemote freelance work where English speakers hold live conversations with AI voice models and rate images and videos with written explanations. Suits fluent English communicators who give clear, evidence-based judgements. https://aitrainers.jobs/jobs/business-owners-freelance-ai-trainer-project-h2fqedhttps://aitrainers.jobs/jobs/business-owners-freelance-ai-trainer-project-h2fqedTue, 12 May 2026 21:49:26 GMTRemote evaluation of merchant tools and AI-generated business summaries, checked against how your own business actually operates. Suits owners or managers of food, lodging, service or retail businesses who maintain a verified Google Business Profile. https://aitrainers.jobs/jobs/domain-advisor-consultant-subject-matter-expert-137dyihttps://aitrainers.jobs/jobs/domain-advisor-consultant-subject-matter-expert-137dyiFri, 27 Feb 2026 00:11:56 GMTSet gold-standard rubrics and model answers for AI outputs in your own field, and explain why model reasoning fails. Suits established independent experts with advanced degrees who can articulate their methods in writing. https://aitrainers.jobs/jobs/garment-manufacturing-qc-specialist-freelance-ai-trainer-project-oaov38https://aitrainers.jobs/jobs/garment-manufacturing-qc-specialist-freelance-ai-trainer-project-oaov38Thu, 08 Jan 2026 05:19:52 GMTDiscuss garment inspection and factory quality scenarios with an AI model, checking whether its judgements match real production practice. Suits people with hands-on garment QC or production-floor inspection experience who can explain quality decisions clearly. https://aitrainers.jobs/jobs/generalist-ai-trainer-1rznyvhttps://aitrainers.jobs/jobs/generalist-ai-trainer-1rznyvThu, 18 Sep 2025 06:33:53 GMTTrainer work writing and evaluating prompts and AI responses, fact-checking outputs and comparing model answers. Suits strong writers with broad general knowledge who follow complex guidelines carefully. https://aitrainers.jobs/jobs/ai-qa-trainer-llm-evaluation-freelance-project-elbuc9https://aitrainers.jobs/jobs/ai-qa-trainer-llm-evaluation-freelance-project-elbuc9Thu, 18 Sep 2025 00:33:57 GMTRemote work testing large language models for hallucinations, jailbreaks and bias, then writing reproducible failure reports. Suits QA and evaluation specialists with ML or safety testing experience. https://aitrainers.jobs/jobs/natural-language-processing-specialist-je5dhehttps://aitrainers.jobs/jobs/natural-language-processing-specialist-je5dheFri, 05 Sep 2025 18:14:52 GMTNLP researchers who curate text datasets, evaluate language models and design evaluation metrics. Suits PhD-level specialists with several years of NLP research or industry work. https://aitrainers.jobs/jobs/ai-model-evaluation-specialist-5i3guihttps://aitrainers.jobs/jobs/ai-model-evaluation-specialist-5i3guiFri, 05 Sep 2025 18:14:52 GMTEvaluation specialists who design metrics, test model performance and analyse outputs for bias and accuracy. Suits senior ML or computer science experts with five or more years of evaluation work. https://aitrainers.jobs/jobs/app-store-and-music-search-evaluator-loh17ghttps://aitrainers.jobs/jobs/app-store-and-music-search-evaluator-loh17gFri, 18 Apr 2025 20:47:39 GMTEvaluate app store listings and music search results for usability and user intent, using side searches to confirm what each query means. Suits fluent speakers of a listed language with very high English who use an iOS device with a valid Apple ID.