Data checks
These figures come from the checks themselves and update with every refresh.
- Listings refreshed: every hour, last at 20:05 UK time on 20 October 2026.
- Apply links checked in the last 7 days: 6,053. 51 were dead, and 40 roles were taken off the site because of it.
- Facts spot-checked against the platforms' own pages in the last 30 days: 174 facts from 40 listings. 163 matched (94%).
- Roles that closed on the platforms and came off this site in the last 24 hours: 38.
- Since 20 October 2026: we've tracked 4,236 roles from 41 platforms, and 26 of them have since closed and been taken down.
Recent corrections
What the spot checks found wrong, and what we did about it. A pay figure or country list that doesn't match the platform's page comes off the listing until it does.
- 20 Oct · Mindrift · Location (6 listings): Page requires applicants to be 18+ and 'currently living in NYC', not anywhere in the USA as shown. Country list taken down.
- 20 Oct · DataAnnotation · Pay: Page says 'Up to $40/hr' with no $25 floor; shown range is $25-40. Pay figure taken down.
- 20 Oct · DataAnnotation · Pay: Page says 'Up to $125+/hr' with no $40 floor; shown range is $40-125. Pay figure taken down.
- 19 Oct · Mindrift · Location (2 listings): Page requires 'currently living in NYC', not all of the USA. Country list taken down.
- 19 Oct · DataAnnotation · Pay: Page says 'Hourly rate up to $40 / hour' and 'Up to $40/hr'; it states no $25 floor, but shown says $25–40. Pay figure taken down.
Collection
We read public job boards and feeds published by 41 platforms every hour: standard applicant-tracking systems (Greenhouse, Ashby, Lever, Workable), the platforms' own public job APIs, and job pages listed in their sitemaps. We respect each site's robots.txt and terms, never log in, and never get around bot protection. A role that disappears from a platform's board is removed here at the next refresh.
Many platforms post one role many times, once per city or country. We merge these into a single listing and keep the full list of countries, but only when the copies quote the same pay. Where a platform pays different rates in different countries, each rate stays a separate listing with its own countries, and the job page links the other rates.
Every listing is still on the platform's own board at our last hourly check, however long ago it was first posted. Some platforms keep projects open for months.
Which roles we list
Platforms' careers boards mix contributor roles with their own staff vacancies (engineers, sales, recruiters). A classifier keeps only roles where people are paid to train, evaluate or supply data for AI, and we check its decisions against test cases.
Pay
We show the rate the posting states: the platform's structured pay where it has one, otherwise the rate read from the posting ("$40–$65 per hour", "up to $69/hr"). Where a posting states no rate, we show an estimate from the platform's typical range, labelled "est.". Every figure on the site compares pay on the midpoint of each stated range, so "top 10%" is the 90th percentile of those midpoints. Hourly rates in other currencies are converted to US dollars at an approximate rate; the posting's own currency is shown on the job page. Per-task and per-session rates are shown as stated and aren't converted to hourly. "Up to" figures are maximums, and many platforms set your rate after an assessment.
Pay figures (medians, typical ranges, top 10%) follow three rules. Each distinct posting counts once: the same role at the same rate, posted again for other languages or countries, is one data point. "Up to" rates are left out, because a ceiling isn't what most people earn; a platform that only posts ceilings is described by its ceilings instead. And we only give a platform's median when at least 10 distinct postings state a rate, and only rank platforms by pay when each has at least 30. The number of postings behind each figure is shown next to it.
Paid research studies
Some platforms also post paid research studies: focus groups, interviews and in-person sessions. They are real paid work, but not AI training, so they have their own page and are left out of role counts and pay figures. When the same study is posted many times under different headlines, we list it once.
Where you can live
Each job's eligible countries come from the most reliable source available, shown on the job page:
- As listed by the platform: the platform's own country or location fields.
- Read from the description: eligibility sentences in the posting, such as "must be located in…" or "not available in…".
- Platform-wide eligibility: when a posting says nothing, but the platform publishes which countries it accepts overall.
- Not stated: the posting gives no location rules. These roles appear in country searches with a note, and you can hide them with "Stated location only".
Other details
Hours, commitment, experience level, languages, qualifications, screening steps, equipment and payment methods are taken from the platform's structured data where it exists, and otherwise read from the posting. When a posting doesn't say, the job page shows that it isn't stated.
Checks and corrections
Every Apply link is checked every few days, and a role whose link has stopped working comes off the site. Each day we also compare a sample of listings with the platforms' own pages and fix anything that doesn't match; the results are in Data checks above. If you spot a mistake, use the "Tell us" link on the job page or email [email protected]. The platform's own page is always the final word.