Quality assurance

Search Quality Rater (Remote)

Hired

New ZealandToday
ContractMid level

What the role involves

  • Rating search results
  • Comparing close examples
  • Recording evaluation findings

What they ask for

At least 18 years old; able to communicate in English; able to rate search results consistently against the supplied rubric; able to explain how source limitations affect evaluation confidence; reliable high-speed internet and suitable home-working setup; currently reside in an eligible country

About the job

  • Role: Search Quality Rater (Remote)
  • Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
  • Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting contributors to rate search results for AI projects. You will use the supplied search-quality rubric to guide your work and record findings about relevance, usefulness, and intent match across result sets for review.

Key Responsibilities

  • Rate search results against the supplied search-quality rubric.
  • Compare close examples to keep score boundaries consistent.
  • Select the rating supported by the strongest evidence in each item.
  • Note when source quality limits confidence in a rating or review decision.
  • Record findings about relevance, usefulness, and intent match across result sets and flag unresolved questions for review.

Requirements

  • Must be at least 18 years old and able to communicate in English.
  • Ability to rate search results consistently against the supplied search-quality rubric.
  • Ability to explain how source limitations affect evaluation confidence.
  • Reliable high-speed internet and a suitable home-working setup.
  • Previous experience in search rating, content evaluation or quality review is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!