Search Quality Rater (Remote)
Hired
What the role involves
- Rating search results
- Comparing close examples
- Recording evaluation findings
What they ask for
At least 18 years old; able to communicate in English; reliable high-speed internet and suitable home-working setup; able to rate search results consistently and explain how source limitations affect evaluation confidence
About the job
- Role: Search Quality Rater (Remote)
- Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay: US$18 per hour
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are recruiting contributors to rate search results for AI projects. You will use the supplied search-quality rubric to guide your work and record findings about relevance, usefulness, and intent match across result sets for review.
Key Responsibilities
- Rate search results against the supplied search-quality rubric.
- Compare close examples to keep score boundaries consistent.
- Select the rating supported by the strongest evidence in each item.
- Note when source quality limits confidence in a rating or review decision.
- Record findings about relevance, usefulness, and intent match across result sets and flag unresolved questions for review.
Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to rate search results consistently against the supplied search-quality rubric.
- Ability to explain how source limitations affect evaluation confidence.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience in search rating, content evaluation or quality review is helpful but not required.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!