Search Evaluator (Remote)
Hired
What the role involves
- Evaluating search results
- Comparing content with intent
- Selecting relevance ratings
What they ask for
At least 18 years old; able to communicate in English; able to evaluate English search results against written relevance criteria; reliable high-speed internet and suitable home-working setup; currently reside in an eligible country
About the job
- Role: Search Evaluator (Remote)
- Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay: US$18 per hour
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are recruiting contributors for AI projects that require evaluation of search results against explicit relevance guidelines. You will compare result sets, apply the stated criteria and document clear reasoning for each decision.
Key Responsibilities
- Evaluate assigned search results against the stated relevance guidelines.
- Compare result content with the search intent and available context.
- Select ratings that match the documented evaluation criteria.
- Record concise reasoning for each material decision.
- Flag ambiguous queries or result sets that need further guidance.
Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to evaluate English search results against written relevance criteria.
- Ability to explain why a result is relevant, partially relevant or not relevant.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience in search evaluation is helpful but not required.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!