Quality assurance

AI Response Reviewer (Remote)

Crewlia

New ZealandYesterday
ContractMid level

What the role involves

  • Evaluating AI responses
  • Comparing similar examples
  • Recording review findings

What they ask for

Must be at least 18; able to communicate in English; able to evaluate responses consistently and support judgments with evidence; reliable high-speed internet and suitable home-working setup; reside in an eligible country

About the job

  • Role: AI Response Reviewer (Remote)
  • Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
  • Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting contributors to evaluate AI responses and prompt-response pairs for AI projects. You will use the supplied response criteria to guide your work and record findings about errors, omissions, relevance, and instruction alignment for review.

Key Responsibilities

  • Evaluate AI responses and prompt-response pairs against the supplied response criteria.
  • Compare similar examples before making close quality decisions.
  • Identify the specific evidence that supports each judgment.
  • Check that each judgment points to evidence in the reviewed item.
  • Record findings about errors, omissions, relevance, and instruction alignment and flag unresolved questions for review.

Requirements

  • Must be at least 18 years old and able to communicate in English.
  • Ability to evaluate AI responses and prompt-response pairs consistently against the supplied response criteria.
  • Ability to support judgments with specific evidence from the reviewed item.
  • Reliable high-speed internet and a suitable home-working setup.
  • Previous experience in AI response evaluation, content review or quality checking is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!