Quality assurance

AI Response Reviewer (Remote)

Crewlia

New Zealand12 days ago
ContractMid level

What the role involves

  • Evaluating AI responses
  • Comparing similar examples
  • Recording review findings

What they ask for

Must be at least 18; able to communicate in English; currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States; reliable high-speed internet and suitable home-working setup

About the job

  • Role: AI Response Reviewer (Remote)
  • Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
  • Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting contributors to evaluate AI responses and prompt-response pairs for AI projects. You will use the supplied response criteria to guide your work and record findings about errors, omissions, relevance, and instruction alignment for review.

Key Responsibilities

  • Evaluate AI responses and prompt-response pairs against the supplied response criteria.
  • Compare similar examples before making close quality decisions.
  • Identify the specific evidence that supports each judgment.
  • Check that each judgment points to evidence in the reviewed item.
  • Record findings about errors, omissions, relevance, and instruction alignment and flag unresolved questions for review.

Requirements

  • Must be at least 18 years old and able to communicate in English.
  • Ability to evaluate AI responses and prompt-response pairs consistently against the supplied response criteria.
  • Ability to support judgments with specific evidence from the reviewed item.
  • Reliable high-speed internet and a suitable home-working setup.
  • Previous experience in AI response evaluation, content review or quality checking is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!

Applying for this job

What to show on your CV

  • For the work it describes, like "Evaluating AI responses", give an example from your own experience, with a result you can talk about at an interview.

Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.

More jobs like this