Quality assurance

AI Output Evaluator (Remote)

Hired

New Zealand4 days ago
ContractMid level

What the role involves

  • Reviewing AI outputs
  • Comparing generated pairs
  • Explaining ratings

What they ask for

Currently residing in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States; confident spoken English; computer, reliable internet, headphones and quiet space for voice tasks; produce own ratings and explanations without AI tools

About the job

  • Role: AI Output Evaluator (Remote)
  • Location: Remote from US, CA, UK, IE, AU, NZ
  • Engagement Type: Freelance / Hourly Contract

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are looking for fair-minded reviewers who notice meaningful differences and support consistent judgments. You will perform AI evaluation across voice, images, and video using prompts, rubrics, and observable evidence. This opportunity is remote, with flexible hours and assignments based on project availability. Students, recent graduates and working professionals are welcome to apply.

Key Responsibilities

  • Review AI outputs for instruction fit, clarity, realism, and visible or audible errors.
  • Compare generated pairs and select the stronger response using rubric evidence.
  • Explain each rating in concise English with specific observations from the output.
  • Take part in English conversations with AI models when assigned to voice tasks.
  • Record your ratings using project guidelines and flag examples that are difficult to judge.

Requirements

  • Confident spoken English and clear written communication.
  • Careful judgment when several quality issues compete.
  • Ability to apply ordered quality criteria consistently across assignments.
  • A computer, reliable internet and headphones, with a quiet space for voice-based tasks.
  • Ability to produce your own ratings and written explanations without using AI tools.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!

Applying for this job

What to show on your CV

  • It names headphones. Use the same words on your CV for the ones you've used, so a search finds them.
  • For the work it describes, like "Reviewing AI outputs", give an example from your own experience, with a result you can talk about at an interview.

Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.

More jobs like this