Quality assurance

AI Data Reviewer (Remote)

Crewlia

New ZealandToday
ContractMid level

What the role involves

  • Checking input-output pairings
  • Identifying unsupported labels
  • Documenting ambiguous examples

What they ask for

At least 18 years old; able to communicate in English; able to understand AI task inputs, expected outputs and labels; able to spot data errors; reliable high-speed internet and suitable home-working setup; must reside in an eligible country

About the job

  • Role: AI Data Reviewer (Remote)
  • Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
  • Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting detail-oriented contributors to inspect data examples prepared for AI training and evaluation. You will check input-output pairings, labels, and supporting context so each example accurately represents the intended task.

Key Responsibilities

  • Confirm that each input is paired with the correct output, label, and contextual information.
  • Identify examples where the assigned label is unsupported or the task instruction is not answerable from the data.
  • Check training examples for duplicates, leakage between fields, truncated content, and inconsistent formatting.
  • Classify data issues according to whether they affect the input, expected output, label, or metadata.
  • Document ambiguous examples that could teach or measure the wrong behavior if left unresolved.

Requirements

  • Must be at least 18 years old and able to communicate in English.
  • Ability to understand the relationship between an AI task input, expected output, and label.
  • Ability to spot pairing errors, ambiguous examples, duplicated content, and missing context.
  • Reliable high-speed internet and a suitable home-working setup.
  • Previous experience with AI data review, annotation, or dataset preparation is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!