Quality assurance

AI Content Evaluator (Remote)

Crewlia

New ZealandToday
ContractMid level

What the role involves

  • Evaluating generated content
  • Checking factual statements
  • Writing rating rationales

What they ask for

At least 18 years old; able to communicate in English; able to evaluate generated writing and support ratings with precise examples; reliable high-speed internet and suitable home-working setup; currently reside in an eligible country

About the job

  • Role: AI Content Evaluator (Remote)
  • Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
  • Pay: US$18 per hour

Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.

Overview

We are recruiting perceptive contributors to evaluate AI-generated written content. You will assess whether responses are useful, grounded in the provided context, appropriately expressed, and compliant with each prompt.

Key Responsibilities

  • Judge whether generated content addresses every material part of the user request.
  • Check factual statements against the context and sources supplied within the task.
  • Identify invented details, vague reasoning, repetition, off-topic text, and unsuitable tone.
  • Score content across the required dimensions without allowing strength in one area to hide a failure in another.
  • Write short rationales that point to the response text supporting each rating.

Requirements

  • Must be at least 18 years old and able to communicate in English.
  • Ability to evaluate generated writing for relevance, grounding, clarity, and instruction adherence.
  • Ability to support ratings with precise examples from a prompt and response.
  • Reliable high-speed internet and a suitable home-working setup.
  • Previous experience with AI content evaluation, writing review, or language annotation is helpful but not required.

Equal Opportunity

We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.

Apply Now!