AI Output Evaluator (Remote)
Hired
What the role involves
- Reviewing AI outputs
- Comparing generated pairs
- Explaining ratings
What they ask for
Currently residing in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States; confident spoken English; computer, reliable internet, headphones and quiet space for voice tasks; produce own ratings and explanations without AI tools
About the job
- Role: AI Output Evaluator (Remote)
- Location: Remote from US, CA, UK, IE, AU, NZ
- Engagement Type: Freelance / Hourly Contract
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are looking for fair-minded reviewers who notice meaningful differences and support consistent judgments. You will perform AI evaluation across voice, images, and video using prompts, rubrics, and observable evidence. This opportunity is remote, with flexible hours and assignments based on project availability. Students, recent graduates and working professionals are welcome to apply.
Key Responsibilities
- Review AI outputs for instruction fit, clarity, realism, and visible or audible errors.
- Compare generated pairs and select the stronger response using rubric evidence.
- Explain each rating in concise English with specific observations from the output.
- Take part in English conversations with AI models when assigned to voice tasks.
- Record your ratings using project guidelines and flag examples that are difficult to judge.
Requirements
- Confident spoken English and clear written communication.
- Careful judgment when several quality issues compete.
- Ability to apply ordered quality criteria consistently across assignments.
- A computer, reliable internet and headphones, with a quiet space for voice-based tasks.
- Ability to produce your own ratings and written explanations without using AI tools.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!
Applying for this job
What to show on your CV
- It names headphones. Use the same words on your CV for the ones you've used, so a search finds them.
- For the work it describes, like "Reviewing AI outputs", give an example from your own experience, with a result you can talk about at an interview.
Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.