Content Evaluator (Remote)
Hired
What the role involves
- Assessing generated outputs
- Comparing generated examples
- Recording ratings and reasons
What they ask for
Currently residing in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States; confident spoken English and clear written communication; computer, reliable internet and headphones; quiet space for voice-based tasks; produce ratings and explanations without AI tools
About the job
- Role: Content Evaluator (Remote)
- Location: Remote from US, CA, UK, IE, AU, NZ
- Engagement Type: Freelance / Hourly Contract
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are looking for balanced evaluators who can judge usefulness, clarity, and quality across varied formats. You will perform AI evaluation of conversations, images, and videos using prompts, rubrics, and direct observation. This opportunity is remote, with flexible hours and assignments based on project availability. Students, recent graduates and working professionals are welcome to apply.
Key Responsibilities
- Assess each output for relevance, coherence, realism, and important errors.
- Compare generated examples and choose the stronger result using all assigned criteria.
- Provide a concise evidence-based reason for every overall rating.
- Take part in English conversations with AI models when assigned to voice tasks.
- Record your ratings using project guidelines and flag examples that are difficult to judge.
Requirements
- Confident spoken English and clear written communication.
- Balanced evaluation of strengths and weaknesses.
- Ability to apply ordered quality criteria consistently across assignments.
- A computer, reliable internet and headphones, with a quiet space for voice-based tasks.
- Ability to produce your own ratings and written explanations without using AI tools.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!
Applying for this job
What to show on your CV
- For the work it describes, like "Assessing generated outputs", give an example from your own experience, with a result you can talk about at an interview.
Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.