Research Operations Specialist (Remote)
Hired
What the role involves
- Reviewing evaluation examples
- Organising rubric observations
- Documenting rating rationales
What they ask for
Reside in Australia, Canada, Ireland, New Zealand, UK or US; confident spoken English and clear writing; computer, internet, headphones and quiet space for voice tasks; ratings based on supplied evidence, without AI tools.
About the job
- Role: Research Operations Specialist
- Location: Remote from US, CA, UK, IE, AU, NZ
- Engagement Type: Freelance / Hourly Contract
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are looking for methodical reviewers who can organise evidence and maintain consistent decisions across assignments. You will perform AI evaluation of conversations and multimedia outputs while tracking criteria, observations, and ratings accurately. This opportunity is remote, with flexible hours and assignments based on project availability. Students, recent graduates and working professionals are welcome to apply.
Key Responsibilities
- Check examples for complete evidence, consistent treatment, and alignment with the assigned question.
- Compare outputs and organise decisive observations under the correct rubric criteria.
- Document a concise rationale that another reviewer can trace to the content.
- Take part in English conversations with AI models when assigned to voice tasks.
- Record your ratings using project guidelines and flag examples that are difficult to judge.
Requirements
- Confident spoken English and clear written communication.
- Methodical evidence organisation and consistent judgment.
- Ability to base ratings on supplied evidence and review criteria.
- A computer, reliable internet and headphones, with a quiet space for voice-based tasks.
- Ability to produce your own ratings and written explanations without using AI tools.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!
Applying for this job
What to show on your CV
- It names computer and headphones. Use the same words on your CV for the ones you've used, so a search finds them.
- For the work it describes, like "Reviewing evaluation examples", give an example from your own experience, with a result you can talk about at an interview.
Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.