AI Data Reviewer (Remote)
Crewlia
What the role involves
- Checking data pairings
- Identifying label errors
- Documenting ambiguous examples
What they ask for
At least 18; able to communicate in English; currently residing in Australia, Canada, Ireland, New Zealand, the United Kingdom, or the United States; understand AI task inputs, outputs, and labels; reliable high-speed internet and suitable home-working setup
About the job
- Role: AI Data Reviewer (Remote)
- Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay: US$18 per hour
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are recruiting detail-oriented contributors to inspect data examples prepared for AI training and evaluation. You will check input-output pairings, labels, and supporting context so each example accurately represents the intended task.
Key Responsibilities
- Confirm that each input is paired with the correct output, label, and contextual information.
- Identify examples where the assigned label is unsupported or the task instruction is not answerable from the data.
- Check training examples for duplicates, leakage between fields, truncated content, and inconsistent formatting.
- Classify data issues according to whether they affect the input, expected output, label, or metadata.
- Document ambiguous examples that could teach or measure the wrong behavior if left unresolved.
Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to understand the relationship between an AI task input, expected output, and label.
- Ability to spot pairing errors, ambiguous examples, duplicated content, and missing context.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience with AI data review, annotation, or dataset preparation is helpful but not required.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!