Quality Review Analyst (Remote)
Crewlia
What the role involves
- Reassessing completed items
- Grouping disagreement patterns
- Reporting unresolved patterns
What they ask for
At least 18 years old; able to communicate in English; able to perform independent second-pass reviews and analyze disagreement patterns; reliable high-speed internet and suitable home-working setup
About the job
- Role: Quality Review Analyst (Remote)
- Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay: US$18 per hour
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are recruiting impartial contributors to analyze the consistency and evidence behind completed quality decisions. You will perform second-pass reviews, identify disagreement patterns, and document where decisions or guidance need clarification.
Key Responsibilities
- Reassess completed items from the original materials without treating the prior outcome as correct by default.
- Compare reviewer rationales with the rubric and flag conclusions that lack supporting evidence.
- Group disagreements by criterion to distinguish random mistakes from recurring interpretation differences.
- Check whether calibration examples resolve the disagreement before requesting clarification.
- Report changed decisions and unresolved patterns with representative examples from the reviewed set.
Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to perform an independent second-pass review and challenge unsupported conclusions.
- Ability to analyze disagreement patterns and connect them to criteria or calibration examples.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience with quality review, evaluation analysis, or reviewer calibration is helpful but not required.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!