QA Analyst (Remote)
Crewlia
What the role involves
- Examining project examples
- Detecting evaluation inconsistencies
- Documenting decision notes
What they ask for
At least 18 years old; able to communicate in English; able to follow multi-step quality rubrics; able to compare outputs, trace evidence and explain decisions clearly in writing; reliable high-speed internet and suitable home-working setup; resident in an eligible country
About the job
- Role: QA Analyst (Remote)
- Location: Remote (Australia, Canada, Ireland, New Zealand, United Kingdom, United States)
- Pay: US$18 per hour
Applicants must currently reside in Australia, Canada, Ireland, New Zealand, the United Kingdom or the United States.
Overview
We are recruiting careful contributors to assess project data and AI outputs against defined acceptance criteria. You will investigate quality issues, make evidence-based decisions, and document why each item passes, fails, or needs escalation.
Key Responsibilities
- Examine mixed project examples for accuracy, relevance, completeness, and instruction adherence.
- Use control examples and side-by-side checks to detect inconsistent evaluation outcomes.
- Identify incorrect labels, unsupported claims, missing information, and conflicts between an output and its source.
- Write concise decision notes that connect each finding to the applicable criterion.
- Escalate ambiguous cases and recurring defect patterns with enough evidence for consistent resolution.
Requirements
- Must be at least 18 years old and able to communicate in English.
- Ability to follow multi-step quality rubrics and distinguish pass, fail, and edge-case outcomes.
- Ability to compare outputs, trace evidence, and explain a decision in clear written language.
- Reliable high-speed internet and a suitable home-working setup.
- Previous experience with quality assurance, data review, or AI evaluation is helpful but not required.
Equal Opportunity
We welcome applications from qualified individuals of all backgrounds. Applicants are considered based on relevant skills, qualifications and project eligibility requirements, without discrimination on grounds protected by applicable law.
Apply Now!