Data and analytics

Project Evaluation Analyst (Remote)

Crewlia

New ZealandToday
ContractMid level

What the role involves

  • Annotating multimodal datasets
  • Evaluating AI-generated media
  • Documenting recurring errors

What they ask for

Strong written and spoken English proficiency; stable high-speed internet connection (minimum 25 Mbps); private workspace; residency and work authorization in the United States or Canada

About the job

  • Role: Project Evaluation Analyst (Remote)
  • Location: Remote (Australia, Canada, United Kingdom, Ireland, New Zealand, United States)
  • Employment Type: Contract

Applicants must currently reside in Australia, Canada, United Kingdom , Ireland, New Zealand or the United States.

Overview:

We are looking for a detail-oriented Project Evaluation Analyst to review, annotate, and structure multimodal datasets for advanced artificial intelligence models. You will play a crucial role in improving data quality across text, images, spreadsheets, and complex structured documents.

Key Responsibilities:

  • Annotate, categorize, and validate large-scale multimodal datasets according to strict project guidelines.
  • Analyze AI-generated text and media to verify alignment with human intent and factual truth.
  • Document recurring errors and edge cases to continuously enhance model training instructions.
  • Maintain high accuracy, quality benchmarks, and daily throughput goals.

Requirements:

  • Exceptional attention to detail, reading comprehension, and analytical evaluation skills.
  • Background in editing, technical writing, QA testing, or data labeling is highly advantageous.
  • Strong written and spoken English proficiency to clearly articulate complex judgments.
  • Must possess a stable high-speed internet connection (minimum 25 Mbps) and a private workspace.
  • Residency and work authorization in the United States or Canada is strictly required.

Equal Opportunity Employer:

We are an equal opportunity employer. We are committed to building an inclusive workplace and welcome applications from all qualified individuals regardless of race, color, ethnicity, nationality, gender, gender identity or expression, sexual orientation, age, religion, disability, marital status, or any other characteristic protected by applicable law. All hiring decisions are made solely on the basis of qualifications, skills, and demonstrated ability.

Apply Now!

CV examples for these jobs

Cover letter examples