Research and development

STEM Expert, AI Training & Evaluation

Toptal

New ZealandToday
Contract

What the role involves

  • Reviewing ai-generated responses
  • Creating technical questions
  • Analyzing technical information

What they ask for

Professional, research, or teaching experience in a STEM discipline

About the job

ExpertCrowd is building a network of science, technology, engineering, and mathematics professionals to help AI systems get better at the hardest part of technical work: reasoning correctly. As AI models are asked to solve problems, work through technical questions, and perform real-world tasks, they need experts who can tell the difference between an answer that sounds right and one that is right.

In this role, you’ll apply your subject matter expertise to AI training and evaluation projects that improve how models solve problems and reason through technical material. We welcome researchers, scientists, engineers, educators, and industry professionals across STEM disciplines, including biology, chemistry, physics, mathematics, statistics, computer science, engineering, and environmental sciences. Assignments will reflect your experience and area of expertise.

What You’ll Do

  • Review AI-generated responses for technical accuracy and quality.
  • Create challenging questions, realistic scenarios, and reference solutions that test genuine understanding of your field.
  • Analyze scientific or technical information and explain your reasoning clearly.
  • Identify errors, unsupported assumptions, and gaps in AI-generated work.
  • Provide structured feedback and review contributions against project guidelines.

What You Bring

  • Professional, research, or teaching experience in a STEM discipline.
  • Strong analytical, problem-solving, and written communication skills.
  • Close attention to detail and the ability to explain complex concepts clearly.
  • The ability to follow project guidelines and meet deadlines while working independently.
  • A genuine interest in applying your expertise to AI development.
  • Relevant degrees, specialized tools, or programming skills may be required for specific projects.

Nice To Have

  • Prior experience with AI tools, data annotation, or model evaluation (welcome but not required).
  • An advanced degree (MS or PhD) or active research background in your discipline.
  • Programming or computational experience (e.g., Python, R, MATLAB) relevant to your field.
  • Experience writing exam, assessment, or problem-set material, or reviewing the technical work of others.

Why This Role

  • Shape how AI handles technical problems. Your expertise directly improves the answers researchers, engineers, and students will rely on.
  • Work on your terms. Opportunities are fully remote and project-based, so you can take on work that fits around your research, teaching, or practice.
  • Use your specialty. Projects are matched to your discipline and experience, so you’re challenged in the areas you know best.
  • Clear terms up front. Compensation, time commitment, and duration vary by assignment and are shared before you accept any project.