Internal Medicine Physician (AI Training)
DataAnnotation
What the role involves
- Reviewing AI responses
- Rating clinical answers
- Comparing model responses
What they ask for
Board certification in internal medicine with at least 3 years of post-residency experience, or a current licence to practise clinically in internal medicine; hands-on experience managing complex adult disease; English fluency at native or bilingual level; based in Australia, Canada, Ireland, New Zealand, the United Kingdom, or the United States
- 3+ yrs experience
- Professional licence or registration
About the job
Overview
We’re looking for an experienced Internal Medicine Physician to help train AI models. You’ll measure how well the models answer clinical questions in internal medicine, check their reasoning, and help raise the quality of each new version.
This is a new area for our company: teaching AI to reason about the prevention, diagnosis, and non-surgical management of complex adult disease the way a skilled internist would, reading a presentation, weighing the workup, and knowing what actually changes management. Open to internists across subspecialties, from critical care and endocrinology to infectious disease, nephrology, oncology, primary care, and rheumatology, and to the clinicians who practice alongside them.
What you’ll actually do
- Review AI responses to clinical questions alongside the context a clinician would have when answering them.
- Rate each response on accuracy, completeness, safety, and usefulness to the person asking.
- Compare two independent responses to the same question, decide which one a clinician would rely on, and log each discrepancy.
- Write a clear, detailed rationale for your call, including what the weaker response still got right.
- Pinpoint what model responses miss, misstate, or leave incomplete, from an incomplete differential to a missed interaction, contraindication, or red flag.
Roles this fits
Common backgrounds: Internal Medicine Physician, Attending Physician, Subspecialist.
What we look for
- Board certification in internal medicine with at least 3 years of post-residency experience, or a current license that lets you practice clinically in internal medicine (for example RN, NP, or PA).
- Hands-on clinical experience managing complex adult disease.
- Fluency in English (native or bilingual level).
- Clear, well-organized writing and close attention to detail.
- Only applicants based in Australia, Canada, Ireland, New Zealand, the United Kingdom, or the United States will be considered for this role.
Compensation
Up to $125+/hr depending on task difficulty and specialization. Many contributors add $100k–$200k a year; some make it their full-time income.
About DataAnnotation
DataAnnotation is where 1M+ experts train the world’s leading AI models. Hundreds of millions paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.
Apply now
Hourly rate up to $125+ / hour
Commitment Flexible hours
Type Independent contractor
Payouts Weekly
Apply now
Applying for this job
What to show on your CV
- The ad asks for 3 years of experience or more. Make your dates and job titles easy to check, most recent first.
- It needs a professional licence or registration. Put yours near the top, with its number if the profession uses one.
- For the work it describes, like "Reviewing AI responses", give an example from your own experience, with a result you can talk about at an interview.
Our guides to the New Zealand CV format, cover letters and interview questions cover the rest.