Medical Doctor (Specialist)

About this role

In this hourly, remote contractor role, you will work as a Medical Doctor (Specialist) Subject Matter Expert (SME) to review AI-generated clinical responses and/or create expert medical content, evaluating reasoning quality and step-by-step clinical problem-solving while providing precise written feedback. You will assess solutions for accuracy, clarity, safety, and adherence to the prompt; identify errors in clinical methodology, differential diagnosis, risk stratification, red-flag recognition, test interpretation, and treatment planning; fact-check medical information; write high-quality explanations and model solutions that demonstrate correct reasoning; and rate and compare multiple responses based on correctness and reasoning quality.

Board-certified/board-eligible specialists across a range of fields, including but not limited to Internal Medicine, Family Medicine, Emergency Medicine, Pediatrics, OB/GYN, Cardiology, Neurology, Psychiatry, General Surgery, Anesthesiology, Critical Care, Radiology, Oncology, Dermatology, Orthopedics, Gastroenterology, Pulmonology, Nephrology, Endocrinology, Infectious Disease, and Pathology are welcomed.

This role is with SME Careers, a fast-growing AI Data Services company and subsidiary of SuperAnnotate, delivering training data for many of the world’s largest AI companies and foundation-model labs. Your healthcare expertise directly helps improve the world’s premier AI models by making their clinical and public-health reasoning more accurate, reliable, and clearly explained.

Your profile

• MD/DO (or equivalent) with completed specialty training (residency/fellowship as applicable) and board eligibility/certification (or local equivalent).

• 5+ years of post-training clinical experience in a specialty setting (hospital, outpatient, academic, or community practice).

• Confident in advanced clinical reasoning: differential diagnosis, triage, red flags, and escalation pathways appropriate to specialty practice.

• Strong understanding of disease processes, guideline-based care, diagnostic pathways, and patient-safety considerations within your specialty.

• Exceptional attention to detail when fact-checking clinical content and identifying unsafe assumptions, missing contraindications, inappropriate tests/therapies, or misinterpretation of results; minimum C1 English proficiency.

• Comfortable evaluating answers for internal consistency (timelines, physiology, dosing/contraindications where relevant), appropriateness for setting (ED vs inpatient vs outpatient), and risk/benefit tradeoffs.

• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.

• Prior experience with AI data training/annotation, guideline work, utilization review, clinical documentation review, or healthcare editorial QA is strongly preferred.

Key responsibilities

• Develop AI Training Content: Create detailed prompts and gold-standard answers across clinical topics aligned to your specialty, ensuring accuracy and appropriate scope.

• Optimize AI Performance: Evaluate and rank AI responses to enhance correctness, safety, clarity, and contextual relevance.

• Ensure Model Integrity: Test AI outputs for inaccuracies, unsafe recommendations, and bias; validate reliability across use cases and patient populations.