Job Description
Medical Evaluation Specialist (students, residents, physicians)
Role Type: Contractor
Location: Remote
Scope of Work
Craft original, high-difficulty medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, guidelines, and clinical judgment.
Source and verify answers using primary literature, clinical guidelines, and authoritative references; thoroughly document rationale and citations.
Develop questions requiring synthesis and genuine clinical reasoning rather than simple fact recall.
Evaluate AI model responses to your questions, refine those that are too straightforward, and enhance complexity while ensuring clinical accuracy.
Ensure all questions and answers are written with clarity, precision, and defensibility — avoiding ambiguity.
Incorporate reviewer feedback and align deliverables with evolving project guidelines and standards.
Preferred Qualifications
Current medical training or clinical practice as a student, resident, or physician, or equivalent biomedical expertise.
Demonstrated ability to locate, interpret, and synthesize information from primary literature and clinical guidelines.
Exceptional attention to detail and proficiency in written English (native fluency not required).
Talent for creating engaging, well-structured, and clinically nuanced questions.
Self-motivated and reliable in managing independent remote contributions.
Experience with medical question writing, peer review, or evaluative projects is an advantage.
Familiarity with AI/ML systems or model evaluation is a plus but not essential.
Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.
