Medical Evaluation Specialist
About the role
OpenTrain AI is hiring a Medical Evaluation Specialist to create challenging medical questions, verify answers against clinical literature and guidelines, and evaluate AI model responses. The part-time contractor role runs 10–15 hours per week, is open worldwide, and is designed for medical students, residents, physicians, or professionals with equivalent biomedical expertise.
What you'll do
- Design and verify challenging medical question-and-answer pairs covering diagnosis, mechanisms, pharmacology, guidelines, and clinical judgment.
- Source and verify answers using primary literature, clinical guidelines, and authoritative references.
- Document the rationale for answers and provide supporting citations.
- Evaluate AI model responses to questions created.
- Incorporate reviewer feedback and align work with evolving project guidelines.
Requirements
- Current medical training or clinical practice as a student, resident, or physician, or equivalent biomedical expertise.
- Ability to locate, interpret, and synthesize primary literature and clinical guidelines.
- Exceptional attention to detail.
- Proficiency in written English (native fluency not required).
- Self-motivation and reliability for independent remote work.
About OpenTrain AI
OpenTrain AI is a talent marketplace connecting freelance AI trainers and domain experts with AI training and data-labeling projects; candidates apply through OpenTrain, which may place or refer them to the client whose project they support.
AI Alerts shares third-party job opportunities for informational purposes only. We are not the employer and are not involved in the hiring process. Always verify the company and role through official channels before applying, and never pay to apply, train, onboard, process documents, or secure a job offer. Legitimate employers do not ask applicants for money. Read our Terms to learn more.