Board-Certified Anesthesiologist – AI Clinical Evaluation Specialist

About the role

We're building a network of elite medical experts to help train and evaluate next-generation health AI systems. We're looking for board-certified anesthesiologists (MD or DO) to review de-identified patient charts and assess the clinical quality of AI-generated responses to anesthesiology questions. This is a remote, flexible-hours opportunity ideal for practicing or recently practicing physicians who want to apply their clinical judgment to shape the future of medical AI.

What you'll do

• Review de-identified patient charts and associated clinical questions in anesthesiology
• Evaluate AI-generated answers for clinical accuracy, safety, and alignment with current standards of care
• Compare pairs of AI responses and judge which is clinically stronger, more complete, and more appropriately cautious
• Write clear, structured rationales explaining your evaluations, covering clinical rigor, completeness, and clarity
• Identify and flag any errors, omissions, or recommendations that could compromise patient safety
• Provide consistent, high-quality feedback on a recurring basis as new cases and model outputs become available

Requirements

• Board certification in Anesthesiology (MD or DO)
• Active or recently active clinical practice experience in anesthesiology
• Strong understanding of current anesthesiology standards of care, perioperative management, and patient safety protocols
• Excellent written communication skills, with the ability to articulate clinical reasoning clearly and concisely
• Comfortable working independently in a remote, asynchronous environment
• Attention to detail and sound clinical judgment when comparing and scoring responses
• Reliable internet access and availability for ongoing, flexible-hour engagements

Compensation

This role offers a competitive hourly rate of $350/hour, reflecting the specialized clinical expertise required. Engagement is remote and flexible, structured around your availability.