RemoteLeads Logo
Sign Up Sign In

Medical Expert AI Evaluation Specialist

1 week, 3 days ago
United States, Canada
Contract
Lead
AI (Artificial Intelligence)
Artificial Intelligence and Machine Learning
Apply Now
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020
View All Jobs 43

Description

  • Create realistic, specialty-specific clinical cases that reflect real-world medical practice.
  • Design prompts covering diagnostic reasoning, treatment planning, risk stratification, differential diagnosis, and guideline-based clinical decision-making.
  • Produce reference-quality clinical responses that reflect attending physician-level reasoning.
  • Ensure recommendations align with current evidence-based practices and accepted clinical guidelines.
  • Assess AI-generated medical responses using structured evaluation frameworks and scoring rubrics.
  • Identify strengths, weaknesses, omissions, and reasoning errors in AI outputs.
  • Provide detailed written feedback to improve model performance and clinical accuracy.
  • Participate in onboarding sessions and specialty calibration meetings.
  • Work with multidisciplinary research teams to maintain consistency and quality across medical evaluations.

Requirements

  • Board-certified physician with a current, active, and unrestricted medical license, if applying as an attending physician.
  • Currently in the final year of an accredited residency program, if applying as a resident physician.
  • Recent residency graduates must be board-eligible.
  • Board-certified or board-eligible in primary specialty, if applying as a fellow.
  • Current, active, and unrestricted medical license, if applying as a fellow.
  • Physicians from specialties including Family Medicine, Pediatrics, Anesthesiology, General Surgery, ENT (Otolaryngology), PM&R, Occupational Medicine, and other medical or surgical specialties are encouraged to apply.
  • Strong understanding of evidence-based medicine and clinical practice guidelines.
  • Excellent written communication skills.
  • Experience with medical education, clinical research, peer review, or healthcare quality initiatives.
  • Interest in artificial intelligence and healthcare innovation.
  • Must be located in Canada or the United States.
  • Visa sponsorship is not available for this opportunity.

Benefits

  • Compensation of $130-$180 per hour.
  • Fully remote, 100% asynchronous work.
  • Flexible schedule completed on your own time.
  • Typical commitment of approximately 20 hours per week, with opportunities for additional hours based on project needs.
  • Weekly payments.
  • Rolling onboarding with ongoing project opportunities.
  • Independent contractor engagement.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Welo Global

Hydrus -Voice Contributor — English (US)

Welo Global Professional Services

Welo Data is hiring a freelance native-level English (US) speaker to record conversational customer-service audio for a remote AI voice project.

United States Freelance Entry Level AI (Artificial Intelligence) Customer Support
$100k-$100k
1 day, 13 hours ago
Crosslake

AI / ML Consultant

Crosslake 251-1K Capital Markets

Crosslake is hiring a US-based remote consultant to help technology and private equity clients evaluate, improve, and implement AI and software-related initiatives across the investment lifecycle.

United States Contract Lead AI (Artificial Intelligence)
Agile Computer Vision Generative AI LLM Machine Learning MLOps NLP Statistics
1 day, 13 hours ago
Welo Global

Hydrus -Voice Contributor — Spanish (Spain)

Welo Global Professional Services

Welo Data is hiring a freelance native-level Spanish (Spain) speaker to record conversational customer-service voice data for a remote conversational AI project.

Spain Freelance Entry Level AI (Artificial Intelligence) Customer Support
$83k-$83k
1 day, 13 hours ago
Mindrift.ai: Be the “I” in AI

Senior Python Engineer - AI Coding Agent Evaluation (Freelance)

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking an experienced software development specialist to create realistic coding-agent evaluation tasks and tests for project-based AI opportunities.

Costa Rica Ecuador Jamaica Uruguay Freelance Lead AI (Artificial Intelligence) Backend Engineer
Docker FastAPI JavaScript Kafka PostgreSQL Python React Redis TypeScript
2 days, 13 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers