Internal Medicine AI Evaluation Specialist

1 month, 2 weeks ago
Contract
Senior
Artificial Intelligence and Machine Learning
Weekday

Weekday

Weekday helps companies hire engineers who are vouched by other software engineers, enabling passive income for engineers. They offer services like drafting outreach messages, shortlisting candidates, and conducting reference checks. Backed by Y Combin...

Construction & Engineering
11-50
Founded 2020

Description

  • Create realistic Internal Medicine case studies based on everyday clinical practice.
  • Develop prompts covering diagnostic reasoning, differential diagnosis, treatment planning, risk stratification, evidence-based guideline adherence, and long-term patient management.
  • Produce attending physician-level reference solutions that reflect current clinical best practices.
  • Ensure recommendations align with established evidence-based guidelines.
  • Review and assess AI-generated clinical responses using structured evaluation frameworks.
  • Identify reasoning gaps, inaccuracies, omissions, and opportunities for improvement.
  • Provide detailed written feedback to improve AI model performance and clinical reliability.
  • Participate in onboarding sessions and specialty calibration meetings.
  • Work with multidisciplinary teams to ensure consistency, accuracy, and quality across medical evaluations.

Requirements

  • Board certification in Internal Medicine for attending physicians, or final-year Internal Medicine residency for resident physicians, or board certification/eligibility in Internal Medicine or a related subspecialty for fellows.
  • Current, active, and unrestricted medical license.
  • Recent residency graduates must be board-eligible.
  • Experience in Internal Medicine subspecialties such as cardiology, hematology & oncology, endocrinology, nephrology, gastroenterology, pulmonology, or other subspecialties is encouraged.
  • Strong knowledge of evidence-based medicine and clinical practice guidelines.
  • Experience in clinical teaching, medical research, or quality improvement initiatives is preferred.
  • Excellent written communication and analytical skills.
  • Interest in artificial intelligence, clinical decision support, or healthcare technology is preferred.
  • Ability to work approximately 20 hours per week on a flexible schedule.
  • Visa sponsorship is not available for this opportunity.

Benefits

  • Compensation of $130-$180 per hour, determined by clinical experience, expertise, and seniority.
  • Fully remote, 100% asynchronous work completed on your own schedule.
  • Standard commitment of approximately 20 hours per week, with opportunities for additional hours based on project demand.
  • Weekly payments through supported payment platforms.
  • Rolling onboarding with ongoing engagement opportunities.
  • Independent contractor engagement.
  • Reasonable accommodations available upon request.

Interested in this position?

Apply directly on the company website

Apply Now

Similar Roles

Filipino Quality Control Specialist - Project Lyra

Welo Global Professional Services

Welo Data is seeking Filipino-speaking linguistics experts in the Philippines for a four-week remote freelance project evaluating and improving AI-generated language outputs for accuracy, grammar, and cultural relevance.

LLM
5 hours, 8 minutes ago

Arabic (Egyptian) Quality Control Specialist - Project Lyra

Welo Global Professional Services

Welo Data is seeking Arabic (Egyptian)-speaking linguistics experts in Egypt or Saudi Arabia to evaluate and improve AI-generated language outputs for a four-week conversational AI project.

LLM
5 hours, 8 minutes ago

Competitive Programming Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking competitive programmers for project-based work creating and validating algorithmic problems, solutions, test cases, and graders used to train advanced AI coding models.

C++ Python
6 hours, 8 minutes ago

Competitive Programming Expert - Freelance AI Trainer

Mindrift.ai: Be the “I” in AI Internet Software & Services

Mindrift is seeking competitive programmers for project-based work creating and validating algorithmic problems, solutions, test cases, and graders that improve AI coding models.

C++ Python
1 day, 6 hours ago

You're on a roll! Sign up now to keep applying.

Sign Up

Already have an account? Log in

Used by 14,729+ remote workers