AI Labs

Radiologist Evaluator (contract)

RadiologyRemote (US, Canada, and UK only)Contract2–3 yrs$ 200–$ 300 / hour

Overview

MarketerHire is seeking board-certified radiologists for a 12-week remote contract evaluating AI-generated radiology reports, impressions, and differential reasoning for clinical accuracy and quality. The role requires a medical degree, completed radiology residency, board certification or equivalent, at least 2 years of post-training independent reading experience, and a current or recently active license to practice in the US, Canada, or UK.

Responsibilities

Key Responsibilities

  • Evaluate AI-generated radiology reports and impressions against clinical quality rubrics covering finding detection, characterisation, differential reasoning, and reporting standards.
  • Assess whether imaging findings genuinely support the conclusions presented in AI-generated output.
  • Identify missed findings, incorrect characterisations, unsupported conclusions, and recommendations that do not follow accepted practice.
  • Review the quality and clinical accuracy of AI-generated differential reasoning.
  • Write clear, structured feedback and detailed justifications for every score.
  • Follow complex evaluation instructions and reason through ambiguous cases consistently.
  • Distinguish clearly between established knowledge and inference when evaluating reports.
  • Help refine grading criteria and iterate on evaluation processes based on feedback from senior reviewers.
  • Complete required onboarding related to data handling before beginning the engagement.
  • Maintain a consistent weekly commitment while working independently and adapting to new evaluation tools and processes.

Requirements

Required Qualifications

  • Medical degree and completed radiology residency.
  • Board certification or equivalent, including ABR, Royal College of Physicians and Surgeons of Canada, or FRCR.
  • 2–3 years of post-training experience reading studies independently.
  • Current or recently active license to practice in the US, Canada, or UK.
  • Excellent written English.
  • Ability to follow complex instructions, reason through ambiguity, and spot errors in reports that read as confident and well written.
  • Ability to clearly separate what is known from what is being inferred, including whether imaging findings genuinely support a conclusion.
  • Ability to work independently, learn new tools quickly, and take feedback well.
  • Based in and working from the US, Canada, or UK.
  • Availability for a consistent weekly commitment throughout the 12-week project.
  • Ability to complete required data-handling onboarding before starting.

Benefits

Benefits and Perks

  • Remote contract engagement available to physicians in the US, Canada, and UK.
  • Flexible scheduling that can be worked around clinical practice.
  • Hourly compensation of $200–$300 per hour, paid weekly via Stripe or Wise.
  • 12-week project with the possibility of extension based on project needs and performance.
  • Work with de-identified or synthetic imaging and case material.
  • No patient-care responsibilities.
  • Reasonable accommodations available upon request.

Education

Required

  • Medical degree
  • Completed radiology residency

Preferred

  • Fellowship training in a subspecialty such as neuroradiology, musculoskeletal, body, chest, or breast imaging

Certifications

Required

  • Board certification or equivalent: ABR, Royal College of Physicians and Surgeons of Canada, or FRCR
Radiologist Evaluator (contract) at AI Labs · Scrini Partner Portal