Medical AI Evaluator (Remote, Hourly Contractor)

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated medical content and develop cases that test clinical reasoning accuracy. Your work directly improves how leading AI models handle healthcare information, making them more accurate, reliable, and safe. Tasks may include:

• Evaluating AI-generated medical responses for clinical accuracy, reasoning quality, and patient safety implications

• Identifying errors in clinical methodology, unsafe assumptions, missing contraindications, and misinterpretation of diagnostic data

• Writing clear, precise feedback explaining corrections and reasoning gaps

• Developing prompts and test cases that probe AI accuracy across clinical scenarios

• Rating and comparing AI responses based on correctness, internal consistency, and contextual appropriateness

• Fact-checking medical content against reliable sources using co...