Medarc is a team.
Cite
Notes
Only stored in your browser.
Medication QA (MedInfo 2019) – consumer medication question answering benchmark
Med MCQA evaluation environment
Single-turn medical MCQ
Medical hallucination detection benchmark
MedQA Evaluation
MedRBench evaluation environment for medical reasoning benchmarks
HEAD-QA environment
MetaMedQA medical MCQ evaluation
Med-HALT (Reasoning) evaluation environment for medical LLMs
MTSamples Procedures is a benchmark of medical transcription samples that tests a model's ability to generate coherent and clinically accurate proc...
Evaluation environment for the Joshua-Harris/PubHealthBench public health MCQ dataset
LongHealth: A Question Answering Benchmark with Long Clinical Documents - 20 patients, 400 MCQ questions
Your environment description here
MedExQA Evaluation - Medical QA with Multiple Explanations
Medical Error Detection and Correction in clinical notes from Ben Abacha et al., 2024
ACI Bench evaluation environment
SCT-Bench Public Environment
Evaluation environment for the HPAI-BSC/CareQA MCQ dataset
HEAD-QA v2 environment
MedXpertQA is a highly challenging and comprehensive benchmark designed to evaluate expert-level medical knowledge and advanced reasoning capabilit...
MTSamples Replicate is a benchmark of transcribed medical reports that evaluates a model’s ability to generate clinically appropriate treatment pla...
Single-turn medicine MCQ
A realistic virtual EHR environment to benchmark medical LLM agents on clinical tasks.
MedAgentBench V2 environment for tool-calling evaluation.
MedCalc-Bench clinical calculator evaluation
OpenAI HealthBench evaluation by RK Arora et al., 2025
MedCaseReasoning medical diagnosis evaluation
Multi-agent medical diagnosis environment for evaluating LLMs on clinical diagnosis through interactive conversations.
MedDialog is a benchmark of real-world doctor-patient conversations focused on health-related concerns and advice and tests a model's ability to su...