Medarc is a team.
Cite
Notes
Only stored in your browser.
Medication QA (MedInfo 2019) – consumer medication question answering benchmark
MedAgentBench V2 environment for tool-calling evaluation.
MTSamples Procedures is a benchmark of medical transcription samples that tests a model's ability to generate coherent and clinically accurate proc...
MedRBench evaluation environment for medical reasoning benchmarks
HEAD-QA environment
Medical Error Detection and Correction in clinical notes from Ben Abacha et al., 2024
ACI Bench evaluation environment
A realistic virtual EHR environment to benchmark medical LLM agents on clinical tasks.
Single-turn medical MCQ
Evaluation environment for the Joshua-Harris/PubHealthBench public health MCQ dataset
MedQA Evaluation
MetaMedQA medical MCQ evaluation
Med MCQA evaluation environment
MedCalc-Bench clinical calculator evaluation
Med-HALT (Reasoning) evaluation environment for medical LLMs
Medical hallucination detection benchmark
HEAD-QA v2 environment
Evaluation environment for the HPAI-BSC/CareQA MCQ dataset
MedXpertQA is a highly challenging and comprehensive benchmark designed to evaluate expert-level medical knowledge and advanced reasoning capabilit...
LongHealth: A Question Answering Benchmark with Long Clinical Documents - 20 patients, 400 MCQ questions
OpenAI HealthBench evaluation by RK Arora et al., 2025
MTSamples Replicate is a benchmark of transcribed medical reports that evaluates a model’s ability to generate clinically appropriate treatment pla...
SCT-Bench Public Environment
MedCaseReasoning medical diagnosis evaluation
MedDialog is a benchmark of real-world doctor-patient conversations focused on health-related concerns and advice and tests a model's ability to su...
Multi-agent medical diagnosis environment for evaluating LLMs on clinical diagnosis through interactive conversations.
MedExQA Evaluation - Medical QA with Multiple Explanations
Single-turn medicine MCQ
Your environment description here