Medqa (Medarc)

Fresh

MedQA Evaluation

Type: RL Env
Publisher: Medarc
Runtime: single-turn
License: unknown
Size: v0.1.1
Published: Dec 2025
Updated: Feb 2026
Canonical: app.primeintellect.ai/dashboard/environments/medarc/medqa

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/medarc/medqa/@0.1.1/inspect

Attribution policy →

Evals this tool implements

Same problem set, this tool's harness. Run it to score a model on the test.

MedQA: Medical exam Q&A benchmark

Massachusetts Institute of Technology

A Q&A benchmark with questions collected from professional medical board exams. Only includes the English subset of the dataset (which also contains Mandarin Chinese and Taiwanese questions).

ActiveKnowledge