MMLU RL Env (Community)

Fresh

MMLU evaluator for multi-subject multiple-choice reasoning.

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/thunderpichu/mmlu/@0.1.0/inspect

Lift evidence

Eval	Tools known to lift	Source paper
Measuring Massive Multitask Language Understanding	MMLU RL Env (Community)	-

Same problem set, this tool's harness. Run it to score a model on the test.

University of California, Berkeley

57-subject multiple-choice exam testing broad world knowledge and reasoning across academic and professional domains.

University of California, Berkeley

Evaluate models on 57 tasks including elementary mathematics, US history, computer science, law, and more.