MMLU Pro (Prime Intellect)

MMLU-Pro evaluation environment

Type: RL Env
Publisher: Prime Intellect
Tags: Knowledge V1
Runtime: single-turn
License: unknown
Size: v0.1.0
Published: Oct 2025
Updated: Sep 2026
Canonical: app.primeintellect.ai/dashboard/environments/primeintellect/mmlu-pro

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/primeintellect/mmlu-pro/@0.1.3/inspect

Attribution policy →

Evals this tool implements

Same problem set, this tool's harness. Run it to score a model on the test.

MMLU-Pro

TIGER-Lab

Harder, reasoning-focused successor to MMLU with 10 answer choices and curated questions resistant to lucky guessing.

ActiveFactual RecallScientific Reasoning

MMLU-Pro: Advanced Multitask Knowledge and Reasoning Evaluation

TIGER-Lab

An advanced benchmark that tests both broad knowledge and reasoning capabilities across many subjects, featuring challenging questions and multiple-choice answers with increased difficulty and complexity.

ActiveKnowledge