MMMU: Multimodal College-Level Understanding and Reasoning
Active
Assesses multimodal AI models on challenging college-level questions covering multiple academic subjects, requiring detailed visual interpretation, in-depth reasoning, and both multiple-choice and open-ended answering abilities.
- Publisher
- University of Waterloo
- Domain
- Reasoning
- License
- mit
- Published
- Oct 2024
- Notable for
- Benchmark for evaluating Reasoning.
Cite
Notes
Only stored in your browser.
Related tools
1Implementations, trainers, datasets and scaffolds linked to this eval.
FAQ
- What is MMMU: Multimodal College-Level Understanding and Reasoning?
- Assesses multimodal AI models on challenging college-level questions covering multiple academic subjects, requiring detailed visual interpretation, in-depth reasoning, and both multiple-choice and open-ended answering abilities.
- How can a model improve its MMMU: Multimodal College-Level Understanding and Reasoning score?
- Tools linked to MMMU: Multimodal College-Level Understanding and Reasoning on Sophon include MMMU RL Env (Prime Intellect) - RL environments, datasets, and scaffolds that target this eval.
- What license is MMMU: Multimodal College-Level Understanding and Reasoning under?
- MMMU: Multimodal College-Level Understanding and Reasoning is available under mit.