0

Allen Institute for AI

Allen Institute for AI is an organization.

Cite

Notes

Only stored in your browser.

Evals
7
Tools
0
Models
6
Papers
0
Boards
0
People
0

Models

6

Ranked by Artificial Analysis Intelligence Index

#ModelReleasedIntelligence
1Llama 3.1 Tulu3 405B30 Jan 202514.1
2OLMo 2 32B13 Mar 202510.6
3Olmo 3 7B Think20 Nov 20259.4
4OLMo 2 7B26 Nov 20249.3
5Olmo 3 7B Instruct20 Nov 20258.1
6Molmo2-8B11 Dec 20257.3
6 / 6 models

Evals

7

C4

C4

Ai2Arc

Dataset Card for "ai2_arc"

Active

The Art of Saying No: Contextual Noncompliance in Language Models

Dataset with 1001 samples to test noncompliance capabilities of language models. Contrast set of 379 samples.

ActiveSafeguards

IFBench

Instruction-following benchmark measuring adherence to multi-step constraints.

PIQA: Physical Commonsense Reasoning Test

Measures the model's ability to apply practical, everyday commonsense reasoning about physical objects and scenarios through simple decision-making questions.

ActiveReasoning

DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphs

Evaluates reading comprehension where models must resolve references in a question, perhaps to multiple input positions, and perform discrete operations over them (such as addition, counting, or sorting).

ActiveReasoning

WINOGRANDE: An Adversarial Winograd Schema Challenge at Scale

Set of 273 expert-crafted pronoun resolution problems originally designed to be unsolvable for statistical models that rely on selectional preferences or word associations.

ActiveReasoning