0

New York University

Private R1 research university with leading AI/ML groups in NLP, perception, and AI safety - home to Yann LeCun and Sam Bowman's groups.

Visit
Type
university lab
HQ
New York, NY, USA
Founded
1831
Funding
Private non-profit university
Website
nyu.edu
Twitter
twitter.com/nyuniversity

Cite

Notes

Only stored in your browser.

Evals
6
Tools
0
Models
0
Papers
1
Boards
0
People
15

Evals

6

SuperGLUE

Dataset Card for "super_glue"

GLUE (General Language Understanding Evaluation benchmark)

Dataset Card for GLUE

BBQ: Bias Benchmark for Question Answering

A dataset for evaluating bias in question answering models across multiple social dimensions.

ActiveBias

GPQA (Full Set)

448 graduate-level physics/chemistry/biology MCQs written by PhDs - the full set; the harder "Diamond" subset is reported more often.

ActiveScientific ReasoningFactual RecallScience

GPQA Diamond

Graduate-level physics, chemistry, and biology multiple-choice questions written by PhDs and verified to be Google-proof.

ActiveScientific ReasoningFactual RecallScience

GPQA: Graduate-Level STEM Knowledge Challenge

Contains challenging multiple-choice questions created by domain experts in biology, physics, and chemistry, designed to test advanced scientific understanding beyond basic internet searches. Experts at PhD level in the corresponding domains reach 65% accuracy.

ActiveKnowledge

Papers

1

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

COLM

2023