David Rein

Researcher at METR; first-author of GPQA, the graduate-level "Google-proof" Q&A benchmark; previously at NYU and Cohere.

Role: researcher
Currently at: METR (Model Evaluation and Threat Research)
Twitter: twitter.com/idavidrein
GitHub: github.com/idavidrein
Scholar: scholar.google.com/citations
Papers: 4

Cite

Notes

Only stored in your browser.

Attribution

Affiliations & profile: scholar.google.com/citations

Attribution policy →

4papers·1eval contribs

Authored papers

4

Measuring AI Ability to Complete Long Tasks

preprint

Training Language Models to Win Debates with Self-Play Improves Judge Accuracy

arXiv 2024

GPQA: A Graduate-Level Google-Proof Q&A Benchmark

COLM

Debate Helps Supervise Unreliable Experts

arXiv 2023

Eval contributions

1

GPQA Diamond

New York University

Graduate-level physics, chemistry, and biology multiple-choice questions written by PhDs and verified to be Google-proof.

ActiveScientific ReasoningFactual RecallScience

Affiliations

Currently at

METR (Model Evaluation and Threat Research)

researcher · non profit

Previously

Coherefrontier lab New York Universityuniversity lab

Frequent co-authors

10

from 4 papers

Julian Michael

researcher

3 shared papers

Jackson Petty

grad-student

2 shared papers

Julien Dirani

2 shared papers

Samuel R. Bowman

2 shared papers

Amy Deng

researcher

Asa Cooper Stickland

researcher

Ben West

researcher

Beth Barnes

founder / CEO

Betty Li Hou

grad-student

Brian Goodrich