GPQA Diamond RL Env (Community)

Fresh

GPQA Diamond: A Graduate-Level Google-Proof Q&A Benchmark

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/anshu/gpqa_diamond/@0.1.0/inspect

Lift evidence

Eval	Tools known to lift	Source paper
GPQA (Full Set)	GPQA Diamond RL Env (Community)	-
GPQA: Graduate-Level STEM Knowledge Challenge	GPQA Diamond RL Env (Community)	-

Same problem set, this tool's harness. Run it to score a model on the test.

New York University

Graduate-level physics, chemistry, and biology multiple-choice questions written by PhDs and verified to be Google-proof.