Gpqa (Prime Intellect)

GPQA evaluation environment

Type: RL Env
Publisher: Prime Intellect
Tags: Science V1
Runtime: single-turn
License: unknown
Size: v0.1.0
Published: Sep 2025
Updated: Sep 2026
Canonical: app.primeintellect.ai/dashboard/environments/primeintellect/gpqa

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/primeintellect/gpqa/@0.1.0/inspect

Attribution policy →

Lift evidence

Eval	Tools known to lift	Source paper
GPQA Diamond	Gpqa (Prime Intellect)	-

Evals this tool implements

Same problem set, this tool's harness. Run it to score a model on the test.

GPQA (Full Set)

New York University

448 graduate-level physics/chemistry/biology MCQs written by PhDs - the full set; the harder "Diamond" subset is reported more often.

ActiveScientific ReasoningFactual RecallScience

GPQA: Graduate-Level STEM Knowledge Challenge

New York University

Contains challenging multiple-choice questions created by domain experts in biology, physics, and chemistry, designed to test advanced scientific understanding beyond basic internet searches. Experts at PhD level in the corresponding domains reach 65% accuracy.

ActiveKnowledge