0

Papersearchqa

Fresh

PaperSearchQA biomedical literature-search QA; the agent answers in chat (bring your own web search), graded by a strict LLM judge.

Type
RL Env
Publisher
Prime Intellect
Tags
V1
Runtime
single-turn
License
unknown
Size
v0.1.0
Published
Jul 2026
Updated
Sep 2026
Canonical
app.primeintellect.ai/dashboard/environments/primeintellect/papersearchqa

Cite

Notes

Only stored in your browser.

Attribution

Attribution policy →

papersearchqa

PaperSearchQA biomedical literature-search QA: the taskset ships only the questions and scoring (no search tool — the agent brings its own web search) and the agent researches over the biomedical literature, then answers in chat wrapping its final answer in \boxed{...}. The last reply is graded by a strict reference LLM judge against the task's acceptable answers (primary answer plus golden variations; any match counts).

Taskset

Changelog

  • 2026-08-31: Yield task records on demand so bounded evaluations construct only the requested prefix.
  • 2026-07-31: Moved the custom judge prompt into a packaged, environment-owned reference judge for verifiers>=0.2.2.dev65; saved configs now carry the judge ID instead of a checkout-specific prompt path.
  • 2026-06-24: Initial v1 taskset.