0

Redsearcher

Fresh

REDSearcher long-horizon web-research QA; the agent answers in chat (bring your own web search), graded by an LLM judge.

Type
RL Env
Tags
V1
Runtime
single-turn
License
unknown
Size
v0.1.0
Published
Aug 2026
Updated
Sep 2026

Cite

Notes

Only stored in your browser.

redsearcher

REDSearcher long-horizon web-research QA: the taskset ships only the questions and scoring (no search tool — the agent brings its own web search) and the agent breaks the question into search subgoals, cross-checks sources, then answers in chat. The last reply is graded against the gold answer by a reference LLM judge using the BROWSECOMP [CORRECT]/[INCORRECT] prompt with A/B verdict labels.

Taskset

Changelog

  • 2026-08-31: Yield task records on demand so bounded evaluations construct only the requested prefix.
  • 2026-07-31: Moved the BROWSECOMP prompt into a packaged, environment-owned reference judge for verifiers>=0.2.2.dev65; saved configs now carry the judge ID instead of a checkout-specific prompt path.
  • 2026-06-25: Initial v1 taskset.