redsearcher
REDSearcher long-horizon web-research QA: the taskset ships only the questions and scoring (no search tool — the agent brings its own web search) and the agent breaks the question into search subgoals, cross-checks sources, then answers in chat. The last reply is graded against the gold answer by a reference LLM judge using the BROWSECOMP [CORRECT]/[INCORRECT] prompt with A/B verdict labels.
Taskset
- Source: Zchu/REDSearcher_RL_1K (
trainsplit) - Size: 1000 tasks
Changelog
- 2026-08-31: Yield task records on demand so bounded evaluations construct only the requested prefix.
- 2026-07-31: Moved the BROWSECOMP prompt into a packaged, environment-owned reference judge for
verifiers>=0.2.2.dev65; saved configs now carry the judge ID instead of a checkout-specific prompt path. - 2026-06-25: Initial v1 taskset.