0

Openseeker

Fresh

OpenSeeker web-research QA; the agent answers in chat (bring your own web search), graded by a binary LLM judge.

Type
RL Env
Tags
V1
Runtime
single-turn
License
unknown
Size
v0.1.0
Published
Aug 2026
Updated
Sep 2026

Cite

Notes

Only stored in your browser.

openseeker

OpenSeeker web-research QA: the taskset ships only the questions and scoring (no search tool — the agent brings its own web search) and the agent answers in chat. The last reply is graded against the gold answer by a binary reference LLM judge using OpenSeeker's [CORRECT]/[INCORRECT] prompt with A/B verdict labels.

Taskset

Changelog

  • 2026-08-31: Yield task records on demand so bounded evaluations construct only the requested prefix.
  • 2026-07-31: Moved the OpenSeeker prompt into a packaged, environment-owned reference judge for verifiers>=0.2.2.dev65; saved configs now carry the judge ID instead of a checkout-specific prompt path.
  • 2026-06-25: Initial v1 taskset.