browser use

214 realistic, time-consuming web-research tasks ("how long is the train from X to Y on Tuesday?") that require live browsing and multi-page synthesis.

1,266 hard fact-finding questions on the open web requiring persistent browsing and reasoning over scattered, obscure sources.

466 real-world questions requiring tool use, multi-step reasoning, and web browsing - easy for humans (~92%) but hard for AI assistants.

100+ small synthetic web-page tasks (click button, fill form, drag slider) - the original web-agent benchmark, still used as a unit test.

910 visually grounded web tasks across three self-hosted sites (Classifieds, Shopping, Reddit) requiring image understanding to complete.

812 long-horizon web tasks across self-hosted clones of Reddit, GitLab, Shopify, Postmill, and a content-management system.

Browser-based enterprise web tasks on a live ServiceNow instance - list filtering, form filling, knowledge search - covering daily knowledge-worker workflows.

ServiceNow's unified Gym-style framework for web agents - wraps WebArena, MiniWoB, VisualWebArena, WorkArena, AssistantBench, WebLINX, and more under one Playwright-backed interface.

OpenEnv port of ServiceNow's BrowserGym - a Playwright-backed browser environment exposing WebArena, MiniWoB, WorkArena, etc. through the standard OpenEnv API.

AndroidWorld benchmark for evaluating autonomous agents on real Android apps with 116 tasks across 20 apps

AndroidWorld benchmark for evaluating autonomous agents on real Android apps with 116 tasks across 20 apps

BrowserEnv[DOM] Environment on Browsecomp

BrowseComp evaluation environment

Tool-use environment for the model to browse the web and locate hard-to-find information; scored using an LLM-as-judge rubric

Tool-use environment for the model to browse the web and locate hard-to-find information; scored using an LLM-as-judge rubric

BrowserGym environment for MiniWoB dataset

BrowserGym environment for MiniWoB dataset

browsecomp with deepdive tools

BrowseComp with DeepDive tools using RLM

Multi-turn open-web research QA environment where the model uses a Serper search tool to answer hard, hop-heavy questions of the BrowseComp / SimpleQA style.

GAIA web browser benchmark for multi-hop question answering with web navigation