What capabilities does WebArena test?

WebArena evaluates browser use, planning, tool calling.

How can a model improve its WebArena score?

Tools linked to WebArena on Sophon include BrowserGym, Openenv Browsergym RL Env (Hugging Face) - RL environments, datasets, and scaffolds that target this eval.

What license is WebArena under?

WebArena is available under Apache-2.0.

WebArena

Active

812 long-horizon web tasks across self-hosted clones of Reddit, GitLab, Shopify, Postmill, and a content-management system.

Open

Publisher: Carnegie Mellon University
Capabilities: Browser Use Planning Tool Calling
Domain: agentic
Format: Web Arena
Size: 812 tasks
License: Apache-2.0
Published: Jul 2023
Updates: Monthly
Notable for: The first widely-adopted realistic web-agent benchmark — fully reproducible self-hosted environment of e-commerce, Reddit, GitLab, and CMS, with WebArena-Verified added in Feb 2026.
Canonical: webarena.dev
Official leaderboard: webarena.dev
Also on: github.com/web-arena-x/webarena

Cite

Notes

Only stored in your browser.

Where it's ranked

Official leaderboard

webarena.dev

Single benchmark

monthly

Related tools

View all

Implementations, trainers, datasets and scaffolds linked to this eval.

BrowserGym

ServiceNow Research

ServiceNow's unified Gym-style framework for web agents - wraps WebArena, MiniWoB, VisualWebArena, WorkArena, AssistantBench, WebLINX, and more under one Playwright-backed interface.

Trains towardRL EnvPlanningTool CallingBrowser Use

Openenv Browsergym RL Env (Hugging Face)

Hugging Face

OpenEnv port of ServiceNow's BrowserGym - a Playwright-backed browser environment exposing WebArena, MiniWoB, WorkArena, etc. through the standard OpenEnv API.

Trains towardRL EnvPlanningTool CallingBrowser Use

Papers

WebArena: A Realistic Web Environment for Building Autonomous Agents

ICLR · 2024

Introduces WebArena, a self-hosted sandbox with five realistic websites (e-commerce, social, dev, content management, maps) and 812 high-level natural-language tasks scored by execution correctness.

introduces

WebArena: A Realistic Web Environment for Building Autonomous Agents

ICLR · 2024

Introduces WebArena, a self-hosted sandbox with five realistic websites (e-commerce, social, dev, content management, maps) and 812 high-level natural-language tasks scored by execution correctness.

Contributors

SShuyan Zhou GGraham Neubig

FAQ

What is WebArena?: 812 long-horizon web tasks across self-hosted clones of Reddit, GitLab, Shopify, Postmill, and a content-management system.
What capabilities does WebArena test?: WebArena evaluates browser use, planning, tool calling.
How can a model improve its WebArena score?: Tools linked to WebArena on Sophon include BrowserGym, Openenv Browsergym RL Env (Hugging Face) - RL environments, datasets, and scaffolds that target this eval.
What license is WebArena under?: WebArena is available under Apache-2.0.