How can a model improve its Tau2 score?

Tools linked to Tau2 on Sophon include Tau2 Bench (Jannik), Tau2 Synth (Prime), Tau2 Bench (Prime Intellect), Tau2 Bench (Will) - RL environments, datasets, and scaffolds that target this eval.

Tau2

Active

Evaluating Conversational Agents in a Dual-Control Environment

Open

Publisher: Sierra
Domain: Assistants
License: mit
Published: Dec 2025
Notable for: Benchmark for evaluating Assistants.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/tau2

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/tau2/README.mdMIT

Attribution policy →

Related tools

View all

Implementations, trainers, datasets and scaffolds linked to this eval.

Tau2 Bench (Jannik)

Verifiers implementation of tau2-bench

Trains towardRL EnvTool UseTool Agent UserUser Sim

Tau2 Synth (Prime)

Prime

τ²-bench with custom synthetic domains (library, fitness_gym, tech_support, telecom, cloud_incident_response, daily_planner, ev_charging_support)

Trains towardRL EnvTool UseTool Agent UserUser Sim

Tau2 Bench (Prime Intellect)

Prime Intellect

τ²-bench evaluation environment

Trains towardRL EnvV1Tool UseTool Agent User

Tau2 Bench (Will)

Verifiers implementation of tau2-bench

Trains towardRL EnvTool UseTool Agent UserUser Sim

FAQ

What is Tau2?: Evaluating Conversational Agents in a Dual-Control Environment
How can a model improve its Tau2 score?: Tools linked to Tau2 on Sophon include Tau2 Bench (Jannik), Tau2 Synth (Prime), Tau2 Bench (Prime Intellect), Tau2 Bench (Will) - RL environments, datasets, and scaffolds that target this eval.
What license is Tau2 under?: Tau2 is available under mit.