How can a model improve its Tau2 score?

Tools linked to Tau2 on Sophon include TAU 2 Bench RL Env (Community), TAU 2 Synth RL Env (Prime), TAU 2 Bench RL Env (Prime Intellect), TAU 2 Bench RL Env (Community) - RL environments, datasets, and scaffolds that target this eval.

Tau2

Active

Evaluating Conversational Agents in a Dual-Control Environment

Open

Publisher: Sierra
Domain: Assistants
License: mit
Published: Dec 2025
Notable for: Benchmark for evaluating Assistants.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/tau2

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/tau2/eval.yamlMIT

Attribution policy →

Related tools

View all

Implementations, trainers, datasets and scaffolds linked to this eval.

TAU 2 Bench RL Env (Community)

Verifiers implementation of tau2-bench

Trains towardRL EnvTool UseTool Agent UserUser Sim

TAU 2 Synth RL Env (Prime)

Prime

τ²-bench with custom synthetic domains (library, fitness_gym, tech_support, telecom, cloud_incident_response, daily_planner, ev_charging_support)

Trains towardRL EnvTool UseTool Agent UserUser Sim

TAU 2 Bench RL Env (Prime Intellect)

Prime Intellect

τ²-bench evaluation environment

Trains towardRL EnvTool UseTool Agent UserUser Sim

TAU 2 Bench RL Env (Community)

Verifiers implementation of tau2-bench

Trains towardRL EnvTool UseTool Agent UserUser Sim

FAQ

What is Tau2?: Evaluating Conversational Agents in a Dual-Control Environment
How can a model improve its Tau2 score?: Tools linked to Tau2 on Sophon include TAU 2 Bench RL Env (Community), TAU 2 Synth RL Env (Prime), TAU 2 Bench RL Env (Prime Intellect), TAU 2 Bench RL Env (Community) - RL environments, datasets, and scaffolds that target this eval.
What license is Tau2 under?: Tau2 is available under mit.