MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning

Active

Evaluating models on multistep soft reasoning tasks in the form of free text narratives.

Publisher: University of Texas at Austin
Domain: Reasoning
License: mit
Published: May 2026
Notable for: Benchmark for evaluating Reasoning.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/musr

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/musr/eval.yamlMIT

Attribution policy →

FAQ

What is MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning?: Evaluating models on multistep soft reasoning tasks in the form of free text narratives.
What license is MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning under?: MuSR: Testing the Limits of Chain-of-thought with Multistep Soft Reasoning is available under mit.