0

Multi Challenge

MultiChallenge is a novel benchmark developed by Scale AI, designed to evaluate large language models (LLMs) on their ability to handle multi-turn ...

Domain
rl-env
License
unknown
Published
Sep 2025

Cite

Notes

Only stored in your browser.

Attribution

Leaderboard scores
prime-hub
Attribution policy →

Top score 60.0% by GPT-5 - 2 models reporting (2 frontier)

Score history

2
15%36%57%79%100%Apr 25May 25Jun 25Jul 25Aug 25GPT-4.1 MiniGPT-5

Top models

2
Multi ChallengeBar chart with 2 bars. Highest value: GPT-5 at 60.
2 models

Related tools

1
View all

Implementations, trainers, datasets and scaffolds linked to this eval.

FAQ

What is Multi Challenge?
MultiChallenge is a novel benchmark developed by Scale AI, designed to evaluate large language models (LLMs) on their ability to handle multi-turn ...
What is the current top score on Multi Challenge?
The top reported score is 60.0% by GPT-5, across 2 models reporting (2 from frontier labs).
How can a model improve its Multi Challenge score?
Tools linked to Multi Challenge on Sophon include Multi Challenge RL Env (Community) - RL environments, datasets, and scaffolds that target this eval.
What license is Multi Challenge under?
Multi Challenge is available under unknown.