0

MBPP+

Extended MBPP with 35× more test cases (EvalPlus). Harder than vanilla MBPP.

Publisher
EvalPlus Team
Published
Apr 2023

Cite

Notes

Only stored in your browser.

Attribution

Leaderboard scores
EvalPlus
Attribution policy →

Top score 77.0% by Qwen2.5 Coder 32B Instruct - 13 models reporting (1 frontier)

Score history

5
45%59%73%86%100%Apr 24Jun 24Aug 24Oct 24Llama 3 Instruct 70BQwen2.5 Coder 32B Instruct

Top models

13
MBPP+Bar chart with 13 bars. Highest value: Qwen2.5 Coder 32B Instruct at 77.
13 models

FAQ

What is MBPP+?
Extended MBPP with 35× more test cases (EvalPlus). Harder than vanilla MBPP.
What is the current top score on MBPP+?
The top reported score is 77.0% by Qwen2.5 Coder 32B Instruct, across 13 models reporting (1 from frontier labs).