0

MBPP RL Env (Community)

Fresh

MBPP baseline environment for Verifiers (compile + tests via SandboxFusion).

Type
RL Env
Tags
CodePythonMbpp
License
unknown
Size
v0.1.2
Published
Sep 2025
Canonical
app.primeintellect.ai/dashboard/environments/jashvira/MBPP

Cite

Notes

Only stored in your browser.

Attribution

Attribution policy →

Evals this tool implements

2

Same problem set, this tool's harness. Run it to score a model on the test.

MBPP: Basic Python Coding Challenges

Google (Alphabet Inc.)

Measures the ability of language models to generate short Python programs from simple natural-language descriptions, testing basic coding proficiency.

ActiveCoding

Mostly Basic Python Problems (MBPP)

Google Research

974 short crowd-sourced Python tasks with three unit tests each, used alongside HumanEval as a baseline code-generation benchmark.

SaturatedCode GenerationCode

Contributors

1
jashvira