Verifiers Math (math-python)

Multi-turn math problem-solving environment where the model proposes Python code in a sandbox to compute and verify numerical answers.

Cite

Notes

Only stored in your browser.

Lift evidence

Eval	Tools known to lift	Source paper
AIME 2024: Problems from the American Invitational Mathematics Examination	Verifiers Math (math-python)	-
GSM8K	Verifiers Math (math-python)	-

Same problem set, this tool's harness. Run it to score a model on the test.

University of California, Berkeley

12,500 high-school competition math problems with full LaTeX-formatted step-by-step solutions, spanning algebra through number theory.

Compatible

any