0

APPS: Automated Programming Progress Standard

Active

APPS is a dataset for evaluating model performance on Python programming tasks across three difficulty levels consisting of 1,000 at introductory, 3,000 at interview, and 1,000 at competition level. The dataset consists of an additional 5,000 training samples, for a total of 10,0

Domain
Coding
License
mit
Published
Jan 2025
Notable for
Benchmark for evaluating Coding.

Cite

Notes

Only stored in your browser.

FAQ

What is APPS: Automated Programming Progress Standard?
APPS is a dataset for evaluating model performance on Python programming tasks across three difficulty levels consisting of 1,000 at introductory, 3,000 at interview, and 1,000 at competition level. The dataset consists of an additional 5,000 training samples, for a total of 10,0
What license is APPS: Automated Programming Progress Standard under?
APPS: Automated Programming Progress Standard is available under mit.