DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation

Active

Code generation benchmark with a thousand data science problems spanning seven Python libraries.

Publisher: University of Washington
Domain: Coding
License: mit
Published: Oct 2024
Notable for: Benchmark for evaluating Coding.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/ds1000

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/ds1000/eval.yamlMIT

Attribution policy →

FAQ

What is DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation?: Code generation benchmark with a thousand data science problems spanning seven Python libraries.
What license is DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation under?: DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation is available under mit.