What license is LiveCodeBench-Pro: Competitive Programming Benchmark under?

LiveCodeBench-Pro: Competitive Programming Benchmark is available under mit.

LiveCodeBench-Pro: Competitive Programming Benchmark

Active

Evaluates LLMs on competitive programming problems using a specialized Docker sandbox (LightCPVerifier) to execute and judge C++ code submissions against hidden test cases with time and memory constraints.

Open

Publisher: University of California, Berkeley
Domain: Coding
License: mit
Published: Mar 2026
Notable for: Benchmark for evaluating Coding.
Canonical: github.com/UKGovernmentBEIS/inspect_evals/tree/main/src/inspect_evals/livecodebench_pro

Cite

Notes

Only stored in your browser.

Attribution

README: github.com/UKGovernmentBEIS/inspect_evals/blob/main/src/inspect_evals/livecodebench_pro/eval.yamlMIT

Attribution policy →

FAQ

What is LiveCodeBench-Pro: Competitive Programming Benchmark?: Evaluates LLMs on competitive programming problems using a specialized Docker sandbox (LightCPVerifier) to execute and judge C++ code submissions against hidden test cases with time and memory constraints.
What license is LiveCodeBench-Pro: Competitive Programming Benchmark under?: LiveCodeBench-Pro: Competitive Programming Benchmark is available under mit.