0

BIG-Bench Extra Hard

Active

A reasoning capability dataset that replaces each task in BIG-Bench-Hard with a novel task that probes a similar reasoning capability but exhibits significantly increased difficulty.

Domain
Reasoning
License
mit
Published
Aug 2025
Notable for
Benchmark for evaluating Reasoning.

Cite

Notes

Only stored in your browser.

FAQ

What is BIG-Bench Extra Hard?
A reasoning capability dataset that replaces each task in BIG-Bench-Hard with a novel task that probes a similar reasoning capability but exhibits significantly increased difficulty.
What license is BIG-Bench Extra Hard under?
BIG-Bench Extra Hard is available under mit.