0

Bigbench BBH RL Env (Prime Community)

Fresh

Big Bench + BBH implementation

Type
RL Env
Publisher
Prime Community
Tags
NLPBbhBigbench
Runtime
single-turn
License
unknown
Size
v0.1.0
Published
Mar 2026
Canonical
app.primeintellect.ai/dashboard/environments/prime-community/BigBench-BBH

Cite

Notes

Only stored in your browser.

Attribution

Attribution policy →

Lift evidence

1
EvalTools known to liftSource paper
BIG-BenchBigbench BBH RL Env (Prime Community)-

Evals this tool implements

2

Same problem set, this tool's harness. Run it to score a model on the test.

BIG-Bench Hard (BBH)

Google Research

23 challenging multi-step reasoning tasks distilled from BIG-Bench where prior models underperformed average humans.

SaturatedPlanningScientific ReasoningMath

BBH: Challenging BIG-Bench Tasks

Google (Alphabet Inc.)

Tests AI models on a suite of 23 challenging BIG-Bench tasks that previously proved difficult even for advanced language models to solve.

ActiveReasoning