BBH RL Env (Community)

Fresh

BigBenchHard (BBH) evaluation environment with Chain-of-Thought

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/pmahdavi/bbh/@0.1.1/inspect

Evals this tool implements

Same problem set, this tool's harness. Run it to score a model on the test.

Google Research

23 challenging multi-step reasoning tasks distilled from BIG-Bench where prior models underperformed average humans.

Google (Alphabet Inc.)

Tests AI models on a suite of 23 challenging BIG-Bench tasks that previously proved difficult even for advanced language models to solve.