Automationbench RL Env (Zapier)

Fresh

Evaluates AI agents on realistic, multi-step business workflows across 47 simulated SaaS tools.

Type: RL Env
Publisher: Zapier
Tags: Tool Use Business Workflows
Runtime: tool-use
License: unknown
Size: v1.0.5
Published: Apr 2026
Canonical: app.primeintellect.ai/dashboard/environments/zapier/AutomationBench

Cite

Notes

Only stored in your browser.

Attribution

README: api.primeintellect.ai/api/v1/environmentshub/zapier/AutomationBench/@1.0.5/inspect
Scores: prime-hubAnthropic

Attribution policy →

Public scores on this env

15

16 vf-eval reports across 15 models

1Claude Opus 4.6Anthropic56.1%2Claude Sonnet 4.6Anthropic47.6%3MiMo-V2.5-ProXiaomi39.4%4GPT-5.4 MiniOpenAI37.0%5GLM 5.1Zai35.9%6Gemini 3 Flash PreviewGoogle (Alphabet Inc.)32.7%7MiMo-V2.5Xiaomi32.5%8GPT-5.4 NanoOpenAI26.2%9Nemotron 3 Super 120B A12BNVIDIA20.7%10Claude Fable 5Anthropic17.4%11Claude Opus 4.8Anthropic15.5%12GPT-5.4OpenAI13.1%13GPT-5.5OpenAI12.9%14Gemini 3.1 Pro PreviewGoogle (Alphabet Inc.)12.3%15MiniMax M2.7Minimax5.7%

Open the scoring view →