Cite
Notes
Only stored in your browser.
Attribution
Terminal-Bench 2.0 loaded through Harbor and graded by each task's own verifier script, for verifiers evaluation and training.
Clean, reconcile and merge-audit messy order exports with pandas inside a sandbox; graded only on the file the agent writes.
Clean and aggregate a messy hourly sensor CSV inside a sandbox; graded only on the result.json the agent writes.
Single-turn two-hop QA port of the semi-synthetic evaluation from 'Lessons from Studying Two-Hop Latent Reasoning' (arXiv:2411.16353), graded with ...
Procedurally generated coordinate reprojection and geodesy on the WGS84/GDA2020 ellipsoid, verified against PROJ.
Reconcile a synthetic Australian GST ledger to a corrected BAS, finding its bookkeeping faults along the way.