0

Claude 3.5 Haiku

Claude Haiku 3.5 is an AI model from Anthropic.

Publisher
Anthropic
Family
Claude
Context
200K
Input
Output
License
proprietary
Released
22 Oct 2024

Cite

Notes

Only stored in your browser.

Attribution

Attribution policy →
Context
200K
Weights
Closed
API only
Input
$0
/1M tok
Output
$0
/1M tok
Blended
$0
#1/ 499/1M · 3:1
Speed
0
#103/ 498tok/s
Cache read
$0.08
/1M tok
Cache write
$1
/1M tok

Price & speed via Artificial Analysis · ranked across tracked models · caching via OpenRouter

Reported on 21 evals across 9 domains - best 72.1% on MATH-500 · #116 of 190

Reported eval scores

21
LiveBench - Instruction Following65.8
IFBench42.8
LiveBench - Coding50.8
LiveBench - Language39.5
Terminal-Bench (Hard)2.3
MMLU-Pro63.4
LiveBench52
Humanity's Last Exam (HLE)3.6
LiveCodeBench31.4
Aider Polyglot Benchmark28
MATH-50072.1
AIME 2024: Problems from the American Invitational Mathematics Examination3.3
FrontierMath0.3
SciCode27.4
GPQA Diamond40.8
τ²-bench (Tau²-bench)24.6
DABstep5
EQ-Bench Creative Writing v31145.7
CorpFin v250.8
TaxEval v257.4