Claude Sonnet 3.5

Closed

Claude Sonnet 3.5 is an AI model from Anthropic.

Publisher: Anthropic
Family: Claude
Context: 200K
Input
Output
License: proprietary

Cite

Notes

Only stored in your browser.

Attribution

Benchmark scores: Aider alpaca-eval arena-hard-auto dabstep-orgfrontiermathLiveBench SWE-bench tau-bench prime-hub Vals AI

Attribution policy →

Context

200K

Reported on 18 evals across 7 domains - best 70.2% on TaxEval v2 · #53 of 88

Reported eval scores

18

τ-bench (tau-bench)62.6

AlpacaEval 2.0 (Length-Controlled)52.4

SWE-bench Lite51.3

Aider Polyglot Benchmark51.6

SWE-bench Verified63.4

LiveBench - Instruction Following69.2

LiveBench - Language56.4

LiveBench - Coding65.6

SWE-bench Multimodal25.3

Traveling Salesman1

MortgageTax64.1

FrontierMath2.1