Claude 3.5 Sonnet vs GPT-4o
Head to head on 22 shared benchmarks, with price, context window, and release dates.
Benchmark scores
41evals · sort by any column, ⤢ to expand fullscreen
| Model | ||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Claude 3.5 Sonnet Anthropic | 51.6% | 15.7% | 3.3% | 53.6% | 28.0% | 2.1% | 55.3% | 96.4 | 4.1% | 63.7% | 65.6% | 69.2% | 56.4% | 38.1% | 77.1% | 77.2% | 64.1% | 36.6% | 63.4% | 70.2% | 0.98 | 62.6% | - | 52.4% | 24.2% | - | - | 1451elo | 58.4 | - | 0.0% | - | - | - | 0.0% | - | 51.3% | 25.3% | - | - | - | 42.7% |
| GPT-4o OpenAI | 18.2% | 15.0% | 11.7% | 45.9% | 6.1% | 0.3% | 47.9% | 96.1 | 2.7% | 55.1% | 46.1% | 70.1% | 49.0% | 30.9% | 75.9% | 74.8% | 57.4% | 33.3% | 21.6% | 74.5% | 0.98 | 32.5% | 38 | - | - | 0.0% | 0.33 | - | - | 34.3% | - | 0.0% | 10.8% | 54.0% | - | 5.71 | - | - | 61.2 | 8.3% | 25.1% | 33.4% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | GPT-4o OpenAI |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | GPT-4o is an AI model from OpenAI. |
| Family | Claude | GPT |
| Params | - | - |
| Open weights | closed | closed |
| License | proprietary | proprietary |
| Released | 22 Oct 2024 | 20 Nov 2024 |
| Context | 200,000 | 128,000 |
| Input $/1M | $3.00 | $2.50 |
| Output $/1M | $15.00 | $10.00 |
| Cache read $/1M | - | $1.250 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text, image | text, image, file |
| Providers | - | - |
| Publisher | Anthropic | OpenAI |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) | Taubench61.2 pass^1 GSM8K96.1 Accuracy ScholarSearch5.71 Social Sciences & Humanities (%) MortgageTax57.4% AIME202438 pass@1 |
FAQ
- Is Claude 3.5 Sonnet or GPT-4o better?
- Across the 22 benchmarks both models report on Sophon, Claude 3.5 Sonnet leads on 18 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and GPT-4o compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and GPT-4o scores 47.9% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or GPT-4o?
- GPT-4o is cheaper at $10.00 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 1.5x.
- When were Claude 3.5 Sonnet and GPT-4o released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. GPT-4o was released 20 Nov 2024 by OpenAI.
Other head-to-heads
56Gemini 2.5 Pro vs GPT-4o22 shared evalsClaude Sonnet 4.5 vs GPT-4o21 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsGPT-4o vs GPT-4o-mini21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsGPT-4.1 Mini vs GPT-4o20 shared evalsGPT-4o vs GPT-5 Mini20 shared evalsClaude 4 Sonnet vs GPT-4o20 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsGPT-4o vs GPT-519 shared evalsGPT-4.1 vs GPT-4o19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsGPT-4o vs GPT-5 Nano18 shared evalsGPT-4o vs GPT-5.218 shared evalsClaude Opus 4.5 vs GPT-4o18 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsDeepSeek V3.2 vs GPT-4o18 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsGPT-4o vs gpt-oss-120b17 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsGPT-4o vs Kimi K2.516 shared evalsGPT-4.1 Nano vs GPT-4o16 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsGPT-4o vs Grok 4.1 Fast16 shared evalsGLM 4.7 vs GPT-4o16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsGPT-4o vs GPT-5.515 shared evalsClaude Opus 4.6 vs GPT-4o15 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsGemini 3.1 Pro Preview vs GPT-4o14 shared evalsClaude Opus 4.8 vs GPT-4o14 shared evalsGPT-4o vs GPT-5.414 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGLM 5.1 vs GPT-4o14 shared evalsClaude Sonnet 4.6 vs GPT-4o14 shared evalsClaude Opus 4.7 vs GPT-4o14 shared evalsGPT-4o vs Qwen3.6 Plus14 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude Fable 5 vs GPT-4o13 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evalsGPT-4o vs GPT-6 Astra4 shared evals
Comparing something else? Build your own side-by-side.