Claude 3.5 Sonnet vs GPT-4.1
Head to head on 18 shared benchmarks, with price, context window, and release dates.
Benchmark scores
50evals · sort by any column, ⤢ to expand fullscreen
| Model | |||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4.1 OpenAI | 52.4% | 43.7% | 34.7% | 61.5% | 63.1% | 12.4% | 1420elo | 5.5% | 66.9% | 5.4% | 45.7% | 91.3% | 80.6% | 65.9% | 38.1% | 31.1% | 39.6% | 75.1% | 0.0% | - | 26.7% | 1.64 | 83.7% | 1.55 | - | 60.9% | - | 43.0% | - | - | - | - | - | 70.8% | 0.49 | 0.49 | 32.1% | 32.1% | 69.4% | 50.5% | - | 8.57 | - | 10.0% | 13.6% | - | 92.0% | 92.0% | - | 47.1% | 48.0% |
| Claude 3.5 Sonnet Anthropic | 51.6% | 15.7% | 3.3% | 24.2% | 53.6% | 28.0% | 1451elo | 2.1% | 55.3% | 4.1% | 38.1% | 77.1% | 77.2% | 64.1% | 36.6% | 25.3% | 63.4% | 70.2% | - | 52.4% | - | - | - | - | 58.4 | - | 96.4 | - | 0.0% | 63.7% | 65.6% | 69.2% | 56.4% | - | - | - | - | - | - | - | 0.0% | - | 51.3% | - | - | 0.98 | - | - | 62.6% | - | 42.7% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | GPT-4.1 OpenAI |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | GPT-4.1 is an AI model from OpenAI. |
| Family | Claude | GPT |
| Params | - | - |
| Open weights | closed | closed |
| License | proprietary | proprietary |
| Released | 22 Oct 2024 | 14 Apr 2025 |
| Context | 200,000 | 1,047,576 |
| Input $/1M | $3.00 | $2.00 |
| Output $/1M | $15.00 | $8.00 |
| Cache read $/1M | - | $0.500 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text, image | image, text, file |
| Providers | - | - |
| Publisher | Anthropic | OpenAI |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) |
FAQ
- Is Claude 3.5 Sonnet or GPT-4.1 better?
- Across the 18 benchmarks both models report on Sophon, GPT-4.1 leads on 15 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and GPT-4.1 compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and GPT-4.1 scores 66.9% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or GPT-4.1?
- GPT-4.1 is cheaper at $8.00 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 1.9x.
- When were Claude 3.5 Sonnet and GPT-4.1 released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. GPT-4.1 was released 14 Apr 2025 by OpenAI.
Other head-to-heads
56GPT-4.1 vs GPT-4.1 Mini28 shared evalsGPT-4.1 vs GPT-528 shared evalsGPT-4.1 vs GPT-5 Mini22 shared evalsGPT-4.1 vs GPT-4.1 Nano22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsGPT-4.1 vs GPT-5 Nano20 shared evalsClaude Sonnet 4.5 vs GPT-4.119 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsClaude 4 Sonnet vs GPT-4.119 shared evalsGemini 2.5 Pro vs GPT-4.119 shared evalsGPT-4.1 vs GPT-4o19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsClaude Opus 4.5 vs GPT-4.116 shared evalsGPT-4.1 vs GPT-4o-mini16 shared evalsGPT-4.1 vs gpt-oss-120b16 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsGPT-4.1 vs GPT-5.215 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsDeepSeek V3.2 vs GPT-4.115 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGemini 3.1 Pro Preview vs GPT-4.113 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsGPT-4.1 vs GPT-5.413 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsClaude Opus 4.6 vs GPT-4.113 shared evalsGPT-4.1 vs Kimi K2.513 shared evalsGPT-4.1 vs Grok 4.1 Fast13 shared evalsGLM 4.7 vs GPT-4.113 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsGPT-4.1 vs GPT-5.512 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude Sonnet 4.6 vs GPT-4.112 shared evalsClaude Opus 4.8 vs GPT-4.111 shared evalsGLM 5.1 vs GPT-4.111 shared evalsClaude Opus 4.7 vs GPT-4.111 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsClaude Fable 5 vs GPT-4.110 shared evalsGPT-4.1 vs Qwen3.6 Plus10 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evalsGPT-4.1 vs GPT-6 Astra5 shared evals
Comparing something else? Build your own side-by-side.