Claude 3.5 Sonnet vs GPT-4.1 Nano
Head to head on 16 shared benchmarks, with price, context window, and release dates.
Benchmark scores
47evals · sort by any column, ⤢ to expand fullscreen
| Model | ||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Claude 3.5 Sonnet Anthropic | 51.6% | 15.7% | 3.3% | 24.2% | 53.6% | 1451elo | 58.4 | 2.1% | 55.3% | 4.1% | 38.1% | 77.1% | 77.2% | 64.1% | 36.6% | 70.2% | 52.4% | - | - | - | - | - | 28.0% | - | 96.4 | - | - | - | 0.0% | 63.7% | 65.6% | 69.2% | 56.4% | - | 0.0% | - | 51.3% | 25.3% | 63.4% | - | - | - | 0.98 | - | - | 62.6% | - | 42.7% |
| GPT-4.1 Nano OpenAI | 8.9% | 23.7% | 24.0% | 10.7% | 42.1% | 939elo | 32.4 | 1.0% | 48.9% | 3.8% | 32.6% | 84.8% | 65.7% | 52.8% | 25.9% | 60.8% | - | 1.53 | -0.17 | 3.3% | 0.0% | 42.5% | - | 0.39 | - | 1.46 | 0.0% | 32.0% | - | - | - | - | - | 10.8% | - | 0.44 | - | - | - | 3.8% | 1.64 | 39.8% | - | 68.0% | 68.0% | - | 17.3% | 30.8% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | GPT-4.1 Nano OpenAI |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | GPT-4.1 Nano is an AI model from OpenAI. |
| Family | Claude | GPT |
| Params | - | - |
| Open weights | closed | closed |
| License | proprietary | proprietary |
| Released | 22 Oct 2024 | 14 Apr 2025 |
| Context | 200,000 | 1,047,576 |
| Input $/1M | $3.00 | $0.10 |
| Output $/1M | $15.00 | $0.40 |
| Cache read $/1M | - | $0.030 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text, image | image, text, file |
| Providers | - | - |
| Publisher | Anthropic | OpenAI |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) |
FAQ
- Is Claude 3.5 Sonnet or GPT-4.1 Nano better?
- Across the 16 benchmarks both models report on Sophon, Claude 3.5 Sonnet leads on 13 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and GPT-4.1 Nano compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and GPT-4.1 Nano scores 48.9% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or GPT-4.1 Nano?
- GPT-4.1 Nano is cheaper at $0.40 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 37.5x.
- When were Claude 3.5 Sonnet and GPT-4.1 Nano released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. GPT-4.1 Nano was released 14 Apr 2025 by OpenAI.
Other head-to-heads
56GPT-4.1 Mini vs GPT-4.1 Nano27 shared evalsGPT-4.1 Nano vs GPT-5 Nano22 shared evalsGPT-4.1 vs GPT-4.1 Nano22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsGPT-4.1 Nano vs GPT-5 Mini21 shared evalsGPT-4.1 Nano vs GPT-521 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsGemini 2.5 Pro vs GPT-4.1 Nano18 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsGPT-4.1 Nano vs GPT-4o-mini17 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsClaude Sonnet 4.5 vs GPT-4.1 Nano16 shared evalsClaude 4 Sonnet vs GPT-4.1 Nano16 shared evalsGPT-4.1 Nano vs GPT-4o16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsGPT-4.1 Nano vs GPT-5.215 shared evalsClaude Opus 4.5 vs GPT-4.1 Nano15 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsDeepSeek V3.2 vs GPT-4.1 Nano15 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGPT-4.1 Nano vs Grok 4.1 Fast14 shared evalsGPT-4.1 Nano vs gpt-oss-120b14 shared evalsGLM 4.7 vs GPT-4.1 Nano14 shared evalsGPT-4.1 Nano vs GPT-5.513 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsGPT-4.1 Nano vs Kimi K2.513 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsGemini 3.1 Pro Preview vs GPT-4.1 Nano12 shared evalsClaude Opus 4.8 vs GPT-4.1 Nano12 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsGPT-4.1 Nano vs GPT-5.412 shared evalsClaude Opus 4.6 vs GPT-4.1 Nano12 shared evalsGLM 5.1 vs GPT-4.1 Nano12 shared evalsClaude Sonnet 4.6 vs GPT-4.1 Nano12 shared evalsClaude Opus 4.7 vs GPT-4.1 Nano12 shared evalsClaude Fable 5 vs GPT-4.1 Nano11 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsGPT-4.1 Nano vs Qwen3.6 Plus10 shared evalsGPT-4.1 Nano vs GPT-6 Astra6 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evals
Comparing something else? Build your own side-by-side.