Claude 3.5 Sonnet vs GPT-4.1 Mini
Head to head on 17 shared benchmarks, with price, context window, and release dates.
Benchmark scores
152evals · sort by any column, ⤢ to expand fullscreen
| Model | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GPT-4.1 Mini OpenAI | 32.4% | 43.0% | 46.3% | 28.2% | 57.9% | 9.0% | 1145elo | 4.5% | 65.8% | 5.0% | 48.3% | 92.5% | 78.1% | 65.5% | 40.4% | 23.9% | 71.9% | -0.17 | 60.0% | 100.0% | 0.0% | 3 | - | 98.2% | 0.0% | -1 | 1.07 | 62.3% | 89.9% | 100 | 83.62 | 0.79 | 0.0% | -0.04 | 0.0% | 0.0% | 1.11 | 1.11 | 1.01 | 204.5 | 40.0% | 41.7% | 1.45 | 34.5% | 13.0% | 53.6% | 3.6% | 17.4% | 3.3% | 80.0% | 80.0% | 83.4% | 48.6% | - | 43.3% | 100.0% | 58.2% | 52.9% | 0.0% | 1.5% | 18.7% | 50.0% | 65.0% | 56.8% | - | 0.0% | 100.0% | 3.47 | 3.47 | 1.55 | 100.0% | 63.3% | 0.0% | 0.0% | 67.5% | 40.2% | 38.3% | 83.5% | 6.7% | - | 62.4% | 43.8% | 26.7% | - | - | - | - | 45.4% | 80.0% | 0.35 | 100.0% | 93.3% | 100.0% | 2.61 | 0.0% | 100.0% | 77.9% | 5 | 0.0% | 64.0% | 64.0% | 20.0% | 26.7% | 54.5% | 20.0% | 20.0% | 30.0% | 19.5% | 96.5% | 52.0% | 30.0% | 30.0% | 60.0% | 0.0% | 46.8% | - | 93.0% | 40.6% | 100.0% | 88.2% | 100.0% | 20.0% | 33.3% | 100.0% | 73.3% | 100.0% | 1.14 | 56.72 | 0 | 10.0% | - | - | 100.0% | 100.0% | 7.6% | 0.0% | 100.0% | 37.6% | - | 1.04 | 100.0% | 100.0% | 45.6% | 93.3% | 100.0% | 29.0% | 90.0% | 29.0% | 82.0% | 82.0% | - | 52.9% | 50.8% |
| Claude 3.5 Sonnet Anthropic | 51.6% | 15.7% | 3.3% | 24.2% | 53.6% | 28.0% | 1451elo | 2.1% | 55.3% | 4.1% | 38.1% | 77.1% | 77.2% | 64.1% | 36.6% | 63.4% | 70.2% | - | - | - | - | - | 52.4% | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 58.4 | - | - | - | - | - | - | - | - | - | - | 96.4 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 0.0% | - | - | - | 63.7% | 65.6% | 69.2% | 56.4% | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 0.0% | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 51.3% | 25.3% | - | - | - | - | - | - | 0.98 | - | - | - | - | - | - | - | - | - | - | - | 62.6% | - | 42.7% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | GPT-4.1 Mini OpenAI |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | GPT-4.1 Mini is an AI model from OpenAI. |
| Family | Claude | GPT |
| Params | - | - |
| Open weights | closed | closed |
| License | proprietary | proprietary |
| Released | 22 Oct 2024 | 14 Apr 2025 |
| Context | 200,000 | 1,047,576 |
| Input $/1M | $3.00 | $0.40 |
| Output $/1M | $15.00 | $1.60 |
| Cache read $/1M | - | $0.100 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text, image | image, text, file |
| Providers | - | - |
| Publisher | Anthropic | OpenAI |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) |
FAQ
- Is Claude 3.5 Sonnet or GPT-4.1 Mini better?
- Across the 17 benchmarks both models report on Sophon, GPT-4.1 Mini leads on 13 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and GPT-4.1 Mini compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and GPT-4.1 Mini scores 65.8% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or GPT-4.1 Mini?
- GPT-4.1 Mini is cheaper at $1.60 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 9.4x.
- When were Claude 3.5 Sonnet and GPT-4.1 Mini released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. GPT-4.1 Mini was released 14 Apr 2025 by OpenAI.
Other head-to-heads
56GPT-4.1 Mini vs GPT-541 shared evalsClaude Sonnet 4.5 vs GPT-4.1 Mini35 shared evalsGPT-4.1 Mini vs GPT-5 Mini32 shared evalsGPT-4.1 vs GPT-4.1 Mini28 shared evalsGPT-4.1 Mini vs GPT-4.1 Nano27 shared evalsGPT-4.1 Mini vs GPT-5 Nano26 shared evalsGPT-4.1 Mini vs GPT-4o-mini22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsGPT-4.1 Mini vs GPT-4o20 shared evalsClaude 4 Sonnet vs GPT-4.1 Mini19 shared evalsGemini 2.5 Pro vs GPT-4.1 Mini19 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsGPT-4.1 Mini vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsClaude Opus 4.5 vs GPT-4.1 Mini16 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsDeepSeek V3.2 vs GPT-4.1 Mini15 shared evalsGPT-4.1 Mini vs gpt-oss-120b15 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsGPT-4.1 Mini vs Grok 4.1 Fast14 shared evalsGLM 4.7 vs GPT-4.1 Mini14 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGPT-4.1 Mini vs GPT-5.513 shared evalsClaude Opus 4.6 vs GPT-4.1 Mini13 shared evalsGPT-4.1 Mini vs Kimi K2.513 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsGemini 3.1 Pro Preview vs GPT-4.1 Mini12 shared evalsGPT-4.1 Mini vs GPT-5.412 shared evalsClaude Sonnet 4.6 vs GPT-4.1 Mini12 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude Opus 4.8 vs GPT-4.1 Mini11 shared evalsGLM 5.1 vs GPT-4.1 Mini11 shared evalsClaude Opus 4.7 vs GPT-4.1 Mini11 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsClaude Fable 5 vs GPT-4.1 Mini10 shared evalsGPT-4.1 Mini vs Qwen3.6 Plus10 shared evalsGPT-4.1 Mini vs GPT-6 Astra6 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evals
Comparing something else? Build your own side-by-side.