Claude 3.5 Sonnet vs Gemini 2.5 Pro
Head to head on 21 shared benchmarks, with price, context window, and release dates.
Benchmark scores
42evals · sort by any column, ⤢ to expand fullscreen
| Model | |||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Gemini 2.5 Pro Google (Alphabet Inc.) | 83.1% | 88.7% | 88.3% | 60.8% | 45.2% | 1422elo | 58.8 | 14.1% | 85.3% | 21.6% | 77.9% | 86.7% | 81.0% | 65.9% | 80.1% | 96.7% | 86.2% | 68.9% | 46.3% | 53.6% | 72.9% | - | 50.4% | - | 15.9% | - | 48.7% | - | 50.6% | 73.6% | 70.0% | - | 41.9% | 55.6 | - | - | 26.5% | - | 0.4% | 53.3% | - | 54.1% | 59.6% |
| Claude 3.5 Sonnet Anthropic | 51.6% | 15.7% | 3.3% | 53.6% | 28.0% | 1451elo | 58.4 | 2.1% | 55.3% | 4.1% | 63.7% | 65.6% | 69.2% | 56.4% | 38.1% | 77.1% | 77.2% | 64.1% | 36.6% | 63.4% | 70.2% | 52.4% | - | 24.2% | - | 96.4 | - | 0.0% | - | - | - | 0.0% | - | - | 51.3% | 25.3% | - | 0.98 | - | - | 62.6% | - | 42.7% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | Gemini 2.5 Pro Google (Alphabet Inc.) |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | Gemini 2.5 Pro is an AI model from Google (Alphabet Inc.). |
| Family | Claude | Gemini |
| Params | - | - |
| Open weights | closed | closed |
| License | proprietary | proprietary |
| Released | 22 Oct 2024 | 5 Jun 2025 |
| Context | 200,000 | 1,048,576 |
| Input $/1M | $3.00 | $1.25 |
| Output $/1M | $15.00 | $10.00 |
| Cache read $/1M | - | $0.125 |
| Cache write $/1M | - | $0.375 |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text, image | text, image, file, audio, video |
| Providers | - | - |
| Publisher | Anthropic | Google (Alphabet Inc.) |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) |
FAQ
- Is Claude 3.5 Sonnet or Gemini 2.5 Pro better?
- Across the 21 benchmarks both models report on Sophon, Gemini 2.5 Pro leads on 19 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and Gemini 2.5 Pro compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and Gemini 2.5 Pro scores 85.3% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or Gemini 2.5 Pro?
- Gemini 2.5 Pro is cheaper at $10.00 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 1.5x.
- When were Claude 3.5 Sonnet and Gemini 2.5 Pro released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. Gemini 2.5 Pro was released 5 Jun 2025 by Google (Alphabet Inc.).
Other head-to-heads
56Claude Sonnet 4.5 vs Gemini 2.5 Pro26 shared evalsGemini 2.5 Pro vs GPT-5 Mini26 shared evalsClaude 4 Sonnet vs Gemini 2.5 Pro25 shared evalsGemini 2.5 Pro vs GPT-524 shared evalsGemini 2.5 Pro vs GPT-5 Nano24 shared evalsGemini 2.5 Pro vs GPT-5.224 shared evalsClaude Opus 4.5 vs Gemini 2.5 Pro24 shared evalsGemini 2.5 Pro vs GPT-5.522 shared evalsGemini 2.5 Pro vs Kimi K2.522 shared evalsGemini 2.5 Pro vs GPT-4o22 shared evalsGemini 2.5 Pro vs Grok 4.1 Fast22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude Opus 4.6 vs Gemini 2.5 Pro21 shared evalsDeepSeek V3.2 vs Gemini 2.5 Pro21 shared evalsGemini 2.5 Pro vs Gemini 3.1 Pro Preview20 shared evalsClaude Opus 4.8 vs Gemini 2.5 Pro20 shared evalsGemini 2.5 Pro vs GPT-5.420 shared evalsClaude Opus 4.7 vs Gemini 2.5 Pro20 shared evalsGemini 2.5 Pro vs GLM 4.720 shared evalsGemini 2.5 Pro vs GPT-4.1 Mini19 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsClaude Fable 5 vs Gemini 2.5 Pro19 shared evalsGemini 2.5 Pro vs GPT-4.119 shared evalsGemini 2.5 Pro vs GPT-4o-mini19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsGemini 2.5 Pro vs GLM 5.119 shared evalsClaude Sonnet 4.6 vs Gemini 2.5 Pro19 shared evalsGemini 2.5 Pro vs gpt-oss-120b19 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsGemini 2.5 Pro vs GPT-4.1 Nano18 shared evalsGemini 2.5 Pro vs Qwen3.6 Plus18 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsGemini 2.5 Pro vs GPT-6 Astra10 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evals
Comparing something else? Build your own side-by-side.