Claude 3.5 Sonnet vs gpt-oss-120b
Head to head on 16 shared benchmarks, with price, context window, and release dates.
Benchmark scores
45evals · sort by any column, ⤢ to expand fullscreen
| Model | ||||||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| gpt-oss-120b OpenAI | 41.8% | 90.0% | 58.2% | 956elo | 35.8 | 75.8% | 19.6% | 51.0% | 60.2% | 50.3% | 48.6% | 87.8% | 80.8% | 34.0% | 26.0% | 71.6% | - | - | - | 38.9% | 7.6% | 11.0% | - | - | - | 57.6 | 69.0% | - | 38.8% | 68.9% | 39.2% | 1.62 | 1.53 | - | 80.0% | - | - | 97.9% | - | - | 23.5% | 65.6% | - | - | 65.8% | 53.9% |
| Claude 3.5 Sonnet Anthropic | 51.6% | 3.3% | 53.6% | 1451elo | 58.4 | 55.3% | 4.1% | 63.7% | 65.6% | 69.2% | 56.4% | 38.1% | 77.2% | 36.6% | 63.4% | 70.2% | 15.7% | 52.4% | 24.2% | - | - | - | 28.0% | 2.1% | 96.4 | - | - | 0.0% | - | - | - | - | - | 77.1% | - | 64.1% | 0.0% | - | 51.3% | 25.3% | - | - | 0.98 | 62.6% | - | 42.7% |
2 / 2 models
| Attribute | Claude 3.5 Sonnet Anthropic | gpt-oss-120b OpenAI |
|---|---|---|
| Description | Claude Sonnet 3.5 is an AI model from Anthropic. | GPT-Oss 120b is an AI model from OpenAI, released with open weights. |
| Family | Claude | GPT |
| Params | - | - |
| Open weights | closed | open |
| License | proprietary | apache-2.0 |
| Released | 22 Oct 2024 | 5 Aug 2025 |
| Context | 200,000 | 131,072 |
| Input $/1M | $3.00 | $0.15 |
| Output $/1M | $15.00 | $0.60 |
| Cache read $/1M | - | $0.075 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 231 tok/s |
| Latency | 0.00 s | 0.48 s |
| Modalities | text, image | text |
| Providers | - | - |
| Publisher | Anthropic | OpenAI |
| Reported scores | MortgageTax64.1% Traveling Salesman0.98 (3 samples) SWE-bench Verified63.4% (SWE-bench) SWE-bench Lite51.3% (SWE-bench) SWE-bench Multimodal25.3% (SWE-bench) | GPQA Diamond75.8% Humanity's Last Exam (HLE)19.6% (AA) LiveCodeBench87.8% (AA) MMLU-Pro80.8% (AA) SciCode34.0% |
FAQ
- Is Claude 3.5 Sonnet or gpt-oss-120b better?
- Across the 16 benchmarks both models report on Sophon, Claude 3.5 Sonnet leads on 9 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do Claude 3.5 Sonnet and gpt-oss-120b compare on GPQA Diamond?
- Claude 3.5 Sonnet scores 55.3% and gpt-oss-120b scores 75.8% on GPQA Diamond.
- Which is cheaper, Claude 3.5 Sonnet or gpt-oss-120b?
- gpt-oss-120b is cheaper at $0.60 per million output tokens against $15.00 for Claude 3.5 Sonnet - about 25.0x.
- When were Claude 3.5 Sonnet and gpt-oss-120b released?
- Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. gpt-oss-120b was released 5 Aug 2025 by OpenAI.
Other head-to-heads
56GPT-5 Mini vs gpt-oss-120b25 shared evalsClaude Sonnet 4.5 vs gpt-oss-120b23 shared evalsDeepSeek V3.2 vs gpt-oss-120b23 shared evalsGPT-5 Nano vs gpt-oss-120b22 shared evalsGPT-5.2 vs gpt-oss-120b22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsClaude Opus 4.5 vs gpt-oss-120b21 shared evalsClaude 4 Sonnet vs gpt-oss-120b21 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsgpt-oss-120b vs Kimi K2.520 shared evalsgpt-oss-120b vs Grok 4.1 Fast20 shared evalsGLM 4.7 vs gpt-oss-120b20 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsGPT-5.5 vs gpt-oss-120b19 shared evalsClaude Opus 4.6 vs gpt-oss-120b19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsGLM 5.1 vs gpt-oss-120b19 shared evalsGemini 2.5 Pro vs gpt-oss-120b19 shared evalsGemini 3.1 Pro Preview vs gpt-oss-120b18 shared evalsClaude Opus 4.8 vs gpt-oss-120b18 shared evalsClaude Fable 5 vs gpt-oss-120b18 shared evalsGPT-5.4 vs gpt-oss-120b18 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsClaude Sonnet 4.6 vs gpt-oss-120b18 shared evalsClaude Opus 4.7 vs gpt-oss-120b18 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsGPT-5 vs gpt-oss-120b17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsGPT-4o vs gpt-oss-120b17 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsGPT-4.1 vs gpt-oss-120b16 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsgpt-oss-120b vs Qwen3.6 Plus16 shared evalsGPT-4.1 Mini vs gpt-oss-120b15 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsGPT-4o-mini vs gpt-oss-120b15 shared evalsClaude 3.5 Sonnet vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGPT-4.1 Nano vs gpt-oss-120b14 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsGPT-6 Astra vs gpt-oss-120b6 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evals
Comparing something else? Build your own side-by-side.