0

Claude 3.5 Sonnet vs Grok 4.1 Fast

Head to head on 15 shared benchmarks, with price, context window, and release dates.

Benchmark scores

47

evals · sort by any column, ⤢ to expand fullscreen

Model
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
↗
Grok 4.1 Fast

xAI

89.2%66.0%1328elo40.185.3%19.3%64.7%69.6%28.2%74.3%82.2%85.4%42.6%44.2%73.1%62.0%-------11.835.0%52.7%80.2%-52.2%83.7%80.2%-60.8%28.1%100.0%78.7%4.0%-74.5%---24.2%-1.2%-93.3%59.8%
Claude 3.5 Sonnet

Anthropic

3.3%53.6%1451elo58.455.3%4.1%63.7%65.6%69.2%56.4%38.1%77.2%64.1%36.6%70.2%-51.6%15.7%52.4%24.2%28.0%2.1%96.4----0.0%---77.1%-----0.0%-51.3%25.3%63.4%-0.98-62.6%-42.7%
2 / 2 models
AttributeClaude 3.5 Sonnet

Anthropic

Grok 4.1 Fast

xAI

DescriptionClaude Sonnet 3.5 is an AI model from Anthropic.Grok 4.1 Fast is an AI model from xAI.
FamilyClaudeGrok
Params--
Open weightsclosedclosed
Licenseproprietaryproprietary
Released22 Oct 202419 Nov 2025
Context200,000-
Input $/1M$3.00-
Output $/1M$15.00-
Cache read $/1M--
Cache write $/1M--
Speed0 tok/s0 tok/s
Latency0.00 s0.00 s
Modalitiestext, imagetext
Providers--
PublisherAnthropicxAI
Reported scores
Traveling Salesman0.98 (3 samples)
SWE-bench Verified63.4% (SWE-bench)
SWE-bench Lite51.3% (SWE-bench)
SWE-bench Multimodal25.3% (SWE-bench)
Infraresolutionbench80.2% (150 samples)
Agent Diff Bench62.0% (179 samples)
Medpt100.0% (15 samples)
Hanabi11.8 (15 samples)
SciCode44.2% (AA)

FAQ

Is Claude 3.5 Sonnet or Grok 4.1 Fast better?
Across the 15 benchmarks both models report on Sophon, Grok 4.1 Fast leads on 11 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
How do Claude 3.5 Sonnet and Grok 4.1 Fast compare on GPQA Diamond?
Claude 3.5 Sonnet scores 55.3% and Grok 4.1 Fast scores 85.3% on GPQA Diamond.
When were Claude 3.5 Sonnet and Grok 4.1 Fast released?
Claude 3.5 Sonnet was released 22 Oct 2024 by Anthropic. Grok 4.1 Fast was released 19 Nov 2025 by xAI.

Other head-to-heads

56
GPT-5.2 vs Grok 4.1 Fast30 shared evalsClaude Opus 4.5 vs Grok 4.1 Fast29 shared evalsClaude Sonnet 4.5 vs Grok 4.1 Fast28 shared evalsGPT-5 Mini vs Grok 4.1 Fast26 shared evalsDeepSeek V3.2 vs Grok 4.1 Fast26 shared evalsGPT-5.5 vs Grok 4.1 Fast25 shared evalsGemini 3.1 Pro Preview vs Grok 4.1 Fast25 shared evalsGPT-5.4 vs Grok 4.1 Fast25 shared evalsClaude Opus 4.6 vs Grok 4.1 Fast25 shared evalsGrok 4.1 Fast vs Kimi K2.525 shared evalsGPT-5 Nano vs Grok 4.1 Fast24 shared evalsClaude Opus 4.8 vs Grok 4.1 Fast24 shared evalsClaude 4 Sonnet vs Grok 4.1 Fast24 shared evalsClaude Opus 4.7 vs Grok 4.1 Fast24 shared evalsGLM 4.7 vs Grok 4.1 Fast24 shared evalsClaude Fable 5 vs Grok 4.1 Fast23 shared evalsGLM 5.1 vs Grok 4.1 Fast23 shared evalsClaude Sonnet 4.6 vs Grok 4.1 Fast22 shared evalsGemini 2.5 Pro vs Grok 4.1 Fast22 shared evalsClaude 3.5 Sonnet vs GPT-4o22 shared evalsClaude 3.5 Sonnet vs Claude 4 Sonnet21 shared evalsClaude 3.5 Sonnet vs Gemini 2.5 Pro21 shared evalsGrok 4.1 Fast vs Qwen3.6 Plus21 shared evalsGPT-5 vs Grok 4.1 Fast20 shared evalsgpt-oss-120b vs Grok 4.1 Fast20 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.519 shared evalsClaude 3.5 Sonnet vs GPT-5 Mini19 shared evalsClaude 3.5 Sonnet vs GPT-4o-mini19 shared evalsClaude 3.5 Sonnet vs GPT-4.118 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Mini17 shared evalsClaude 3.5 Sonnet vs GPT-517 shared evalsClaude 3.5 Sonnet vs GPT-5 Nano17 shared evalsClaude 3.5 Sonnet vs GPT-5.217 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.517 shared evalsClaude 3.5 Sonnet vs DeepSeek V3.217 shared evalsClaude 3.5 Sonnet vs GPT-4.1 Nano16 shared evalsGPT-4o vs Grok 4.1 Fast16 shared evalsClaude 3.5 Sonnet vs gpt-oss-120b16 shared evalsClaude 3.5 Sonnet vs Kimi K2.515 shared evalsGPT-4o-mini vs Grok 4.1 Fast15 shared evalsClaude 3.5 Sonnet vs GLM 4.715 shared evalsGPT-4.1 Mini vs Grok 4.1 Fast14 shared evalsClaude 3.5 Sonnet vs GPT-5.514 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.614 shared evalsGPT-4.1 Nano vs Grok 4.1 Fast14 shared evalsClaude 3.5 Sonnet vs Gemini 3.1 Pro Preview13 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.813 shared evalsClaude 3.5 Sonnet vs GPT-5.413 shared evalsGPT-4.1 vs Grok 4.1 Fast13 shared evalsClaude 3.5 Sonnet vs GLM 5.113 shared evalsClaude 3.5 Sonnet vs Claude Sonnet 4.613 shared evalsClaude 3.5 Sonnet vs Claude Opus 4.713 shared evalsClaude 3.5 Sonnet vs Claude Fable 512 shared evalsClaude 3.5 Sonnet vs Qwen3.6 Plus11 shared evalsGPT-6 Astra vs Grok 4.1 Fast10 shared evalsClaude 3.5 Sonnet vs GPT-6 Astra6 shared evals

Comparing something else? Build your own side-by-side.