GLM 5.1 vs GPT-5.4 Mini
Head to head on 24 shared benchmarks, with price, context window, and release dates.
Benchmark scores
41evals · sort by any column, ⤢ to expand fullscreen
| Model | ||||||||||||||||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GLM 5.1 Zai | 35.9% | 64.5% | 1589elo | 73.5 | 44.8% | 33.5% | 83.9% | 27.9% | 52.0% | 72.7% | 75.4% | 63.2% | 68.5% | 71.8% | 84.9% | 72.5% | 22.2% | 36.1% | 71.2% | 35.6% | 69.8 | 52.5% | 31.5% | 97.1% | 20.8% | 1.13 | 40.0% | - | - | 34.7% | 15.1% | - | 67.0% | 41.6% | 72.3% | 85.4% | - | - | 34.6% | 5.24 | - | 53.6% |
| GPT-5.4 Mini OpenAI | 37.0% | 60.9% | 1662elo | 73 | 45.4% | 28.3% | 60.6% | 5.9% | 38.8% | 70.9% | 71.6% | 70.9% | 60.3% | 71.5% | 78.6% | 72.5% | 21.0% | 39.6% | 71.2% | 18.2% | 61.7 | 39.6% | 48.0% | 23.4% | - | - | - | 21.2% | 3.9% | - | - | 80.3% | - | - | - | - | 63.5% | 50.8% | - | - | 54.2% | 48.4% |
2 / 2 models
| Attribute | GLM 5.1 Zai | GPT-5.4 Mini OpenAI |
|---|---|---|
| Description | GLM-5.1 is an AI model from Zai, released with open weights. | GPT-5.4 mini is an AI model from OpenAI. |
| Family | Glm | GPT |
| Params | - | - |
| Open weights | open | closed |
| License | mit | proprietary |
| Released | 7 Apr 2026 | 17 Mar 2026 |
| Context | 204,800 | 400,000 |
| Input $/1M | $1.39 | $0.75 |
| Output $/1M | $4.40 | $4.50 |
| Cache read $/1M | $0.234 | $0.075 |
| Cache write $/1M | - | - |
| Speed | 0 tok/s | 0 tok/s |
| Latency | 0.00 s | 0.00 s |
| Modalities | text | file, image, text |
| Providers | - | - |
| Publisher | Zai | OpenAI |
| Reported scores | IFBench52.0% (AA) τ²-bench (Tau²-bench)97.1% (AA) Terminal-Bench (Hard)35.6% (AA) Vals Index52.5% Vibe Code Bench v1.131.5% |
FAQ
- Is GLM 5.1 or GPT-5.4 Mini better?
- Across the 24 benchmarks both models report on Sophon, GLM 5.1 leads on 17 of them. Which one is "better" depends on the benchmark - the table above shows every shared score.
- How do GLM 5.1 and GPT-5.4 Mini compare on GPQA Diamond?
- GLM 5.1 scores 83.9% and GPT-5.4 Mini scores 60.6% on GPQA Diamond.
- Which is cheaper, GLM 5.1 or GPT-5.4 Mini?
- GLM 5.1 is cheaper at $4.40 per million output tokens against $4.50 for GPT-5.4 Mini - about 1.0x.
- When were GLM 5.1 and GPT-5.4 Mini released?
- GLM 5.1 was released 7 Apr 2026 by Zai. GPT-5.4 Mini was released 17 Mar 2026 by OpenAI.
Comparing something else? Build your own side-by-side.