GLM-5.1
| Released | 2026-04-07 |
|---|---|
| Price per 1M | $0.90 in · $3.59 out |
| Overall score | 54.7 · rank 77 |
| Context window | 200,000 tokens |
| Provider | Zhipu AI |
| Weights | Open weights |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 54.7 | 77 | 27 |
| Overall: Coding | 53.6 | 81 | 14 |
| Overall: Reasoning | 54.9 | 75 | 13 |
| Overall: Agentic work | 55.8 | 73 | 12 |
| Overall: Frontend | 50.2 | 87 | 6 |
| Coding | 53.4 | 92 | 4 |
| Agents | 56.8 | 64 | 3 |
| Reasoning | 55.8 | 80 | 5 |
| Math | 54.7 | 73 | 5 |
| Knowledge | 53.3 | 76 | 3 |
| Frontend | 48.5 | 79 | 2 |
| General | 56.7 | 49 | 5 |
| Value vs price | +5.6 | 70 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 54.7 ±1.3 | 27 |
| Non-reasoning | 50.7 ±5.8 | 1 |
Evidence
Coding 53.4 ±2.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SciCode | 44.8% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 81.4% | Vals AI | 2026-09-01 |
| SWE-bench Verified (Epoch run) | 74.2% | Epoch AI | 2026-05-15 |
| ProgramBench | 0.0% | Vals AI | 2026-11-09 |
| SWE-bench Verified (Vals run) | 76.4% | Vals AI | 2026-09-01 |
Agents 56.8 ±4.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| APEX-Agents | 40.9% | Epoch AI | 2026-11-11 |
| Terminal-Bench 2.1 (Vals run) | 56.9% | Vals AI | 2026-10-01 |
| Vending-Bench 2 | $5,634 | Epoch AI | 2026-11-11 |
Reasoning 55.8 ±2.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Extended NYT Connections | 77.7% | Lech Mazur | 2026-11-10 |
| CritPt | 4.6% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 89.9% | Epoch AI | 2026-08-10 |
| GPQA Diamond (Vals run) | 84.5% | Vals AI | 2026-09-01 |
| Chess Puzzles | 20.0% | Epoch AI | 2026-10-14 |
| SimpleBench | 55.1% | SimpleBench | 2026-07-09 |
| SimpleBench | 55.1% | Epoch AI | 2026-11-11 |
Math 54.7 ±1.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 | 36.8% | Epoch AI | 2026-08-29 |
| ProofBench | 22.2% | Epoch AI | 2026-11-11 |
| FrontierMath Tier 4 (2025 set) | 12.5% | Epoch AI | 2026-05-12 |
| OTIS Mock AIME 2024-2025 | 93.3% | Epoch AI | 2026-08-10 |
| MathArena Final-Answer Competitions | 67.1% | MathArena | 2026-11-11 |
| FrontierMath Tiers 1-3 (2025 set) | 33.5% | Epoch AI | 2026-05-11 |
Knowledge 53.3 ±3.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 34.0% | Epoch AI | 2026-08-27 |
| MMLU-Pro (Vals run) | 86.9% | Vals AI | 2026-09-01 |
| Legal Research Bench | 27.9% | Vals AI | 2026-11-09 |
Frontend 48.5 ±0.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Vibe Code Bench v1.1 | 31.5% | Vals AI | 2026-11-09 |
| LMArena WebDev | 1,508 | LMArena | 2026-11-09 |
General 56.7 ±1.8
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LLM Debate Benchmark | 1,511 | Lech Mazur | 2026-10-26 |
| EQ-Bench Creative Writing v3 | 1,594 | EQ-Bench | 2026-11-11 |
| LMArena Text | 1,465 | LMArena | 2026-11-09 |
| Creative Story-Writing (Lech Mazur) | 34.0% | Lech Mazur | 2026-10-23 |
| EQ-Bench Longform Creative Writing | 73.5% | EQ-Bench | 2026-11-11 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| FrontierMath Tiers 1-3 | 24.9% | Epoch AI | A stronger configuration result was used |
Names matched to this model
glm-5-1