GLM-5.1

Released2026-04-07
Price per 1M$0.90 in · $3.59 out
Overall score54.7 · rank 77
Context window200,000 tokens
ProviderZhipu AI
WeightsOpen weights

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 54.7 77 27
Overall: Coding 53.6 81 14
Overall: Reasoning 54.9 75 13
Overall: Agentic work 55.8 73 12
Overall: Frontend 50.2 87 6
Coding 53.4 92 4
Agents 56.8 64 3
Reasoning 55.8 80 5
Math 54.7 73 5
Knowledge 53.3 76 3
Frontend 48.5 79 2
General 56.7 49 5
Value vs price+5.670

Configurations

ConfigurationBalancedBenchmarks
Unspecified setting 54.7 ±1.3 27
Non-reasoning 50.7 ±5.8 1

Evidence

Coding 53.4 ±2.5

BenchmarkResultSourceDate
SciCode 44.8% Epoch AI 2026-11-11
LiveCodeBench (Vals run) 81.4% Vals AI 2026-09-01
SWE-bench Verified (Epoch run) 74.2% Epoch AI 2026-05-15
ProgramBench 0.0% Vals AI 2026-11-09
SWE-bench Verified (Vals run) 76.4% Vals AI 2026-09-01

Agents 56.8 ±4.0

BenchmarkResultSourceDate
APEX-Agents 40.9% Epoch AI 2026-11-11
Terminal-Bench 2.1 (Vals run) 56.9% Vals AI 2026-10-01
Vending-Bench 2 $5,634 Epoch AI 2026-11-11

Reasoning 55.8 ±2.3

BenchmarkResultSourceDate
Extended NYT Connections 77.7% Lech Mazur 2026-11-10
CritPt 4.6% Epoch AI 2026-11-11
GPQA Diamond 89.9% Epoch AI 2026-08-10
GPQA Diamond (Vals run) 84.5% Vals AI 2026-09-01
Chess Puzzles 20.0% Epoch AI 2026-10-14
SimpleBench 55.1% SimpleBench 2026-07-09
SimpleBench 55.1% Epoch AI 2026-11-11

Math 54.7 ±1.4

BenchmarkResultSourceDate
FrontierMath Tiers 1-3 36.8% Epoch AI 2026-08-29
ProofBench 22.2% Epoch AI 2026-11-11
FrontierMath Tier 4 (2025 set) 12.5% Epoch AI 2026-05-12
OTIS Mock AIME 2024-2025 93.3% Epoch AI 2026-08-10
MathArena Final-Answer Competitions 67.1% MathArena 2026-11-11
FrontierMath Tiers 1-3 (2025 set) 33.5% Epoch AI 2026-05-11

Knowledge 53.3 ±3.6

BenchmarkResultSourceDate
SimpleQA Verified 34.0% Epoch AI 2026-08-27
MMLU-Pro (Vals run) 86.9% Vals AI 2026-09-01
Legal Research Bench 27.9% Vals AI 2026-11-09

Frontend 48.5 ±0.7

BenchmarkResultSourceDate
Vibe Code Bench v1.1 31.5% Vals AI 2026-11-09
LMArena WebDev 1,508 LMArena 2026-11-09

General 56.7 ±1.8

BenchmarkResultSourceDate
LLM Debate Benchmark 1,511 Lech Mazur 2026-10-26
EQ-Bench Creative Writing v3 1,594 EQ-Bench 2026-11-11
LMArena Text 1,465 LMArena 2026-11-09
Creative Story-Writing (Lech Mazur) 34.0% Lech Mazur 2026-10-23
EQ-Bench Longform Creative Writing 73.5% EQ-Bench 2026-11-11

Results not used in the score

BenchmarkResultSourceWhy not used
FrontierMath Tiers 1-3 24.9% Epoch AI A stronger configuration result was used

Names matched to this model

glm-5-1

Compare GLM-5.1 with other models