Qwen3.8 27B Extra High

Released2026-08-14
Price per 1M$0.20 in · $2.70 out
Overall score55.8 · rank 189
Context window262,144 tokens
ProviderAlibaba
WeightsOpen weights
ConfigurationExtra High

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 55.8 189 19
Overall: Coding 56.0 180 15
Overall: Reasoning 55.8 181 7
Overall: Agentic work 56.4 181 14
Overall: Frontend 55.5 151 7
Coding 55.9 166 5
Agents 56.2 136 5
Reasoning 58.0 162 4
Math 54.7 124 1
Knowledge 52.6 102 2
Frontend 55.2 87 1
Multimodal 56.0 65 1
Value vs price+6.0114

Evidence

Coding 55.9 ±2.1

BenchmarkResultSourceDate
IOI 39.1% Vals AI 2026-10-29
SWE-bench Verified (Vals run) 86.0% Vals AI 2026-09-01
SciCode 46.6% Epoch AI 2026-11-11
LiveCodeBench (Vals run) 84.0% Vals AI 2026-09-01
ProgramBench 0.0% Vals AI 2026-11-09

Agents 56.2 ±2.4

BenchmarkResultSourceDate
Terminal-Bench-Science 0.0% Vals AI 2026-11-09
Terminal-Bench 2.1 (Vals run) 58.4% Vals AI 2026-10-01
Tax Agent Bench 30.9% Vals AI 2026-11-09
SkillsBench 38.1% Vals AI 2026-10-29
CyberBench v1.1 67.8% Vals AI 2026-11-05

Reasoning 58.0 ±2.1

BenchmarkResultSourceDate
GPQA Diamond (Vals run) 88.9% Vals AI 2026-09-01
ARC-AGI-2 42.4% Epoch AI 2026-11-11
ARC-AGI-2 (ARC Prize verified) 42.4% ARC Prize 2026-11-11
CritPt 5.4% Epoch AI 2026-11-11
ARC-AGI-1 (ARC Prize verified) 87.5% ARC Prize 2026-11-11
ARC-AGI-1 87.5% Epoch AI 2026-11-11

Math 54.7 ±2.7

BenchmarkResultSourceDate
ProofBench v1.1 16.0% Vals AI 2026-11-09

Knowledge 52.6 ±3.9

BenchmarkResultSourceDate
MMLU-Pro (Vals run) 84.3% Vals AI 2026-09-01
Legal Research Bench 36.1% Vals AI 2026-11-09

Frontend 55.2 ±0.8

BenchmarkResultSourceDate
Vibe Code Bench v1.1 64.9% Vals AI 2026-11-09

Multimodal 56.0 ±2.7

BenchmarkResultSourceDate
MMMU-Pro (Vals run) 83.9% Vals AI 2026-09-01

Names matched to this model

qwen3-8-27b-xhigh

Compare Qwen3.8 27B Extra High with other models