Claude Sonnet 4 Thinking

Released2025-05-22
Price per 1M$3.00 in · $15.00 out
Overall score48.0 · rank 295
Context window200,000 tokens
ProviderAnthropic
WeightsProprietary
ConfigurationThinking

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 48.0 295 16
Overall: Coding 46.6 309 9
Overall: Reasoning 49.5 269 7
Overall: Agentic work 48.0 295 9
Overall: Frontend 45.7 281 6
Coding 45.2 297 2
Agents 48.7 209 2
Reasoning 50.3 259 5
Math 48.8 195 1
Knowledge 49.1 134 1
General 48.7 176 1
Multimodal 47.2 130 4
Value vs price−7.3333

Evidence

Coding 45.2 ±1.5

BenchmarkResultSourceDate
Aider Polyglot 61.3% Epoch AI 2026-11-11
LiveCodeBench (Vals run) 62.4% Vals AI 2026-09-01

Agents 48.7 ±2.9

BenchmarkResultSourceDate
METR task suite 62.0% Epoch AI 2026-11-11
DeepResearch Bench 46.6% Epoch AI 2026-11-11

Reasoning 50.3 ±2.1

BenchmarkResultSourceDate
ARC-AGI-2 5.9% Epoch AI 2026-11-11
ARC-AGI-2 (ARC Prize verified) 5.9% ARC Prize 2026-11-11
ARC-AGI-1 (ARC Prize verified) 40.0% ARC Prize 2026-11-11
ARC-AGI-1 40.0% Epoch AI 2026-11-11
GPQA Diamond 79.2% Epoch AI 2025-05-26
GPQA Diamond (Vals run) 75.0% Vals AI 2026-09-01
Kagi Reasoning Benchmark 73.0% Kagi 2026-11-11
SimpleBench 45.5% SimpleBench 2026-11-11
SimpleBench 45.5% Epoch AI 2026-11-11

Math 48.8 ±3.6

BenchmarkResultSourceDate
OTIS Mock AIME 2024-2025 71.1% Epoch AI 2025-05-22

Knowledge 49.1 ±4.7

BenchmarkResultSourceDate
MMLU-Pro (Vals run) 83.9% Vals AI 2026-09-01

General 48.7 ±4.1

BenchmarkResultSourceDate
LMArena Text 1,402 LMArena 2026-11-09

Multimodal 47.2 ±4.4

BenchmarkResultSourceDate
LMArena Vision 1,206 LMArena 2026-11-09
MMMU-Pro (Vals run) 74.9% Vals AI 2026-09-01
VPCT 34.0% Epoch AI 2026-11-11
GeoBench 32.0% Epoch AI 2026-11-11

Names matched to this model

claude-sonnet-4-20250514-thinking

Compare Claude Sonnet 4 Thinking with other models