Claude Haiku 4.5 Thinking
| Released | 2025-10-15 |
|---|---|
| Price per 1M | $1.00 in · $5.00 out |
| Overall score | 46.2 · rank 319 |
| Context window | 200,000 tokens |
| Provider | Anthropic |
| Weights | Proprietary |
| Configuration | Thinking |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 46.2 | 319 | 19 |
| Overall: Coding | 47.0 | 302 | 11 |
| Overall: Reasoning | 47.3 | 301 | 11 |
| Overall: Agentic work | 48.7 | 291 | 10 |
| Overall: Frontend | 42.6 | 322 | 5 |
| Coding | 47.1 | 278 | 3 |
| Agents | 49.3 | 203 | 3 |
| Reasoning | 48.9 | 278 | 4 |
| Math | 48.3 | 203 | 4 |
| Knowledge | 41.8 | 178 | 3 |
| Frontend | 42.4 | 169 | 1 |
| Multimodal | 29.8 | 174 | 1 |
| Value vs price | −6.0 | 321 |
Evidence
Coding 47.1 ±10.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SWE-bench Verified (Vals run) | 66.6% | Vals AI | 2026-09-01 |
| LiveCodeBench (Vals run) | 41.2% | Vals AI | 2026-09-01 |
| ProgramBench | 0.0% | Vals AI | 2026-11-09 |
Agents 49.3 ±4.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Terminal-Bench 2.1 (Vals run) | 43.8% | Vals AI | 2026-10-01 |
| Tax Agent Bench | 5.9% | Vals AI | 2026-11-09 |
| BALROG | 31.2% | Epoch AI | 2026-11-11 |
Reasoning 48.9 ±2.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ARC-AGI-2 | 4.0% | Epoch AI | 2026-11-11 |
| ARC-AGI-1 | 47.7% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 71.2% | Epoch AI | 2025-10-22 |
| GPQA Diamond (Vals run) | 72.2% | Vals AI | 2026-09-01 |
| Chess Puzzles | 8.0% | Epoch AI | 2026-10-13 |
Math 48.3 ±1.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 96.4% | Epoch AI | 2025-10-22 |
| FrontierMath Tiers 1-3 (2025 set) | 5.9% | Epoch AI | 2025-10-22 |
| FrontierMath Tier 4 (2025 set) | 2.1% | Epoch AI | 2025-10-22 |
| OTIS Mock AIME 2024-2025 | 66.7% | Epoch AI | 2025-10-22 |
Knowledge 41.8 ±3.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 12.6% | Epoch AI | 2026-08-27 |
| MMLU-Pro (Vals run) | 78.7% | Vals AI | 2026-09-01 |
| Legal Research Bench | 10.6% | Vals AI | 2026-11-09 |
Frontend 42.4 ±0.8
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Vibe Code Bench v1.1 | 11.4% | Vals AI | 2026-11-09 |
Multimodal 29.8 ±2.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMMU-Pro (Vals run) | 46.1% | Vals AI | 2026-09-01 |
Names matched to this model
claude-haiku-4-5-20251001-thinking