GPT-5.1
| Released | 2025-11-13 |
|---|---|
| Price per 1M | $1.25 in · $10.00 out |
| Overall score | 53.2 · rank 90 |
| Context window | 400,000 tokens |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 53.2 | 90 | 27 |
| Overall: Coding | 51.6 | 100 | 17 |
| Overall: Reasoning | 54.9 | 76 | 14 |
| Overall: Agentic work | 51.9 | 102 | 15 |
| Overall: Frontend | 49.2 | 95 | 9 |
| Coding | 52.6 | 98 | 4 |
| Agents | 50.9 | 100 | 3 |
| Reasoning | 54.9 | 83 | 8 |
| Math | 55.3 | 67 | 3 |
| Knowledge | 54.2 | 68 | 3 |
| Frontend | 46.5 | 83 | 2 |
| General | 56.3 | 54 | 1 |
| Multimodal | 55.0 | 50 | 3 |
| Value vs price | +1.8 | 108 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 52.0 ±1.4 | 10 |
| High | 54.4 ±1.7 | 18 |
| Low | 48.9 ±4.6 | 7 |
| Medium | 51.2 ±3.1 | 10 |
| Non-reasoning | 41.9 ±4.2 | 9 |
Evidence
Coding 52.6 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GSO | 13.7% | Epoch AI | 2026-11-11 |
| SciCode | 43.3% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 86.5% | Vals AI | 2026-09-01 |
| SWE-bench Verified (Epoch run) | 68.0% | Epoch AI | 2026-02-18 |
| SWE-bench Verified (Vals run) | 69.8% | Vals AI | 2026-09-01 |
Agents 50.9 ±4.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Terminal-Bench 2.0 | 47.6% | Epoch AI | 2025-11-16 |
| DeepResearch Bench | 42.8% | Epoch AI | 2026-11-11 |
| Vending-Bench 2 | $1,473 | Epoch AI | 2026-11-11 |
Reasoning 54.9 ±1.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ARC-AGI-2 | 17.6% | Epoch AI | 2026-11-11 |
| ARC-AGI-2 (ARC Prize verified) | 17.6% | ARC Prize | 2026-11-11 |
| CritPt | 4.9% | Epoch AI | 2026-11-11 |
| ARC-AGI-1 (ARC Prize verified) | 72.8% | ARC Prize | 2026-11-11 |
| ARC-AGI-1 | 72.8% | Epoch AI | 2026-11-11 |
| EnigmaEval | 11.2% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 87.6% | Epoch AI | 2025-11-13 |
| GPQA Diamond (Vals run) | 86.6% | Vals AI | 2026-09-01 |
| Chess Puzzles | 42.0% | Epoch AI | 2026-10-13 |
| SimpleBench | 53.2% | SimpleBench | 2025-11-16 |
| SimpleBench | 53.2% | Epoch AI | 2026-11-11 |
| Mystery Game Puzzles | 19.0% | Epoch AI | 2026-08-27 |
Math 55.3 ±2.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 (2025 set) | 31.0% | Epoch AI | 2025-11-13 |
| FrontierMath Tier 4 (2025 set) | 12.5% | Epoch AI | 2025-11-13 |
| OTIS Mock AIME 2024-2025 | 88.6% | Epoch AI | 2025-11-13 |
Knowledge 54.2 ±2.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 48.0% | Epoch AI | 2026-08-27 |
| Humanity's Last Exam | 23.7% | Epoch AI | 2026-11-11 |
| MMLU-Pro (Vals run) | 86.4% | Vals AI | 2026-09-01 |
Frontend 46.5 ±0.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Vibe Code Bench v1.1 | 24.6% | Vals AI | 2026-11-09 |
| LMArena WebDev | 1,397 | LMArena | 2026-11-09 |
General 56.3 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,455 | LMArena | 2026-11-09 |
Multimodal 55.0 ±2.9
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Vision | 1,251 | LMArena | 2026-11-09 |
| MMMU-Pro (Vals run) | 83.2% | Vals AI | 2026-09-01 |
| VPCT | 58.7% | Epoch AI | 2026-11-11 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| ARC-AGI-1 | 5.8% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-1 | 57.7% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-1 | 33.2% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) | 5.8% | ARC Prize | A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) | 57.7% | ARC Prize | A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) | 33.2% | ARC Prize | A stronger configuration result was used |
| ARC-AGI-2 | 0.4% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-2 | 6.5% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-2 | 1.9% | Epoch AI | A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) | 0.4% | ARC Prize | A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) | 6.5% | ARC Prize | A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) | 1.9% | ARC Prize | A stronger configuration result was used |
| Chess Puzzles | 6.0% | Epoch AI | A stronger configuration result was used |
| Chess Puzzles | 23.0% | Epoch AI | A stronger configuration result was used |
| EnigmaEval | 1.9% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tier 4 (2025 set) | 4.2% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) | 2.1% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) | 26.9% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) | 17.3% | Epoch AI | A stronger configuration result was used |
| GPQA Diamond | 66.7% | Epoch AI | A stronger configuration result was used |
| GPQA Diamond | 85.0% | Epoch AI | A stronger configuration result was used |
| GSO | 13.7% | Epoch AI | A stronger configuration result was used |
| Humanity's Last Exam | 6.8% | Epoch AI | A stronger configuration result was used |
| LMArena Text | 1,439 | LMArena | A stronger configuration result was used |
| LMArena Vision | 1,240 | LMArena | A stronger configuration result was used |
| LMArena WebDev | 1,342 | LMArena | A stronger configuration result was used |
| Mystery Game Puzzles | 15.0% | Epoch AI | A stronger configuration result was used |
| Mystery Game Puzzles | 16.0% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 37.8% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 85.6% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 63.9% | Epoch AI | A stronger configuration result was used |
| Terminal-Bench 2.0 | 47.6% | Epoch AI | A stronger configuration result was used |
| VPCT | 53.3% | Epoch AI | A stronger configuration result was used |
Names matched to this model
gpt-5-1, gpt-5-1-2025-11-13