o1
| Released | 2024-12-05 |
|---|---|
| Price per 1M | $15.00 in · $60.00 out |
| Overall score | 46.3 · rank 148 |
| Context window | 200,000 tokens |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 46.3 | 148 | 19 |
| Overall: Coding | 44.8 | 157 | 8 |
| Overall: Reasoning | 48.4 | 129 | 11 |
| Overall: Agentic work | 44.2 | 166 | 8 |
| Overall: Frontend | 45.7 | 130 | 6 |
| Coding | 44.9 | 154 | 2 |
| Agents | 42.8 | 145 | 1 |
| Reasoning | 48.4 | 127 | 5 |
| Math | 48.5 | 127 | 3 |
| Knowledge | 48.1 | 102 | 3 |
| General | 48.8 | 121 | 1 |
| Multimodal | 48.4 | 79 | 4 |
| Value vs price | −11.2 | 179 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 46.1 ±3.1 | 5 |
| High | 47.6 ±2.6 | 11 |
| Low | 46.8 ±5.5 | 5 |
| Medium | 45.4 ±3.6 | 10 |
Evidence
Coding 44.9 ±1.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Aider Polyglot | 61.7% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 50.3% | Vals AI | 2026-09-01 |
Agents 42.8 ±2.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| METR 50% Time Horizon | $39 | METR | 2026-11-11 |
| METR task suite | 51.1% | Epoch AI | 2026-11-11 |
Reasoning 48.4 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ARC-AGI-1 | 30.7% | Epoch AI | 2026-11-11 |
| EnigmaEval | 5.7% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 76.8% | Epoch AI | 2025-02-13 |
| GPQA Diamond (Vals run) | 73.2% | Vals AI | 2026-09-01 |
| Chess Puzzles | 11.0% | Epoch AI | 2026-10-13 |
| SimpleBench | 40.1% | SimpleBench | 2026-11-11 |
| SimpleBench | 40.1% | Epoch AI | 2026-11-11 |
Math 48.5 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 94.7% | Epoch AI | 2025-02-13 |
| OTIS Mock AIME 2024-2025 | 73.3% | Epoch AI | 2026-07-15 |
| FrontierMath Tiers 1-3 | 14.7% | Epoch AI | 2026-08-28 |
| FrontierMath Tiers 1-3 (2025 set) | 9.3% | Epoch AI | 2025-03-07 |
Knowledge 48.1 ±5.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 41.1% | Epoch AI | 2026-08-31 |
| Humanity's Last Exam | 8.0% | Epoch AI | 2026-11-11 |
| MMLU-Pro (Vals run) | 83.5% | Vals AI | 2026-09-01 |
General 48.8 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,402 | LMArena | 2026-11-09 |
Multimodal 48.4 ±2.8
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Vision | 1,193 | LMArena | 2026-11-09 |
| MMMU-Pro (Vals run) | 77.4% | Vals AI | 2026-09-01 |
| VPCT | 37.0% | Epoch AI | 2026-11-11 |
| GeoBench | 80.0% | Epoch AI | 2026-11-11 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| ARC-AGI-1 | 27.2% | Epoch AI | A stronger configuration result was used |
| Chess Puzzles | 10.0% | Epoch AI | A stronger configuration result was used |
| Chess Puzzles | 8.0% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 | 8.4% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 | 10.2% | Epoch AI | A stronger configuration result was used |
| GPQA Diamond | 74.2% | Epoch AI | A stronger configuration result was used |
| GPQA Diamond | 75.8% | Epoch AI | A stronger configuration result was used |
| MATH Level 5 | 94.4% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 53.3% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 73.3% | Epoch AI | A stronger configuration result was used |
| SimpleBench | 36.7% | Epoch AI | A stronger configuration result was used |
| SimpleBench | 36.7% | SimpleBench | A stronger configuration result was used |
Names matched to this model
o1, o1-2024-12-17