o1-mini
| Released | 2024-09-12 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 40.1 · rank 192 |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 40.1 | 192 | 9 |
| Overall: Coding | 38.4 | 195 | 5 |
| Overall: Reasoning | 42.9 | 176 | 7 |
| Overall: Agentic work | 39.5 | 192 | 5 |
| Overall: Frontend | 37.6 | 185 | 1 |
| Coding | 37.6 | 183 | 1 |
| Reasoning | 42.6 | 168 | 4 |
| Math | 43.3 | 152 | 3 |
| General | 39.5 | 163 | 1 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 39.2 ±3.5 | 5 |
| High | 42.6 ±5.6 | 4 |
| Medium | 41.2 ±5.5 | 6 |
Evidence
Coding 37.6 ±1.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Aider Polyglot | 32.9% | Epoch AI | 2026-11-11 |
Reasoning 42.6 ±2.2
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 62.4% | Epoch AI | 2025-02-13 |
| ARC-AGI-2 | 0.8% | Epoch AI | 2026-11-11 |
| ARC-AGI-2 (ARC Prize verified) | 0.8% | ARC Prize | 2026-11-11 |
| ARC-AGI-1 (ARC Prize verified) | 14.0% | ARC Prize | 2026-11-11 |
| ARC-AGI-1 | 14.0% | Epoch AI | 2026-11-11 |
| SimpleBench | 18.1% | SimpleBench | 2026-11-11 |
| SimpleBench | 18.1% | Epoch AI | 2026-11-11 |
Math 43.3 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 (2025 set) | 1.7% | Epoch AI | 2025-03-06 |
| MATH Level 5 | 89.2% | Epoch AI | 2025-02-13 |
| OTIS Mock AIME 2024-2025 | 46.9% | Epoch AI | 2025-03-06 |
General 39.5 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,337 | LMArena | 2026-11-09 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| ARC-AGI-1 | 14.0% | Epoch AI | A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) | 1.4% | Epoch AI | A stronger configuration result was used |
| GPQA Diamond | 59.5% | Epoch AI | A stronger configuration result was used |
| MATH Level 5 | 84.3% | Epoch AI | A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 | 44.7% | Epoch AI | A stronger configuration result was used |
Names matched to this model
o1-mini, o1-mini-2024-09-12