o1-preview
| Released | 2024-09-12 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 42.2 · rank 183 |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 42.2 | 183 | 7 |
| Overall: Coding | 40.5 | 186 | 4 |
| Overall: Reasoning | 42.9 | 174 | 5 |
| Overall: Agentic work | 39.9 | 186 | 4 |
| Agents | 39.0 | 160 | 1 |
| Reasoning | 43.5 | 166 | 3 |
| Math | 42.0 | 155 | 2 |
| General | 46.9 | 133 | 1 |
Evidence
Agents 39.0 ±2.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| METR 50% Time Horizon | $20 | METR | 2026-11-11 |
| METR task suite | 45.1% | Epoch AI | 2026-11-11 |
Reasoning 43.5 ±4.8
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 50.3% | Epoch AI | 2025-01-27 |
| ARC-AGI-1 | 18.0% | Epoch AI | 2026-11-11 |
| SimpleBench | 41.7% | SimpleBench | 2026-11-11 |
| SimpleBench | 41.7% | Epoch AI | 2026-11-11 |
Math 42.0 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 81.7% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 31.1% | Epoch AI | 2025-03-07 |
General 46.9 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,389 | LMArena | 2026-11-09 |
Names matched to this model
o1-preview, o1-preview-2024-09-12