GPT-4o (2024-08-06)
| Released | 2024-08-06 |
|---|---|
| Price per 1M | $2.50 in · $10.00 out |
| Overall score | 37.7 · rank 204 |
| Context window | 128,000 tokens |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 37.7 | 204 | 12 |
| Overall: Coding | 35.2 | 207 | 4 |
| Overall: Reasoning | 38.6 | 203 | 8 |
| Overall: Agentic work | 36.3 | 210 | 4 |
| Overall: Frontend | 35.6 | 200 | 3 |
| Coding | 34.4 | 191 | 1 |
| Reasoning | 39.3 | 200 | 3 |
| Math | 34.2 | 183 | 3 |
| Knowledge | 44.4 | 118 | 2 |
| General | 39.4 | 165 | 1 |
| Multimodal | 39.3 | 109 | 2 |
| Value vs price | −14.4 | 187 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 38.0 ±2.2 | 10 |
| High | 37.4 ±6.3 | 2 |
Evidence
Coding 34.4 ±1.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Aider Polyglot | 23.1% | Epoch AI | 2026-11-11 |
Reasoning 39.3 ±6.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 49.2% | Epoch AI | 2025-01-27 |
| SimpleBench | 17.8% | Epoch AI | 2026-11-11 |
| Chess Puzzles | 9.0% | Epoch AI | 2026-10-13 |
Math 34.2 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 53.3% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 6.4% | Epoch AI | 2025-02-25 |
| FrontierMath Tiers 1-3 | 0.4% | Epoch AI | 2026-08-27 |
| FrontierMath Tiers 1-3 (2025 set) | 0.3% | Epoch AI | 2025-03-07 |
Knowledge 44.4 ±2.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 26.0% | Epoch AI | 2026-08-31 |
| MMLU-Pro (Vals run) | 74.1% | Vals AI | 2026-09-01 |
General 39.4 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,336 | LMArena | 2026-11-09 |
Multimodal 39.3 ±2.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMMU-Pro (Vals run) | 64.0% | Vals AI | 2026-09-01 |
| LMArena Vision | 1,118 | LMArena | 2026-11-09 |
Names matched to this model
gpt-4o-2024-08-06