GPT-4o mini
| Released | 2024-07-18 |
|---|---|
| Price per 1M | $0.15 in · $0.60 out |
| Overall score | 32.1 · rank 227 |
| Context window | 128,000 tokens |
| Provider | OpenAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 32.1 | 227 | 20 |
| Overall: Coding | 26.9 | 231 | 9 |
| Overall: Reasoning | 35.3 | 216 | 11 |
| Overall: Agentic work | 33.0 | 223 | 9 |
| Overall: Frontend | 25.6 | 221 | 6 |
| Coding | 21.5 | 211 | 2 |
| Agents | 36.9 | 168 | 1 |
| Reasoning | 36.8 | 216 | 6 |
| Math | 34.7 | 181 | 3 |
| Knowledge | 32.9 | 155 | 2 |
| General | 35.1 | 174 | 2 |
| Multimodal | 38.1 | 111 | 4 |
| Value vs price | −11.7 | 181 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 32.4 ±1.8 | 17 |
| High | 30.6 ±4.0 | 4 |
Evidence
Coding 21.5 ±1.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Aider Polyglot | 3.6% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 26.4% | Vals AI | 2026-09-01 |
Agents 36.9 ±7.1
Reasoning 36.8 ±3.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ARC-AGI-2 | 0.0% | Epoch AI | 2026-11-11 |
| ARC-AGI-2 (ARC Prize verified) | 0.0% | ARC Prize | 2026-11-11 |
| GPQA Diamond | 37.7% | Epoch AI | 2025-01-27 |
| GPQA Diamond (Vals run) | 44.2% | Vals AI | 2026-09-01 |
| Kagi Reasoning Benchmark | 28.8% | Kagi | 2026-11-11 |
| Chess Puzzles | 3.0% | Epoch AI | 2026-10-13 |
| SimpleBench | 10.7% | SimpleBench | 2026-11-11 |
| SimpleBench | 10.7% | Epoch AI | 2026-11-11 |
| Mystery Game Puzzles | 12.0% | Epoch AI | 2026-08-27 |
Math 34.7 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 | 0.7% | Epoch AI | 2026-08-27 |
| MATH Level 5 | 52.6% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 6.9% | Epoch AI | 2025-07-30 |
Knowledge 32.9 ±2.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 8.3% | Epoch AI | 2026-08-31 |
| MMLU-Pro (Vals run) | 62.7% | Vals AI | 2026-09-01 |
General 35.1 ±2.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| EQ-Bench Creative Writing v3 | 871 | EQ-Bench | 2026-11-11 |
| LMArena Text | 1,318 | LMArena | 2026-11-09 |
Multimodal 38.1 ±5.9
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Vision | 1,097 | LMArena | 2026-11-09 |
| MMMU-Pro (Vals run) | 56.6% | Vals AI | 2026-09-01 |
| VPCT | 34.0% | Epoch AI | 2026-11-11 |
| GeoBench | 64.0% | Epoch AI | 2026-11-11 |
Names matched to this model
gpt-4o-mini, gpt-4o-mini-2024-07-18