Grok 3
| Released | 2025-04-09 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 43.8 · rank 167 |
| Provider | xAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 43.8 | 167 | 14 |
| Overall: Coding | 43.5 | 168 | 8 |
| Overall: Reasoning | 43.8 | 167 | 10 |
| Overall: Agentic work | 44.4 | 164 | 8 |
| Overall: Frontend | 42.9 | 160 | 2 |
| Coding | 42.9 | 168 | 2 |
| Agents | 45.3 | 134 | 1 |
| Reasoning | 43.4 | 167 | 5 |
| Math | 44.5 | 149 | 4 |
| Knowledge | 43.2 | 123 | 1 |
| General | 43.1 | 148 | 1 |
Evidence
Coding 42.9 ±1.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Aider Polyglot | 53.3% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 52.9% | Vals AI | 2026-09-01 |
Agents 45.3 ±7.1
Reasoning 43.4 ±2.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ARC-AGI-2 | 0.0% | Epoch AI | 2026-11-11 |
| ARC-AGI-2 (ARC Prize verified) | 0.0% | ARC Prize | 2026-11-11 |
| ARC-AGI-1 (ARC Prize verified) | 5.5% | ARC Prize | 2026-11-11 |
| ARC-AGI-1 | 5.5% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 75.8% | Epoch AI | 2025-05-26 |
| GPQA Diamond (Vals run) | 74.2% | Vals AI | 2026-09-01 |
| Kagi Reasoning Benchmark | 61.3% | Kagi | 2026-11-11 |
| SimpleBench | 36.1% | SimpleBench | 2026-11-11 |
| SimpleBench | 36.1% | Epoch AI | 2026-11-11 |
Math 44.5 ±1.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 88.8% | Epoch AI | 2025-04-10 |
| FrontierMath Tiers 1-3 (2025 set) | 3.8% | Epoch AI | 2025-04-10 |
| FrontierMath Tier 4 (2025 set) | 0.0% | Epoch AI | 2025-07-01 |
| OTIS Mock AIME 2024-2025 | 55.6% | Epoch AI | 2025-04-10 |
Knowledge 43.2 ±4.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMLU-Pro (Vals run) | 79.9% | Vals AI | 2026-09-01 |
General 43.1 ±3.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| EQ-Bench Creative Writing v3 | 1,186 | EQ-Bench | 2026-11-11 |
Names matched to this model
grok-3, grok-3-beta