Grok-2 (Dec 2024)
| Released | 2024-12-12 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 36.5 · rank 211 |
| Provider | xAI |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 36.5 | 211 | 8 |
| Overall: Coding | 35.5 | 205 | 3 |
| Overall: Reasoning | 37.7 | 205 | 6 |
| Overall: Agentic work | 36.2 | 211 | 3 |
| Overall: Frontend | 35.3 | 202 | 2 |
| Coding | 35.0 | 190 | 1 |
| Reasoning | 38.2 | 204 | 2 |
| Math | 37.0 | 174 | 3 |
| Knowledge | 37.5 | 147 | 1 |
| Multimodal | 36.3 | 115 | 1 |
Evidence
Coding 35.0 ±5.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LiveCodeBench (Vals run) | 38.7% | Vals AI | 2026-09-01 |
Reasoning 38.2 ±3.8
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleBench | 22.7% | Epoch AI | 2026-11-11 |
| GPQA Diamond | 53.8% | Epoch AI | 2025-01-27 |
| GPQA Diamond (Vals run) | 50.8% | Vals AI | 2026-09-01 |
Math 37.0 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 (2025 set) | 0.7% | Epoch AI | 2025-03-06 |
| MATH Level 5 | 63.5% | Epoch AI | 2025-02-17 |
| OTIS Mock AIME 2024-2025 | 11.5% | Epoch AI | 2025-02-25 |
Knowledge 37.5 ±4.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMLU-Pro (Vals run) | 75.5% | Vals AI | 2026-09-01 |
Multimodal 36.3 ±2.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMMU-Pro (Vals run) | 57.3% | Vals AI | 2026-09-01 |
Names matched to this model
grok-2-1212, grok-2-dec-2024, grok-2-vision-1212