| ARC-AGI-1 |
6.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
56.2% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
44.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
6.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
56.2% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
44.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 |
0.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
7.5% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
1.9% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
7.5% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
1.9% |
ARC Prize |
A stronger configuration result was used |
| Aider Polyglot |
86.7% |
Epoch AI |
A stronger configuration result was used |
| Aider Polyglot |
81.3% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
11.0% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
32.0% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
27.0% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
0.0% |
Epoch AI |
A stronger configuration result was used |
| DeepResearch Bench |
48.9% |
Epoch AI |
A stronger configuration result was used |
| DeepResearch Bench |
48.1% |
Epoch AI |
A stronger configuration result was used |
| DeepResearch Bench |
48.6% |
Epoch AI |
A stronger configuration result was used |
| EQ-Bench Longform Creative Writing |
72.8% |
EQ-Bench |
A stronger configuration result was used |
| FrontierMath Tier 4 (2025 set) |
6.3% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
18.3% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
37.2% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) |
27.2% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
71.7% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
85.4% |
Epoch AI |
A stronger configuration result was used |
| Humanity's Last Exam |
25.3% |
Epoch AI |
A stronger configuration result was used |
| LMArena Text |
1,427 |
LMArena |
A stronger configuration result was used |
| LMArena Vision |
1,211 |
LMArena |
A stronger configuration result was used |
| MATH Level 5 |
97.9% |
Epoch AI |
A stronger configuration result was used |
| METR task suite |
69.4% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
14.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
15.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
16.0% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
46.7% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
87.2% |
Epoch AI |
A stronger configuration result was used |
| SWE-bench Verified (Epoch run) |
71.5% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
43.8% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
35.2% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
33.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
49.6% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
43.8% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
35.2% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
33.9% |
Epoch AI |
A stronger configuration result was used |
| VPCT |
63.2% |
Epoch AI |
A stronger configuration result was used |