| ARC-AGI-1 |
4.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
1.5% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
16.7% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
4.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
1.5% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
16.7% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 |
0.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
0.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
0.9% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.9% |
ARC Prize |
A stronger configuration result was used |
| BFCL v4 |
27.6% |
BFCL |
A stronger configuration result was used |
| Chess Puzzles |
15.0% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
2.0% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tier 4 (2025 set) |
0.0% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
6.0% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
1.8% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) |
7.2% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
57.6% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
48.5% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
67.4% |
Epoch AI |
A stronger configuration result was used |
| MATH Level 5 |
94.9% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
5.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
8.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
9.0% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
46.7% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
35.6% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
74.2% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
11.5% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
9.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
7.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
7.0% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
11.5% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
9.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
7.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
7.0% |
Epoch AI |
A stronger configuration result was used |
| VPCT |
35.4% |
Epoch AI |
A stronger configuration result was used |