| ARC-AGI-1 |
5.3% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
37.3% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
26.3% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
5.3% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
37.3% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
26.3% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 |
1.7% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
4.0% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
0.8% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
1.7% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
4.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.8% |
ARC Prize |
A stronger configuration result was used |
| BFCL v4 |
27.8% |
BFCL |
A stronger configuration result was used |
| Chess Puzzles |
0.0% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
16.0% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
0.0% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tier 4 (2025 set) |
4.2% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
6.0% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
18.3% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 (2025 set) |
20.3% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
71.7% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
71.7% |
Epoch AI |
A stronger configuration result was used |
| MATH Level 5 |
96.8% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
5.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
4.0% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
55.6% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
78.3% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
39.0% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
34.8% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
31.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
29.2% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
24.0% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
22.3% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
31.9% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
29.2% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
24.0% |
Epoch AI |
A stronger configuration result was used |
| Terminal-Bench 2.0 |
22.2% |
Epoch AI |
A stronger configuration result was used |
| VPCT |
39.0% |
Epoch AI |
A stronger configuration result was used |