| ARC-AGI-1 |
34.2% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
56.5% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
87.7% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 |
76.5% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
3.3% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
39.5% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
56.5% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
87.7% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-1 (ARC Prize verified) |
78.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 |
5.1% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
7.4% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
47.6% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 |
29.3% |
Epoch AI |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
0.8% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
5.1% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
7.4% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
47.6% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-2 (ARC Prize verified) |
33.3% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-3 |
0.2% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-3 |
0.2% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-3 |
0.0% |
ARC Prize |
A stronger configuration result was used |
| ARC-AGI-3 |
0.1% |
ARC Prize |
A stronger configuration result was used |
| Chess Puzzles |
3.0% |
Epoch AI |
A stronger configuration result was used |
| Chess Puzzles |
17.0% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
0.3% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
2.6% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
4.9% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
20.6% |
Epoch AI |
A stronger configuration result was used |
| CritPt |
16.6% |
Epoch AI |
A stronger configuration result was used |
| CursorBench |
16.0% |
Epoch AI |
A stronger configuration result was used |
| CursorBench |
22.2% |
Epoch AI |
A stronger configuration result was used |
| CursorBench |
33.0% |
Epoch AI |
A stronger configuration result was used |
| CursorBench |
29.4% |
Epoch AI |
A stronger configuration result was used |
| DeepSWE |
1.6% |
Epoch AI |
A stronger configuration result was used |
| DeepSWE |
11.3% |
Epoch AI |
A stronger configuration result was used |
| DeepSWE |
56.9% |
Epoch AI |
A stronger configuration result was used |
| DeepSWE |
44.3% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
39.7% |
Epoch AI |
A stronger configuration result was used |
| FrontierMath Tiers 1-3 |
41.4% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
63.6% |
Epoch AI |
A stronger configuration result was used |
| GPQA Diamond |
82.3% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
20.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
17.0% |
Epoch AI |
A stronger configuration result was used |
| Mystery Game Puzzles |
12.0% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
40.0% |
Epoch AI |
A stronger configuration result was used |
| OTIS Mock AIME 2024-2025 |
66.7% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
40.4% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
46.1% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
46.8% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
50.5% |
Epoch AI |
A stronger configuration result was used |
| SciCode |
51.6% |
Epoch AI |
A stronger configuration result was used |
| SimpleBench |
46.8% |
Epoch AI |
A stronger configuration result was used |