allbenched allbenched Allbenched allbenched allbenched AllBenched allbenched allbenched allbenched

Benchmarks / Reasoning

ARC-AGI-1 (ARC Prize verified)

The original ARC abstract visual puzzles, semi-private set, scored by the ARC Prize Foundation. Near saturation. Shares weight with the Epoch copy of the same board.

CategoryReasoning
MetricSemi-private set score
SourceARC Prize (original)
LicenseInternal use
Benchmark pagearcprize.org
StatusScored
Weight0.6 within Reasoning
FitDiscrimination 2.13, noise 0.45
LineageShares weight with arc_agi_1

Results

#ModelProviderResultDate
1 Gemini 4 Argon High Google 98.5% 2026-11-11
2 Gemini 3.8 Flash High Google 98.5% 2026-11-11
3 Claude Fable 5 Max Anthropic 98.5% 2026-11-11
4 GPT-6 Astra High OpenAI 98.5% 2026-11-11
5 GPT-6 Astra Extra High OpenAI 98.5% 2026-11-11
6 Claude Fable 5 Extra High Anthropic 98.5% 2026-11-11
7 Claude Opus 5.5 High Anthropic 98.5% 2026-11-11
8 Gemini 4 Argon Medium Google 98.5% 2026-11-11
9 GPT-6.1 Sol High OpenAI 98.5% 2026-11-11
10 GPT-6.1 Sol Extra High OpenAI 98.5% 2026-11-11
11 Claude Fable 5.2 Extra High Anthropic 98.5% 2026-11-11
12 Gemini 4 Carbon Medium Google 98.5% 2026-11-11
13 Gemini 3.1 Pro Preview Google 98.0% 2026-11-11
14 Claude Fable 5.2 Max Anthropic 97.5% 2026-11-11
15 Gemini 4 Carbon High Google 97.5% 2026-11-11
16 Claude Opus 5.5 Max Anthropic 97.5% 2026-11-11
17 GPT-6 Astra Max OpenAI 97.5% 2026-11-11
18 Claude Opus 5 Max Anthropic 97.5% 2026-11-11
19 Claude Fable 5.1 Max Anthropic 97.5% 2026-11-11
20 GPT-6 Astra Medium OpenAI 97.5% 2026-11-11
21 Claude Opus 5 High Anthropic 97.5% 2026-11-11
22 GPT-5.6 Sol Extra High OpenAI 97.5% 2026-11-11
23 Gemini 3.8 Flash Medium Google 97.5% 2026-11-11
24 Claude Opus 5.5 Extra High Anthropic 97.5% 2026-11-11
25 Claude Opus 5.5 Medium Anthropic 97.5% 2026-11-11
26 Claude Fable 5.2 High Anthropic 97.5% 2026-11-11
27 Claude Fable 5.2 Medium Anthropic 97.5% 2026-11-11
28 GPT-5.6 Sol High OpenAI 97.0% 2026-11-11
29 GPT-6.1 Sol Max OpenAI 96.5% 2026-11-11
30 Claude Sonnet 5.5 Max Anthropic 96.5% 2026-11-11
31 GPT-5.6 Terra Max OpenAI 96.5% 2026-11-11
32 GPT-5.6 Sol Max OpenAI 96.5% 2026-11-11
33 GPT-5.5 Pro High OpenAI 96.5% 2026-11-11
34 GPT-6 Astra Low OpenAI 96.5% 2026-11-11
35 Claude Fable 5.1 Extra High Anthropic 96.5% 2026-11-11
36 Claude Sonnet 5.5 Extra High Anthropic 96.5% 2026-11-11
37 Inkling 2 Small Extra High Thinking Machines 96.5% 2026-11-11
38 Claude Fable 5.1 High Anthropic 96.0% 2026-11-11
39 GPT-6 Sol Max OpenAI 95.5% 2026-11-11
40 Gemini 3.7 Flash High Google 95.5% 2026-11-11
41 Claude Fable 5 High Anthropic 95.5% 2026-11-11
42 GPT-6.1 Sol Medium OpenAI 95.5% 2026-11-11
43 GPT-5.5 Pro Extra High OpenAI 95.0% 2026-11-11
44 GPT-5.5 Extra High OpenAI 95.0% 2026-11-11
45 DeepSeek V4.1 Flash Max DeepSeek 94.5% 2026-11-11
46 Kimi K3 Max Moonshot AI 94.5% 2026-11-11
47 GPT-5.4 Pro Extra High OpenAI 94.5% 2026-11-11
48 GPT-5.5 High OpenAI 94.5% 2026-11-11
49 Claude Fable 5.1 Medium Anthropic 94.5% 2026-11-11
50 DeepSeek V4.1 Flash 1017 High DeepSeek 94.5% 2026-11-11
51 Claude Fable 5.2 Low Anthropic 94.5% 2026-11-11
52 GPT-5.6 Terra Extra High OpenAI 94.0% 2026-11-11
53 Claude Opus 4.6 High Anthropic 94.0% 2026-11-11
54 GPT-5.4 Extra High OpenAI 93.7% 2026-11-11
55 DeepSeek V4.1 Flash 1017 Max DeepSeek 93.5% 2026-11-11
56 GPT-6.1 Sol Low OpenAI 93.5% 2026-11-11
57 Claude Opus 4.6 Max Anthropic 93.0% 2026-11-11
58 GPT-5.4 High OpenAI 92.7% 2026-11-11
59 GPT-6 Sol Extra High OpenAI 92.7% 2026-11-11
60 Claude Opus 4.8 Max Anthropic 92.5% 2026-11-11
61 Gemini 3.5 Flash High Google 92.5% 2026-11-11
62 GPT-5.6 Sol Medium OpenAI 92.5% 2026-11-11
63 Claude Fable 5 Medium Anthropic 92.5% 2026-11-11
64 GPT-5.5 Medium OpenAI 92.2% 2026-11-11
65 GPT-5.6 Terra High OpenAI 92.0% 2026-11-11
66 Claude Sonnet 5.5 High Anthropic 92.0% 2026-11-11
67 Claude Opus 4.8 High Anthropic 92.0% 2026-11-11
68 Claude Opus 4.6 Medium Anthropic 92.0% 2026-11-11
69 DeepSeek V4.1 Flash 1017 Low DeepSeek 91.5% 2026-11-11
70 Claude Opus 4.8 Medium Anthropic 91.5% 2026-11-11
71 Gemini 3.6 Flash High Google 91.2% 2026-11-11
72 Gemini 3.7 Flash Medium Google 91.2% 2026-11-11
73 GLM-5.3-Flash Max Zhipu AI 91.0% 2026-11-11
74 GPT-6 Sol High OpenAI 91.0% 2026-11-11
75 GPT-5.6 Luna Max OpenAI 90.7% 2026-11-11
76 Claude Fable 5 Low Anthropic 90.5% 2026-11-11
77 GPT-5.2 Pro Extra High OpenAI 90.5% 2026-11-11
78 Gemini 3.8 Flash Low Google 90.5% 2026-11-11
79 DeepSeek V4.1 Flash Low DeepSeek 90.5% 2026-11-11
80 DeepSeek V4 Pro 0813 Low DeepSeek 90.5% 2026-11-11
81 Grok 4.7 High xAI 90.2% 2026-11-11
82 DeepSeek V4 Pro 0813 Max DeepSeek 90.0% 2026-11-11
83 Claude Fable 5.1 Low Anthropic 90.0% 2026-11-11
84 Grok 4.7 Medium xAI 90.0% 2026-11-11
85 Grok 4.20 (Reasoning) xAI 89.5% 2026-11-11
86 Grok 4.7 Extra High xAI 89.5% 2026-11-11
87 Muse Spark Open Extra High Meta 89.0% 2026-11-11
88 Claude Haiku 5.5 Max Anthropic 89.0% 2026-11-11
89 DeepSeek V4 Flash 0731 Max DeepSeek 89.0% 2026-11-11
90 Claude Opus 5.5 Low Anthropic 88.5% 2026-11-11
91 DeepSeek V4.1 Flash High DeepSeek 88.5% 2026-11-11
92 Muse Spark Open High Meta 88.5% 2026-11-11
93 Claude Opus 4.8 Low Anthropic 88.0% 2026-11-11
94 GPT-5.6 Luna Extra High OpenAI 87.7% 2026-11-11
95 Gemini 3 Deep Think Google 87.5% 2026-11-11
96 Claude Haiku 5.5 Extra High Anthropic 87.5% 2026-11-11
97 Grok 4.6 Medium xAI 87.5% 2026-11-11
98 Qwen3.8 27B Extra High Alibaba 87.5% 2026-11-11
99 DeepSeek V4 Pro 0813 High DeepSeek 87.2% 2026-11-11
100 Grok 4.5 Medium xAI 87.2% 2026-11-11
101 Grok 4.6 Extra High xAI 87.0% 2026-11-11
102 Grok 4.6 High xAI 87.0% 2026-11-11
103 DeepSeek V4 Flash 0731 High DeepSeek 87.0% 2026-11-11
104 GPT-6 Luna Max OpenAI 86.7% 2026-11-11
105 Kimi K3 High Moonshot AI 86.7% 2026-11-11
106 Claude Sonnet 4.6 High Anthropic 86.5% 2026-11-11
107 GPT-5.4 Medium OpenAI 86.2% 2026-11-11
108 GPT-5.2 Extra High OpenAI 86.2% 2026-11-11
109 Claude Sonnet 4.6 Max Anthropic 86.0% 2026-11-11
110 GPT-6 Astra Non-reasoning OpenAI 86.0% 2026-11-11
111 Claude Opus 4.6 Low Anthropic 86.0% 2026-11-11
112 Grok 4.5 High xAI 85.7% 2026-11-11
113 GPT-5.2 Pro High OpenAI 85.7% 2026-11-11
114 Gemini 4 Carbon Low Google 85.5% 2026-11-11
115 Gemini 3.7 Flash Low Google 85.2% 2026-11-11
116 Gemini 3 Flash Preview High Google 84.7% 2026-11-11
117 Inkling Small Extra High Thinking Machines 84.0% 2026-11-11
118 DeepSeek V4 Flash 0731 Low DeepSeek 84.0% 2026-11-11
119 GPT-6 Sol Medium OpenAI 83.7% 2026-11-11
120 Gemini 3.6 Flash Medium Google 83.2% 2026-11-11
121 Claude Haiku 5.5 High Anthropic 81.5% 2026-11-11
122 GPT-5.2 Pro Medium OpenAI 81.2% 2026-11-11
123 Claude Opus 4.5 (latest) Thinking Anthropic 80.0% 2026-11-11
124 Inkling Thinking Machines 79.5% 2026-11-11
125 Grok 4.5 Low xAI 79.2% 2026-11-11
126 GPT-5.2 High OpenAI 78.7% 2026-11-11
127 GPT-5.6 Luna High OpenAI 78.0% 2026-11-11
128 Inkling Small High Thinking Machines 78.0% 2026-11-11
129 Muse Spark Open Medium Meta 77.7% 2026-11-11
130 GLM-5.2 Zhipu AI 77.0% 2026-11-11
131 GPT-5.6 Terra Medium OpenAI 77.0% 2026-11-11
132 Gemini 3.6 Flash Low Google 76.5% 2026-11-11
133 Gemini 4 Argon Low Google 76.5% 2026-11-11
134 GPT-5.5 Low OpenAI 76.2% 2026-11-11
135 Gemini 3 Pro Preview Google 75.0% 2026-11-11
136 Grok 4.6 Low xAI 74.8% 2026-11-11
137 GPT-5.6 Sol Low OpenAI 74.5% 2026-11-11
138 Beam 1.0 Extra High Reflection 74.0% 2026-11-11
139 GPT-6 Luna Extra High OpenAI 73.0% 2026-11-11
140 GPT-5.1 High OpenAI 72.8% 2026-11-11
141 GPT-5.2 Medium OpenAI 72.7% 2026-11-11
142 GPT-6 Sol Low OpenAI 72.2% 2026-11-11
143 GLM-5.3-Flash High Zhipu AI 71.8% 2026-11-11
144 GPT-6 Luna High OpenAI 70.3% 2026-11-11
145 GPT-5 Pro OpenAI 70.2% 2026-11-11
146 Claude Sonnet 5.5 Medium Anthropic 70.0% 2026-11-11
147 Qwen3.8 27B Low Alibaba 69.2% 2026-11-11
148 Qwen3.8 27B Medium Alibaba 68.7% 2026-11-11
149 GPT-5.4 Low OpenAI 68.2% 2026-11-11
150 Beam 1.0 High Reflection 67.7% 2026-11-11
151 Claude Sonnet 5.5 Low Anthropic 67.0% 2026-11-11
152 Inkling Small Medium Thinking Machines 67.0% 2026-11-11
153 Grok 4 Thinking xAI 66.7% 2026-11-11
154 Kimi K3 Low Moonshot AI 65.7% 2026-11-11
155 GPT-5 High OpenAI 65.7% 2026-11-11
156 Kimi K2.5 Moonshot AI 65.3% 2026-11-11
157 MiniMax-M2.5 MiniMax 63.7% 2026-11-11
158 GPT-5.4 mini Extra High OpenAI 63.7% 2026-11-11
159 Claude Sonnet 4.5 Thinking Anthropic 63.7% 2026-11-11
160 Grok 4.7 Low xAI 63.3% 2026-11-11
161 GPT-6 Luna Medium OpenAI 61.0% 2026-11-11
162 o3 High OpenAI 60.8% 2026-11-11
163 GPT-5.6 Terra Low OpenAI 60.2% 2026-11-11
164 o3-pro High OpenAI 59.3% 2026-11-11
165 o4-mini High OpenAI 58.7% 2026-11-11
166 Muse Spark Open Low Meta 58.5% 2026-11-11
167 GPT-5.4 mini High OpenAI 58.0% 2026-11-11
168 GPT-5.1 Medium OpenAI 57.7% 2026-11-11
169 Gemini 3 Flash Preview Medium Google 57.7% 2026-11-11
170 Claude Haiku 5.5 Medium Anthropic 57.3% 2026-11-11
171 DeepSeek V3.2 DeepSeek 57.0% 2026-11-11
172 o3-pro Medium OpenAI 57.0% 2026-11-11
173 GPT-5.6 Luna Medium OpenAI 56.5% 2026-11-11
174 GPT-5 Medium OpenAI 56.2% 2026-11-11
175 GPT-5.2 Low OpenAI 55.7% 2026-11-11
176 Beam 1.0 Medium Reflection 55.7% 2026-11-11
177 GPT-5 Mini High OpenAI 54.3% 2026-11-11
178 o3 Medium OpenAI 53.8% 2026-11-11
179 Gemini 3.5 Flash Lite High Google 53.5% 2026-11-11
180 Inkling Small Low Thinking Machines 52.5% 2026-11-11
181 GPT-5.4 nano Extra High OpenAI 51.5% 2026-11-11
182 Claude Haiku 5.5 Low Anthropic 50.3% 2026-11-11
183 Gemini 3.5 Flash Minimal Google 48.8% 2026-11-11
184 X-Ai/Grok-4-Fast-Reasoning xAI 48.5% 2026-11-11
185 Inkling Small Minimal Thinking Machines 48.5% 2026-11-11
186 Claude Haiku 4.5 (latest) Thinking Anthropic 47.7% 2026-11-11
187 GLM-5.3-Flash Low Zhipu AI 47.0% 2026-11-11
188 Beam 1.0 Low Reflection 45.0% 2026-11-11
189 GLM-5 Zhipu AI 44.7% 2026-11-11
190 o3-pro Low OpenAI 44.3% 2026-11-11
191 GPT-5 Low OpenAI 44.0% 2026-11-11
192 o4-mini Medium OpenAI 41.8% 2026-11-11
193 o3 Low OpenAI 41.5% 2026-11-11
194 Gemini 2.5 Pro Thinking Google 41.0% 2026-11-11
195 GPT-5.4 mini Medium OpenAI 40.8% 2026-11-11
196 Claude Sonnet 4 Thinking Anthropic 40.0% 2026-11-11
197 Claude Opus 4.5 (latest) Non-reasoning Anthropic 40.0% 2026-11-11
198 GPT-5.6 Luna Low OpenAI 39.5% 2026-11-11
199 GPT-5.4 nano High OpenAI 38.2% 2026-11-11
200 GPT-6 Luna Low OpenAI 37.7% 2026-11-11
201 GPT-5 Mini Medium OpenAI 37.3% 2026-11-11
202 Claude Opus 4 Thinking Anthropic 35.7% 2026-11-11
203 Gemini 3.6 Flash Minimal Google 34.5% 2026-11-11
204 o3-mini High OpenAI 34.5% 2026-11-11
205 Qwen3.8 27B Non-reasoning Alibaba 34.0% 2026-11-11
206 GPT-5.1 Low OpenAI 33.2% 2026-11-11
207 GPT-5.4 nano Medium OpenAI 33.0% 2026-11-11
208 Gemini 3.5 Flash Lite Medium Google 32.3% 2026-11-11
209 GPT-6 Sol Non-reasoning OpenAI 29.3% 2026-11-11
210 Gemini 3 Flash Preview Low Google 29.0% 2026-11-11
211 GPT-5 Mini Low OpenAI 26.3% 2026-11-11
212 Claude Sonnet 4.5 Anthropic 25.5% 2026-11-11
213 Claude Sonnet 4 Anthropic 23.8% 2026-11-11
214 Nemotron 3.5 Super VL 120B A12B High NVIDIA 22.7% 2026-11-11
215 Claude Opus 4 Anthropic 22.5% 2026-11-11
216 o3-mini Medium OpenAI 22.3% 2026-11-11
217 Gemini 3 Flash Preview Minimal Google 21.5% 2026-11-11
218 o4-mini Low OpenAI 21.3% 2026-11-11
219 DeepSeek-R1 DeepSeek 21.2% 2026-11-11
220 GPT-5 Nano Medium OpenAI 20.7% 2026-11-11
221 Nemotron 3.5 Super VL 120B A12B Medium NVIDIA 20.2% 2026-11-11
222 GPT-5.4 nano Low OpenAI 18.3% 2026-11-11
223 Gemini 3.5 Flash Lite Low Google 17.0% 2026-11-11
224 GPT-5 Nano High OpenAI 16.7% 2026-11-11
225 Grok-3 mini Low xAI 16.5% 2026-11-11
226 o3-mini Low OpenAI 14.5% 2026-11-11
227 Claude Haiku 4.5 (latest) Anthropic 14.3% 2026-11-11
228 o1-mini OpenAI 14.0% 2026-11-11
229 DeepSeek V4 Pro 0813 Non-reasoning DeepSeek 13.0% 2026-11-11
230 GPT-5.4 mini Low OpenAI 13.0% 2026-11-11
231 GPT-5.2 OpenAI 12.3% 2026-11-11
232 DeepSeek V4 Flash 0731 Non-reasoning DeepSeek 11.8% 2026-11-11
233 Qwen3 235B-A22B Alibaba 11.0% 2026-11-11
234 GPT-4.5 OpenAI 10.3% 2026-11-11
235 GPT-6 Luna Non-reasoning OpenAI 8.8% 2026-11-11
236 DeepSeek V4.1 Flash Non-reasoning DeepSeek 7.8% 2026-11-11
237 Gemini 3.5 Flash Lite Minimal Google 7.5% 2026-11-11
238 GPT-5 Minimal OpenAI 6.0% 2026-11-11
239 GPT-5.1 Non-reasoning OpenAI 5.8% 2026-11-11
240 DeepSeek V4.1 Flash 1017 Non-reasoning DeepSeek 5.7% 2026-11-11
241 GPT-4.1 OpenAI 5.5% 2026-11-11
242 Grok 3 xAI 5.5% 2026-11-11
243 Inkling Small Non-reasoning Thinking Machines 5.5% 2026-11-11
244 GPT-5 Mini Minimal OpenAI 5.3% 2026-11-11
245 Magistral Small Mistral 5.0% 2026-11-11
246 GPT-4o OpenAI 4.5% 2026-11-11
247 Llama 4 Maverick Meta 4.4% 2026-11-11
248 GPT-5 Nano Low OpenAI 4.0% 2026-11-11
249 GPT-4.1 mini OpenAI 3.5% 2026-11-11
250 GPT-5.6 Luna Non-reasoning OpenAI 3.3% 2026-11-11
251 Nemotron 3.5 Super VL 120B A12B Non-reasoning NVIDIA 2.0% 2026-11-11
252 GPT-5 Nano Minimal OpenAI 1.5% 2026-11-11
253 Llama 4 Scout Meta 0.5% 2026-11-11
254 GPT-4.1 nano OpenAI 0.0% 2026-11-11