| 240 |
Mistral 7B Instruct v0.3 |
Mistral |
Open |
21.3 |
–No results |
–No results |
20.9 |
21.7 |
–No results |
$0.000 |
| 239 |
Llama 2-70B |
Meta |
Open |
24.9 |
–No results |
–No results |
27.6 |
21.4 |
–No results |
–No price |
| 238 |
DeepSeek LLM 67B |
DeepSeek |
Open |
25.6 |
–No results |
–No results |
26.7 |
24.2 |
–No results |
–No price |
| 237 |
granite-4.0-350m |
Unknown |
|
25.9 |
–No results |
28.4 |
27.3 |
24.0 |
–No results |
–No price |
| 236 |
Llama 3-8B |
Meta |
Open |
26.4 |
–No results |
–No results |
27.4 |
25.1 |
–No results |
–No price |
| 235 |
Gemma 2 9B |
Google |
Open |
28.1 |
–No results |
–No results |
28.1 |
28.0 |
–No results |
–No price |
| 234 |
Gemini 1.0 Pro |
Google |
|
29.1 |
–No results |
–No results |
31.1 |
26.5 |
–No results |
–No price |
| 233 |
Claude 2 |
Anthropic |
|
29.7 |
–No results |
–No results |
31.4 |
27.6 |
–No results |
–No price |
| 232 |
GPT-3.5-turbo |
OpenAI |
|
30.0 |
–No results |
21.6 |
30.1 |
29.9 |
–No results |
$0.75 |
| 231 |
Gemma 3 4B IT |
Google |
Open |
30.7 |
–No results |
28.8 |
27.3 |
35.1 |
–No results |
$0.063 |
| 230 |
Claude Haiku 3 |
Anthropic |
|
30.9 |
–No results |
–No results |
33.1 |
28.1 |
–No results |
$0.50 |
| 229 |
Gemma 2 27B |
Google |
Open |
31.3 |
–No results |
–No results |
32.2 |
30.2 |
–No results |
$0.65 |
| 228 |
Hermes 2 Theta Llama-3 70B |
Nous Research |
Open |
31.5 |
–No results |
–No results |
32.6 |
30.1 |
–No results |
–No price |
| 227 |
Llama-3.1-8B-Instruct |
Meta |
Open |
31.7 |
12.9 |
32.6 |
33.3 |
29.6 |
–No results |
$0.058 |
| 226 |
Mistral Large |
Mistral |
|
31.8 |
–No results |
–No results |
33.1 |
30.1 |
–No results |
$3.00 |
| 225 |
Claude 3 Sonnet |
Anthropic |
|
31.8 |
–No results |
–No results |
33.8 |
29.2 |
–No results |
–No price |
| 224 |
GPT-4 |
OpenAI |
|
32.0 |
–No results |
30.6 |
34.3 |
29.1 |
–No results |
$37.50 |
| 223 |
granite-4.0-micro |
Unknown |
|
32.5 |
–No results |
–No results |
33.6 |
30.9 |
–No results |
–No price |
| 222 |
Gemini 1.5 Flash (May 2024) |
Google |
|
32.6 |
–No results |
–No results |
33.7 |
31.0 |
–No results |
–No price |
| 221 |
Llama 3-70B |
Meta |
Open |
32.9 |
–No results |
–No results |
34.5 |
30.7 |
–No results |
–No price |
| 220 |
Claude Haiku 3.5 |
Anthropic |
|
33.3 |
35.0 |
38.5 |
36.1 |
34.1 |
25.6 |
$1.60 |
| 219 |
Llama-3.2-90B-Vision-Instruct |
Meta |
Open |
33.5 |
–No results |
44.0 |
34.1 |
32.6 |
–No results |
$0.000 |
| 218 |
Command A |
Cohere |
Open |
34.1 |
33.6 |
42.0 |
35.7 |
–No results |
30.6 |
$4.38 |
| 217 |
Llama-3.1-70B-Instruct |
Meta |
Open |
34.1 |
–No results |
44.3 |
35.3 |
32.7 |
–No results |
$0.72 |
| 216 |
Laguna M.1 |
Poolside |
Open |
34.2 |
50.2 |
48.6 |
27.4 |
45.4 |
29.7 |
$0.000 |
| 215 |
Gemini 1.5 Flash (Sep 2024) |
Google |
|
34.5 |
34.3 |
34.4 |
36.1 |
36.9 |
27.0 |
–No price |
| 214 |
Mistral Small 3.1 |
Mistral |
Open |
34.6 |
32.7 |
–No results |
37.8 |
34.6 |
27.4 |
–No price |
| 213 |
Qwen Turbo |
Alibaba |
|
35.0 |
–No results |
–No results |
34.3 |
35.8 |
–No results |
$0.060 |
| 212 |
Tulu 3 (Tülu 3) 70B |
Ai2 |
Open |
35.0 |
–No results |
–No results |
36.1 |
33.7 |
–No results |
–No price |
| 211 |
Gemini 1.5 Pro (May 2024) |
Google |
|
35.1 |
–No results |
–No results |
35.9 |
34.0 |
–No results |
–No price |
| 210 |
Mistral Large 2.1 |
Mistral |
Open |
35.3 |
34.4 |
38.5 |
37.2 |
35.1 |
31.1 |
$3.00 |
| 209 |
GPT-4o mini |
OpenAI |
|
35.3 |
21.5 |
36.9 |
36.8 |
34.7 |
32.9 |
$0.26 |
| 208 |
Mistral Small 3 |
Mistral |
Open |
35.6 |
–No results |
–No results |
36.5 |
34.5 |
–No results |
$0.058 |
| 207 |
Qwen2.5-32B |
Alibaba |
Open |
36.0 |
–No results |
–No results |
36.0 |
36.0 |
–No results |
–No price |
| 206 |
GPT-4 Turbo |
OpenAI |
|
36.1 |
–No results |
30.4 |
37.5 |
34.2 |
–No results |
$15.00 |
| 205 |
Llama-3.3-70B-Instruct |
Meta |
Open |
36.2 |
31.8 |
36.4 |
38.1 |
33.8 |
–No results |
$0.72 |
| 204 |
Mistral Large 2407 |
Mistral |
Open |
36.3 |
–No results |
–No results |
37.4 |
34.8 |
–No results |
$3.00 |
| 203 |
GPT-4o (2024-05-13) |
OpenAI |
|
36.3 |
–No results |
37.8 |
37.2 |
35.2 |
–No results |
$7.50 |
| 202 |
GPT-4.1 nano |
OpenAI |
|
36.6 |
31.4 |
36.1 |
36.8 |
39.5 |
31.0 |
$0.18 |
| 201 |
GPT-4o (2024-11-20) |
OpenAI |
|
36.7 |
34.2 |
–No results |
39.8 |
34.8 |
32.9 |
$4.38 |
| 200 |
Claude 3 Opus |
Anthropic |
|
36.8 |
–No results |
29.2 |
38.0 |
33.1 |
40.5 |
–No price |
| 199 |
Llama 4 Scout |
Meta |
Open |
36.9 |
25.9 |
33.7 |
37.6 |
35.9 |
–No results |
–No price |
| 198 |
Magistral Small 1.2 |
Mistral |
Open |
37.0 |
44.6 |
–No results |
39.4 |
41.4 |
23.7 |
$0.75 |
| 197 |
Qwen2.5-VL 72B Instruct |
Alibaba |
Open |
37.1 |
–No results |
34.2 |
37.1 |
37.1 |
–No results |
$1.01 |
| 196 |
Gemma 3 12B IT |
Google |
Open |
37.4 |
18.7 |
34.9 |
36.4 |
38.7 |
–No results |
$0.075 |
| 195 |
Llama 3.1-405B |
Meta |
Open |
37.6 |
–No results |
–No results |
39.1 |
35.6 |
–No results |
–No price |
| 194 |
Grok-2 (Dec 2024) |
xAI |
|
37.7 |
35.0 |
–No results |
38.2 |
37.0 |
37.5 |
–No price |
| 193 |
Magistral Medium 1.2 |
Mistral |
|
38.0 |
47.4 |
–No results |
41.5 |
–No results |
30.0 |
–No price |
| 192 |
GPT-4o (2024-08-06) |
OpenAI |
|
38.6 |
34.4 |
–No results |
39.3 |
34.3 |
44.4 |
$4.38 |
| 191 |
DeepSeek-V3 |
DeepSeek |
Open |
38.6 |
41.8 |
39.8 |
39.7 |
39.1 |
35.6 |
$0.51 |
| 190 |
Laguna XS.2 |
Poolside |
Open |
38.9 |
50.0 |
46.0 |
39.2 |
45.4 |
26.9 |
$0.000 |
| 189 |
Gemma 3 27B IT |
Google |
Open |
39.0 |
23.4 |
34.4 |
38.1 |
40.1 |
–No results |
$0.16 |
| 188 |
Phi-4 |
Microsoft |
Open |
39.2 |
–No results |
33.1 |
40.2 |
38.0 |
–No results |
–No price |
| 187 |
Qwen Max |
Alibaba |
|
39.2 |
33.9 |
–No results |
39.9 |
38.4 |
–No results |
$2.80 |
| 186 |
DeepSeek-R1-Distill-Qwen-14B |
DeepSeek |
Open |
39.3 |
–No results |
–No results |
35.5 |
44.3 |
–No results |
–No price |
| 185 |
Claude 3.5 Sonnet |
Anthropic |
|
39.4 |
–No results |
35.7 |
41.0 |
37.5 |
–No results |
–No price |
| 184 |
Qwen Plus |
Alibaba |
|
39.8 |
–No results |
–No results |
40.2 |
39.3 |
–No results |
$0.60 |
| 183 |
Magistral Small |
Mistral |
Open |
39.8 |
–No results |
–No results |
38.2 |
41.8 |
–No results |
$0.75 |
| 182 |
Mistral Medium 3 |
Mistral |
|
39.8 |
37.5 |
38.2 |
41.2 |
39.5 |
37.3 |
$0.80 |
| 181 |
Claude Sonnet 3.5 v2 |
Anthropic |
|
39.9 |
43.2 |
39.9 |
42.0 |
39.1 |
36.7 |
$6.00 |
| 180 |
Llama 4 Maverick |
Meta |
Open |
40.0 |
31.9 |
38.0 |
41.4 |
38.5 |
39.3 |
–No price |
| 179 |
Mistral Small 3.2 |
Mistral |
Open |
40.0 |
32.2 |
38.0 |
38.6 |
41.8 |
–No results |
$0.22 |
| 178 |
Gemini 1.5 Pro (Sept 2024) |
Google |
|
40.1 |
36.3 |
39.7 |
41.6 |
39.6 |
37.4 |
–No price |
| 177 |
Gemini 2.0 Flash |
Google |
|
41.7 |
37.0 |
–No results |
42.5 |
41.5 |
39.8 |
$0.18 |
| 176 |
DeepSeek V3 0324 |
DeepSeek |
Open |
41.7 |
44.7 |
41.0 |
41.6 |
41.3 |
42.6 |
$0.50 |
| 175 |
GPT-4.1 mini |
OpenAI |
|
41.8 |
42.1 |
43.6 |
40.7 |
44.1 |
40.2 |
$0.70 |
| 174 |
Gemini 2.0 Pro |
Google |
|
41.8 |
38.4 |
–No results |
41.2 |
42.7 |
–No results |
–No price |
| 173 |
GPT-4.5 |
OpenAI |
|
42.2 |
40.9 |
–No results |
44.0 |
41.8 |
38.9 |
–No price |
| 172 |
Mistral Large 3 |
Mistral |
Open |
42.3 |
43.4 |
–No results |
41.9 |
–No results |
43.0 |
$0.75 |
| 171 |
Qwen3 235B-A22B |
Alibaba |
Open |
42.6 |
45.0 |
–No results |
44.4 |
39.0 |
45.0 |
$0.50 |
| 170 |
Gemini 2.0 Flash Thinking (Jan 2025) |
Google |
|
42.7 |
32.5 |
–No results |
40.8 |
46.4 |
40.6 |
–No price |
| 169 |
DeepSeek-R1-Distill-Llama-70B |
DeepSeek |
Open |
42.9 |
–No results |
–No results |
41.0 |
45.2 |
–No results |
–No price |
| 168 |
o1-mini |
OpenAI |
|
42.9 |
37.6 |
–No results |
42.6 |
43.3 |
–No results |
–No price |
| 167 |
Qwen3 8B |
Alibaba |
Open |
42.9 |
27.6 |
40.3 |
40.3 |
46.2 |
–No results |
$0.098 |
| 166 |
o1-preview |
OpenAI |
|
42.9 |
–No results |
39.0 |
43.5 |
42.0 |
–No results |
–No price |
| 165 |
GPT-4.1 |
OpenAI |
|
43.0 |
42.0 |
45.1 |
42.3 |
43.2 |
44.3 |
$3.50 |
| 164 |
Mercury 2.5 |
Inception |
|
43.0 |
46.8 |
51.8 |
40.8 |
50.3 |
35.4 |
$0.34 |
| 163 |
GPT OSS 20B |
OpenAI |
Open |
43.6 |
48.7 |
31.8 |
45.1 |
47.7 |
33.2 |
$0.13 |
| 162 |
Kimi K2 Instruct |
Moonshot AI |
Open |
43.6 |
46.6 |
46.4 |
44.1 |
–No results |
42.5 |
$0.88 |
| 161 |
Mistral Medium 3.5 |
Mistral |
|
43.7 |
51.7 |
49.5 |
38.4 |
53.3 |
38.9 |
$3.00 |
| 160 |
Grok 3 |
xAI |
|
43.8 |
42.9 |
45.3 |
43.4 |
44.5 |
43.2 |
–No price |
| 159 |
Qwen3-14B |
Alibaba |
Open |
44.7 |
37.9 |
39.7 |
42.3 |
47.9 |
–No results |
–No price |
| 158 |
Qwen3 32B |
Alibaba |
Open |
44.9 |
39.8 |
42.9 |
42.5 |
48.0 |
–No results |
$0.26 |
| 157 |
GLM-4.5 |
Zhipu AI |
Open |
45.6 |
46.6 |
–No results |
46.8 |
–No results |
42.9 |
$1.00 |
| 156 |
GLM-4.6 |
Zhipu AI |
Open |
45.6 |
48.6 |
47.8 |
45.1 |
45.8 |
46.5 |
$1.00 |
| 155 |
Claude Sonnet 3.7 |
Anthropic |
|
45.7 |
46.1 |
47.1 |
47.0 |
45.6 |
42.8 |
$6.00 |
| 154 |
Gemini 3.1 Flash Lite Preview |
Google |
|
45.8 |
52.9 |
47.9 |
45.6 |
–No results |
46.0 |
$0.56 |
| 153 |
Qwen3-30B-A3B-Thinking (Jul 2025) |
Alibaba |
Open |
46.0 |
39.4 |
–No results |
44.0 |
48.6 |
–No results |
–No price |
| 152 |
Grok-3 mini |
xAI |
|
46.1 |
42.1 |
–No results |
45.1 |
47.3 |
–No results |
–No price |
| 151 |
Claude Sonnet 4 |
Anthropic |
|
46.1 |
46.0 |
49.3 |
48.9 |
44.5 |
42.6 |
$6.00 |
| 150 |
Nemotron 3.5 Super VL 120B A12B |
NVIDIA |
Open |
46.2 |
54.9 |
53.7 |
47.3 |
–No results |
43.5 |
$0.000 |
| 149 |
Grok 4.1 Fast |
xAI |
|
46.2 |
36.6 |
48.0 |
47.0 |
50.4 |
37.2 |
$0.28 |
| 148 |
o1-pro |
OpenAI |
|
46.3 |
–No results |
–No results |
47.9 |
–No results |
42.6 |
$262.50 |
| 147 |
GPT-5 Nano |
OpenAI |
|
46.5 |
47.9 |
44.0 |
46.8 |
50.2 |
39.2 |
$0.14 |
| 146 |
DeepSeek-R1 |
DeepSeek |
Open |
46.5 |
45.3 |
43.3 |
45.9 |
46.6 |
48.0 |
$2.36 |
| 145 |
o3-mini |
OpenAI |
|
46.7 |
44.6 |
–No results |
46.6 |
49.4 |
42.0 |
$1.93 |
| 144 |
Qwen3.5 9B |
Alibaba |
Open |
46.7 |
35.7 |
38.1 |
46.5 |
47.0 |
–No results |
$0.14 |
| 143 |
Claude Haiku 4.5 |
Anthropic |
|
46.7 |
47.8 |
49.9 |
47.6 |
48.3 |
41.9 |
$2.00 |
| 142 |
Gemini 2.5 Flash (Apr 2025) |
Google |
|
46.8 |
41.5 |
–No results |
45.2 |
49.2 |
46.3 |
–No price |
| 141 |
Gemini 2.5 Flash |
Google |
|
47.0 |
–No results |
45.6 |
46.7 |
47.5 |
–No results |
$0.85 |