allbenched allbenched Allbenched allbenched allbenched AllBenched allbenched allbenched allbenched
Filters

Rank by

Provider

Weights

AI Model Leaderboard

Rank Model Provider Weights Overall Coding Agents Reasoning Math Knowledge Cost
1 Claude Fable 5.2 New Anthropic 68.5 67.1 65.3 69.2 70.4 76.7 $16.00
2 Gemini 4 Carbon New Google 67.2 68.2 65.2 70.6 66.6 66.9 $4.00
3 Claude Opus 5.5 Anthropic 65.8 66.5 64.2 66.9 67.1 64.5 $8.00
4 GPT-6 Astra OpenAI 65.4 65.1 64.0 69.5 68.3 63.5 $20.00
5 Claude Fable 5.1 Anthropic 65.3 65.7 63.6 66.1 66.4 64.2 $20.00
6 GPT-6.1 Sol OpenAI 64.9 64.0 63.4 68.6 69.6 64.3 $4.00
7 Gemini 4 Argon Google 64.8 64.4 63.7 68.8 64.9 66.1 $4.00
8 Claude Opus 5 Anthropic 63.9 62.9 62.5 65.9 64.2 63.5 $10.00
9 Claude Fable 5 Anthropic 63.7 62.8 61.8 65.5 65.1 64.2 $20.00
10 GPT-6.1 Terra OpenAI 63.6 66.1 62.2 63.6 66.3 58.2 $2.00
11 Claude Sonnet 5.5 Anthropic 63.4 65.3 63.9 65.0 65.7 59.8 $4.00
12 Muse Wonder Meta 63.0 62.8 62.4 63.8 62.8 63.2 $8.00
13 Muse Wonder Full Meta 62.8 60.9 62.8 64.6 64.0 64.3 –
14 GPT-5.6 Sol OpenAI 62.5 61.2 62.0 65.1 64.3 61.7 $8.00
15 GPT-6 Sol OpenAI 62.4 62.0 62.1 64.7 65.0 59.4 $4.00
16 Kimi K3.1 Pro Moonshot AI Open 62.2 61.1 62.6 63.8 62.2 60.5 $4.00
17 Muse Ember New Meta 61.8 – 62.0 61.6 – 62.7 $0.20
18 Muse Spark 1.3 Meta 61.7 61.3 60.1 63.1 60.5 65.0 $2.00
19 DeepSeek V4.1 Flash 1017 DeepSeek Open 61.4 62.9 61.6 63.4 60.6 55.4 $0.26
20 Gemini 3.8 Flash Google 60.7 59.5 60.2 65.9 58.8 62.0 $1.50
21 GPT-5.5 OpenAI 60.7 59.5 59.6 64.5 62.7 59.2 $11.25
22 Claude Opus 4.8 Anthropic 60.6 60.2 59.9 62.0 61.3 59.5 $10.00
23 Kimi K3 Moonshot AI Open 60.5 59.4 59.4 62.1 60.1 58.3 $6.00
24 Doubao Seed Evolving (Nov 2026) New ByteDance 60.5 – – 62.2 64.4 53.9 –
25 GPT-5.6 Terra OpenAI 60.3 61.3 60.3 61.8 63.1 55.9 $4.50
26 Gemini 3.7 Flash Google 60.2 59.6 59.8 64.4 59.3 60.9 $1.50
27 Hy4 New Tencent 60.2 – 60.9 59.5 – 59.9 $1.25
28 Grok 4.7 xAI 60.1 61.1 60.8 60.6 56.8 59.3 $3.00
29 GLM-5.3 Zhipu AI Open 60.1 60.6 60.8 59.3 58.1 56.6 $1.94
30 Qwen3.8 Max Alibaba 59.9 58.6 60.6 61.9 60.7 58.3 $3.00
31 Grok 4.6 xAI 59.8 60.9 60.4 61.6 59.2 59.4 $3.00
32 MiMo-V2.6-Pro Xiaomi Open 59.8 59.5 60.2 59.1 59.9 62.0 $0.54
33 Qwen3.8 Max 0902 Alibaba 59.6 58.7 60.4 61.1 61.0 55.8 $3.00
34 Claude Haiku 5.5 Anthropic 59.5 62.2 60.9 60.2 61.1 54.3 $0.20
35 Ember-1 Fireworks 59.4 57.7 60.0 60.5 59.2 61.2 $6.00
36 Claude Opus 4.7 Anthropic 59.4 58.8 59.5 59.5 58.7 58.5 $10.00
37 DeepSeek V4 Pro 0813 DeepSeek Open 59.0 58.3 58.5 61.3 58.7 57.2 $0.99
38 DeepSeek V4.1 Flash DeepSeek Open 59.0 60.0 58.3 61.4 58.8 55.3 $0.33
39 GPT-5.4 OpenAI 58.9 57.7 58.3 61.7 60.1 56.3 $5.63
40 Inkling 2 Small New Thinking Machines 58.8 57.6 59.0 64.0 – 61.9 $0.000
41 Hy4 preview Tencent Open 58.7 58.0 58.0 57.1 60.5 61.3 $1.25
42 Muse Spark 1.2 Meta 58.7 57.6 57.5 60.1 57.4 59.4 $0.13
43 Muse Spark 1.1 Meta 58.6 58.2 57.4 60.2 56.8 58.8 $2.00
44 MiniMax-M3.1-Flash MiniMax Open 58.5 60.9 60.1 53.9 – 57.2 $0.26
45 MiMo-V2.6-Flash Xiaomi Open 58.4 57.3 60.0 60.4 59.2 58.7 $0.18
46 Step 5 Preview StepFun Open 58.4 60.1 58.9 59.0 57.3 59.6 $1.53
47 Claude Opus 4.6 Anthropic 58.4 57.2 58.6 60.7 57.9 57.4 $10.00
48 GPT-5.3 Codex OpenAI 58.3 57.2 58.4 61.6 – – $4.81
49 Claude Sonnet 5 Anthropic 58.3 58.4 58.6 58.8 58.7 55.4 $4.00
50 GLM-5.3-Flash Zhipu AI Open 58.3 58.9 59.3 59.5 56.3 55.8 $0.49
51 Gemini 3.6 Flash Google 58.2 57.3 58.5 60.9 56.9 58.5 $1.50
52 GPT-5.6 Luna OpenAI 58.1 58.4 58.1 58.4 61.4 54.7 $0.45
53 GPT-6 Luna OpenAI 58.0 59.5 58.6 58.9 61.2 54.1 $0.20
54 Muse Spark Open Meta Open 58.0 58.4 57.0 58.8 59.6 58.9 $2.00
55 Gemini 3.5 Flash Google 57.8 56.9 57.3 62.3 57.4 59.5 $3.38
56 Gemini 3.1 Pro Preview Google 57.5 54.9 56.1 63.8 57.5 62.3 $4.50
57 Grok 4.5 xAI 57.5 58.9 58.7 59.8 57.5 58.0 $3.00
58 Mistral Large 4 Preview Mistral Open 57.1 60.2 58.1 57.7 57.3 45.1 –
59 Muse Spark Meta 56.9 55.0 – 58.7 55.8 59.5 –
60 Mercury 3 Inception 56.6 58.3 55.9 – – 55.0 $0.16
61 GLM-5.2 Zhipu AI Open 56.6 56.2 57.5 56.4 56.8 53.6 $1.94
62 DeepSeek V4 Flash 0731 DeepSeek Open 56.5 55.2 59.1 60.1 57.5 53.1 $0.19
63 Claude Sonnet 4.6 Anthropic 56.3 54.5 56.9 58.1 55.5 55.1 $6.00
64 Qwen3.7 Max Alibaba 56.3 55.7 56.0 59.8 57.9 57.4 $2.68
65 GPT-5.2 OpenAI 56.2 56.8 54.3 58.7 57.4 53.5 $4.81
66 Kimi K2.6 Moonshot AI Open 56.0 56.6 55.1 58.3 56.7 51.9 $1.71
67 Gemini 3 Pro Preview Google 56.0 55.4 53.9 59.0 55.8 58.9 $4.50
68 Qwen3.8 27B Alibaba Open 56.0 57.7 56.3 57.0 54.4 52.6 $0.83
69 Qwen3.6 Max Preview Alibaba 55.7 54.8 58.2 56.6 53.4 57.3 $2.95
70 Beam 1.0 Reflection Open 55.7 54.8 56.9 56.8 54.7 55.0 –
71 DeepSeek V4 Pro DeepSeek Open 55.6 54.4 56.9 58.0 54.0 54.4 $2.06
72 Kimi K2.7 Code Moonshot AI Open 55.4 55.3 57.2 56.1 56.5 52.0 $1.71
73 Claude Opus 4.5 Anthropic 55.2 56.6 55.6 55.9 53.5 54.7 $10.00
74 Gemini 3 Flash Preview Google 55.2 53.9 54.9 58.0 55.5 57.0 $1.13
75 GPT-5.2 Codex OpenAI 55.0 55.4 55.9 – – – $4.81
76 Composer 2.5 Cursor 54.8 55.0 55.2 – – – –
77 GLM-5.1 Zhipu AI Open 54.7 53.4 56.8 55.8 54.7 53.3 $1.57
78 Mistral Large 4 Mistral 54.6 55.5 56.2 55.1 58.1 47.9 $1.05
79 GPT-5.5 Instant OpenAI 54.5 57.6 – 47.4 50.4 – $11.25
80 GPT-5.1 Codex OpenAI 54.2 56.9 53.6 – – – $3.44
81 GPT-5.1 Codex Max OpenAI 53.7 55.4 54.1 – 52.4 – $3.44
82 GPT-5.4 mini OpenAI 53.6 54.9 53.0 53.9 54.6 48.4 $1.69
83 GPT-5-Codex OpenAI 53.6 56.2 50.4 53.6 – – $3.44
84 MiniMax-M3 MiniMax Open 53.6 52.8 55.0 54.7 52.4 51.6 $0.53
85 DeepSeek V4 Flash DeepSeek Open 53.6 50.7 – 55.9 55.7 – $0.18
86 GPT-5 OpenAI 53.5 53.0 52.3 54.4 55.5 54.8 $3.44
87 Grok 4.20 (Reasoning) xAI 53.4 54.2 52.5 60.0 55.2 49.9 $1.56
88 Inkling Thinking Machines Open 53.3 52.4 53.6 56.2 51.8 53.7 $2.57
89 Kimi K2.5 Moonshot AI Open 53.2 54.4 52.5 53.4 53.5 51.9 $1.20
90 GPT-5.1 OpenAI 53.2 52.6 50.9 54.9 55.3 54.2 $3.44
91 MiMo-V2.5-Pro Xiaomi Open 53.2 54.0 53.8 51.6 55.2 49.4 $0.54
92 Qwen3.6 Plus Alibaba 53.1 51.4 54.6 53.7 54.8 52.9 $1.13
93 Nemotron 3 Ultra 550B A55B NVIDIA Open 52.9 54.9 53.2 55.2 – 50.7 $0.000
94 Inkling Small Thinking Machines Open 52.7 53.9 52.3 56.9 54.9 49.8 $0.53
95 Grok 4.3 xAI 52.6 54.2 50.3 56.0 54.9 50.4 $1.56
96 Qwen3.7 Plus Alibaba 52.5 47.4 54.4 56.9 53.2 48.5 $0.70
97 GLM-5 Zhipu AI Open 52.5 53.5 51.2 52.7 50.9 52.8 $1.12
98 Gemini 3.5 Flash Lite Google 52.1 52.0 52.8 51.8 49.9 50.4 $0.85
99 Claude Sonnet 4.5 Anthropic 52.1 52.1 52.8 51.7 51.6 50.7 $6.00
100 MiMo-V2.5 Xiaomi Open 52.1 51.8 54.3 52.0 54.4 45.6 $0.18
101 Qwen3.5 397B-A17B Alibaba Open 51.6 – 51.7 51.8 52.3 – $1.35
102 o3 OpenAI 51.3 51.1 48.0 52.0 51.9 53.4 $3.50
103 DeepSeek Reasoner DeepSeek Open 51.1 49.1 – 53.1 53.1 – $0.84
104 MiniMax-M2.1 MiniMax Open 50.8 54.0 48.5 46.4 – 54.7 $0.53
105 Grok 4 xAI 50.7 51.8 48.7 54.9 51.3 51.5 –
106 DeepSeek V3.2 DeepSeek Open 50.6 52.5 50.4 50.5 51.5 50.8 $0.33
107 Nemotron 3 Ultra NVIDIA Open 50.5 48.8 51.8 51.9 50.3 – –
108 Claude Opus 4.1 Anthropic 50.4 51.1 50.2 52.3 49.0 46.6 $30.00
109 Nemotron 3.5 Super VL 120B A12B NVIDIA Open 50.4 54.9 53.7 47.3 – 43.5 $0.000
110 Grok 4.1 Fast (Reasoning) xAI 50.3 48.7 52.2 56.5 50.4 49.6 $0.28
111 GLM-4.7 Zhipu AI Open 50.1 52.4 48.6 50.6 46.6 49.5 $0.86
112 MiniMax-M2.7 MiniMax Open 50.1 54.2 51.3 48.6 49.7 43.7 $0.53
113 GPT-5.4 nano OpenAI 50.0 53.5 50.2 51.1 54.0 39.2 $0.46
114 Muse Glimmer Meta Open 49.9 50.7 – 50.1 – – –
115 Qwen3.5 Flash Alibaba 49.7 52.7 50.8 52.3 47.8 46.3 $0.18
116 Gemini 2.5 Pro Preview 06-05 Google 49.7 50.4 47.7 48.0 49.3 51.9 $3.44
117 Qwen3 Max Alibaba 49.4 52.0 44.7 49.7 49.9 54.7 $1.52
118 MiniMax-M2.5 MiniMax Open 49.3 53.3 47.7 49.7 50.4 43.4 $0.53
119 Qwen3.5 27B Alibaba Open 49.1 – 48.1 52.3 49.2 – $0.73
120 Step 3.7 Flash StepFun Open 49.1 46.2 – 50.4 52.8 – $0.45
121 Claude Opus 4 Anthropic 49.0 49.5 49.3 49.7 45.9 45.7 $30.00
122 Gemini 2.5 Pro Google 49.0 48.3 48.4 51.2 50.3 – $3.44
123 Qwen3 Max Preview Alibaba 48.9 46.4 – 49.5 – 48.5 $2.01
124 Kimi K2 Thinking Moonshot AI Open 48.9 48.0 47.6 49.2 50.1 44.8 $1.08
125 o4-mini OpenAI 48.9 49.3 47.1 49.8 52.9 46.5 $1.93
126 Gemini 2.5 Flash (Sep 2025) Google 48.6 50.9 42.4 51.9 – 48.8 –
127 Qwen3.6 27B Alibaba Open 48.3 48.0 – 47.5 53.1 – $1.03
128 Gemini 3.1 Flash Lite Preview Google 48.0 52.9 47.9 45.6 – 46.0 $0.56
129 GPT-5 Mini OpenAI 48.0 50.6 41.7 49.6 54.0 47.8 $0.69
130 DeepSeek-V3.2-Exp DeepSeek Open 47.9 48.7 47.5 48.8 – – –
131 Gemma 4 31B IT Google Open 47.9 45.7 49.1 50.5 49.2 38.7 $0.21
132 Gemini 2.5 Flash Google 47.3 – 45.6 46.7 47.5 – $0.85
133 Gemma 4 26B A4B IT Google Open 47.2 46.2 – 44.4 51.3 – $0.20
134 Claude Sonnet 4 Anthropic 47.1 46.0 49.3 48.9 44.5 42.6 $6.00
135 Gemini 3.1 Flash Lite Google 47.0 49.3 42.6 48.7 51.3 43.1 $0.56
136 DeepSeek R1 0528 DeepSeek Open 47.0 48.2 42.6 46.3 49.7 – $1.01
137 X-Ai/Grok-4-Fast-Reasoning xAI 46.9 48.9 – 51.8 – 42.9 $0.28
138 GLM-4.6 Zhipu AI Open 46.9 48.6 47.8 45.1 45.8 46.5 $1.00
139 Mistral Medium 3.5 Mistral 46.9 51.7 49.5 38.4 53.3 38.9 $3.00
140 Kimi K2 Instruct Moonshot AI Open 46.8 46.6 46.4 44.1 – 42.5 $0.88
141 DeepSeek Chat DeepSeek Open 46.8 47.8 – 46.3 45.0 – $0.33
142 Claude Haiku 4.5 Anthropic 46.7 47.8 49.9 47.6 48.3 41.9 $2.00
143 DeepSeek-V3.1-Terminus DeepSeek Open 46.5 44.3 – 47.5 – – –
144 Qwen3.6 35B-A3B Alibaba Open 46.4 44.1 45.1 49.7 49.9 – $0.36
145 Gemini 2.5 Flash-Lite Preview 09-2025 Google 46.4 48.4 – 45.6 – 42.1 $0.18
146 Claude Sonnet 3.7 Anthropic 46.4 46.1 47.1 47.0 45.6 42.8 $6.00
147 GLM-4.5 Zhipu AI Open 46.4 46.6 – 46.8 – 42.9 $1.00
148 o1 OpenAI 46.3 44.9 42.8 48.4 48.5 48.1 $26.25
149 Gemini 2.5 Flash Preview 05-20 Google 46.2 43.6 – 47.2 48.7 45.3 $0.94
150 DeepSeek-R1 DeepSeek Open 46.0 45.3 43.3 45.9 46.6 48.0 $2.36
151 Qwen3.5 122B-A10B Alibaba Open 46.0 42.0 – 49.5 – – $0.79
152 Qwen3-Coder 480B-A35B Instruct Alibaba Open 45.8 47.5 45.9 – – – $0.62
153 Qwen3 235B-A22B Instruct 2507 Alibaba Open 45.4 44.8 44.3 44.3 – – $0.31
154 Mercury 2.5 Inception 45.4 46.8 51.8 40.8 50.3 35.4 $0.34
155 Mistral Medium 3.5 Mistral Open 45.3 45.1 – 40.8 52.4 – $3.14
156 o3-mini OpenAI 45.2 44.6 – 46.6 49.4 42.0 $1.93
157 Qwen3.5 Plus Alibaba 45.0 54.3 30.6 51.4 51.7 49.7 $0.90
158 Gemini 2.5 Flash (Apr 2025) Google 44.8 41.5 – 45.2 49.2 46.3 –
159 GPT-5 Nano OpenAI 44.6 47.9 44.0 46.8 50.2 39.2 $0.14
160 Qwen3 235B-A22B Alibaba Open 44.5 45.0 – 44.4 39.0 45.0 $0.50
161 Trinity Large Thinking Arcee AI Open 44.5 46.8 – 45.1 – – $0.41
162 GPT OSS 120B OpenAI Open 44.4 44.1 42.1 44.7 53.5 42.2 $0.26
163 GPT-4.1 OpenAI 44.3 42.0 45.1 42.3 43.2 44.3 $3.50
164 Qwen3 235B-A22B Thinking 2507 Alibaba Open 44.3 47.5 30.6 45.8 48.0 53.4 $0.95
165 MiniMax-M2 MiniMax Open 44.0 – 46.7 44.2 – – $0.53
166 Grok-3 mini xAI 43.9 42.1 – 45.1 47.3 – –
167 Grok 3 xAI 43.8 42.9 45.3 43.4 44.5 43.2 –
168 x-AI/Grok-Code-Fast 1 xAI 43.6 44.3 45.5 45.1 – – $0.53
169 GLM-4.5-Air Zhipu AI Open 43.4 44.9 – 40.8 – 42.6 $0.31
170 Qwen3.5 35B-A3B Alibaba Open 43.3 39.1 – 48.1 48.7 – $0.36
171 Grok 4.1 Fast xAI 43.3 36.6 48.0 47.0 50.4 37.2 $0.28
172 Laguna XS.2 Poolside Open 43.2 50.0 46.0 39.2 45.4 26.9 $0.000
173 GPT-4.5 OpenAI 43.2 40.9 – 44.0 41.8 38.9 –
174 Command A Plus Cohere Open 43.1 44.8 42.8 40.8 – – $4.38
175 Mistral Large 3 Mistral Open 43.0 43.4 – 41.9 – 43.0 $0.75
176 Qwen3-30B-A3B-Thinking (Jul 2025) Alibaba Open 42.6 39.4 – 44.0 48.6 – –
177 GPT-4.1 mini OpenAI 42.6 42.1 43.6 40.7 44.1 40.2 $0.70
178 DeepSeek V3 0324 DeepSeek Open 42.5 44.7 41.0 41.6 41.3 42.6 $0.50
179 Laguna M.1 Poolside Open 42.4 50.2 48.6 27.4 45.4 29.7 $0.000
180 Mercury 2 Inception 42.3 44.9 – 43.8 – – $0.38
181 Qwen3 32B Alibaba Open 42.2 39.8 42.9 42.5 48.0 – $0.26
182 Qwen3 30B-A3B Instruct 2507 Alibaba Open 42.2 – 39.8 39.7 47.2 – $0.15
183 o1-preview OpenAI 42.2 – 39.0 43.5 42.0 – –
184 Magistral Medium 1.2 Mistral 42.1 47.4 – 41.5 – 30.0 –
185 Mistral Medium 3.1 Mistral 42.0 38.8 – 41.1 – – $0.80
186 Claude Sonnet 3.5 v2 Anthropic 41.8 43.2 39.9 42.0 39.1 36.7 $6.00
187 GPT OSS 20B OpenAI Open 40.6 48.7 31.8 45.1 47.7 33.2 $0.13
188 Qwen3-14B Alibaba Open 40.5 37.9 39.7 42.3 47.9 – –
189 Gemini 2.0 Flash Google 40.5 37.0 – 42.5 41.5 39.8 $0.18
190 Qwen3.5 9B Alibaba Open 40.3 35.7 38.1 46.5 47.0 – $0.14
191 X-Ai/Grok-4-Fast-Non-Reasoning xAI 40.2 38.0 – 42.1 – 31.8 $0.28
192 o1-mini OpenAI 40.1 37.6 – 42.6 43.3 – –
193 DeepSeek-V3 DeepSeek Open 40.1 41.8 39.8 39.7 39.1 35.6 $0.51
194 Gemini 2.0 Pro Google 40.1 38.4 – 41.2 42.7 – –
195 QwQ 32B Alibaba Open 39.6 33.6 – 43.6 46.7 – $0.75
196 Mistral Medium 3 Mistral 39.6 37.5 38.2 41.2 39.5 37.3 $0.80
197 Magistral Small 1.2 Mistral Open 39.4 44.6 – 39.4 41.4 23.7 $0.75
198 Claude 3.5 Sonnet Anthropic 39.2 – 35.7 41.0 37.5 – –
199 Gemini 1.5 Pro (Sept 2024) Google 39.2 36.3 39.7 41.6 39.6 37.4 –
200 Gemini 2.0 Flash Thinking (Jan 2025) Google 38.2 32.5 – 40.8 46.4 40.6 –
201 GPT-4o (2024-05-13) OpenAI 38.1 – 37.8 37.2 35.2 – $7.50
202 Qwen Max Alibaba 38.0 33.9 – 39.9 38.4 – $2.80
203 GPT-4o (2024-08-06) OpenAI 37.7 34.4 – 39.3 34.3 44.4 $4.38
204 MiMo-V2-Flash Xiaomi Open 37.7 31.7 – 40.8 – – $0.15
205 Llama-3.1-70B-Instruct Meta Open 37.5 – 44.3 35.3 32.7 – $0.72
206 Mistral Small 3.2 Mistral Open 37.5 32.2 38.0 38.6 41.8 – $0.22
207 Llama 4 Maverick Meta Open 37.0 31.9 38.0 41.4 38.5 39.3 –
208 Llama-3.2-90B-Vision-Instruct Meta Open 36.9 – 44.0 34.1 32.6 – $0.000
209 Command A Cohere Open 36.7 33.6 42.0 35.7 – 30.6 $4.38
210 Qwen3 8B Alibaba Open 36.6 27.6 40.3 40.3 46.2 – $0.098
211 Grok-2 (Dec 2024) xAI 36.6 35.0 – 38.2 37.0 37.5 –
212 GPT-4o (2024-11-20) OpenAI 36.3 34.2 – 39.8 34.8 32.9 $4.38
213 Qwen2.5-VL 72B Instruct Alibaba Open 35.8 – 34.2 37.1 37.1 – $1.01
214 Mistral Large 2.1 Mistral Open 35.7 34.4 38.5 37.2 35.1 31.1 $3.00
215 Claude Haiku 3.5 Anthropic 35.5 35.0 38.5 36.1 34.1 25.6 $1.60
216 Cohere Command A Cohere Open 35.3 29.3 – 40.8 – – –
217 Phi-4 Microsoft Open 35.0 – 33.1 40.2 38.0 – –
218 Llama-3.3-70B-Instruct Meta Open 35.0 31.8 36.4 38.1 33.8 – $0.72
219 GPT-4.1 nano OpenAI 34.8 31.4 36.1 36.8 39.5 31.0 $0.18
220 Gemini 1.5 Flash (Sep 2024) Google 34.7 34.3 34.4 36.1 36.9 27.0 –
221 GPT-4 Turbo OpenAI 34.5 – 30.4 37.5 34.2 – $15.00
222 Solar Pro 3 Upstage 34.5 31.1 – 40.8 – – $0.25
223 Claude 3 Opus Anthropic 34.4 – 29.2 38.0 33.1 40.5 –
224 Gemma 3 27B IT Google Open 34.1 23.4 34.4 38.1 40.1 – $0.16
225 Mistral Small 3.1 Mistral Open 33.8 32.7 – 37.8 34.6 27.4 –
226 Llama 4 Scout Meta Open 32.7 25.9 33.7 37.6 35.9 – –
227 GPT-4o mini OpenAI 32.1 21.5 36.9 36.8 34.7 32.9 $0.26
228 GPT-4 OpenAI 31.5 – 30.6 34.3 29.1 – $37.50
229 Gemma 3 12B IT Google Open 31.4 18.7 34.9 36.4 38.7 – $0.075
230 Qwen2-72B Alibaba Open 31.2 – 29.3 33.9 33.4 – –
231 Mistral Nemo Mistral Open 31.2 – 33.9 29.3 26.0 – $0.11
232 Gemma 3 4B IT Google Open 31.1 – 28.8 27.3 35.1 – $0.063
233 mistral-small-2402 Unknown 28.0 23.2 – 37.5 – 25.9 –
234 GPT-3.5-turbo OpenAI 25.6 – 21.6 30.1 29.9 – $0.75
235 Llama-3.1-8B-Instruct Meta Open 25.4 12.9 32.6 33.3 29.6 – $0.058
236 Ministral 8B Instruct Mistral Open 25.3 – 21.9 28.0 27.7 – –
237 Llama 3.2 1B Instruct Meta Open 21.5 – 21.5 26.3 24.4 – $0.071