LMArena Vision

Blind pairwise human votes on prompts that include images, adjusted for answer style.

CategoryMultimodal
MetricElo, style controlled
SourceLMArena (original)
LicenseCC BY 4.0
Benchmark pagelmarena.ai
StatusScored
Weight1.0 within Multimodal
FitDiscrimination 0.23, noise 0.10

Results

#ModelProviderResultDate
1 Claude Fable 5 High Anthropic 1,309 2026-11-09
2 Claude Opus 4.7 Anthropic 1,300 2026-11-09
3 Qwen3.8 Max Alibaba 1,299 2026-11-09
4 Claude Opus 4.6 High Anthropic 1,299 2026-11-09
5 Claude Opus 4.7 High Anthropic 1,298 2026-11-09
6 Claude Opus 5.5 High Anthropic 1,295 2026-11-09
7 Muse Spark Meta 1,294 2026-11-09
8 Gemini 3.7 Flash High Google 1,294 2026-11-09
9 Muse Spark 1.2 Extra High Meta 1,294 2026-11-09
10 Claude Opus 4.6 Anthropic 1,293 2026-11-09
11 Gemini 3.8 Flash High Google 1,293 2026-11-09
12 GPT-6.1 Sol Max OpenAI 1,293 2026-11-09
13 Muse Spark 1.3 Max Meta 1,291 2026-11-09
14 Gemini 3 Pro Preview Google 1,289 2026-11-09
15 Claude Fable 5.1 Max Anthropic 1,289 2026-11-09
16 GPT-5.6 Sol Extra High OpenAI 1,288 2026-11-09
17 Muse Spark 1.3 Extra High Meta 1,288 2026-11-09
18 Claude Opus 4.8 High Anthropic 1,286 2026-11-09
19 Claude Opus 5 High Anthropic 1,285 2026-11-09
20 GPT-5.5 OpenAI 1,285 2026-11-09
21 GPT-6 Astra Max OpenAI 1,283 2026-11-09
22 GPT-5.5 High OpenAI 1,283 2026-11-09
23 GPT-5.4 High OpenAI 1,282 2026-11-09
24 Gemini 3.5 Flash Medium Google 1,281 2026-11-09
25 Gemini 3.5 Flash High Google 1,281 2026-11-09
26 Grok 4.5 xAI 1,280 2026-11-09
27 Gemini 3.1 Pro Preview Google 1,280 2026-11-09
28 Gemini 3.6 Flash High Google 1,280 2026-11-09
29 Muse Spark 1.1 Meta 1,279 2026-11-09
30 Claude Opus 4.8 Anthropic 1,279 2026-11-09
31 GPT-5.4 OpenAI 1,278 2026-11-09
32 GPT-5.2 Chat OpenAI 1,278 2026-11-09
33 GPT-5.5 Instant OpenAI 1,277 2026-11-09
34 Claude Sonnet 4.6 Anthropic 1,275 2026-11-09
35 Gemini 3 Flash Preview Google 1,272 2026-11-09
36 GLM-5.3-Flash Zhipu AI 1,272 2026-11-09
37 GPT-5.6 Terra Extra High OpenAI 1,266 2026-11-09
38 Gemini 3.5 Flash Lite Google 1,266 2026-11-09
39 Gemma 4 31B IT Google 1,265 2026-11-09
40 Kimi K2.6 Moonshot AI 1,265 2026-11-09
41 Grok 4.6 High xAI 1,263 2026-11-09
42 DeepSeek V4.1 Flash Max DeepSeek 1,263 2026-11-09
43 Claude Sonnet 5.5 Extra High Anthropic 1,263 2026-11-09
44 Qwen3.7 Plus Alibaba 1,262 2026-11-09
45 Claude Sonnet 5 High Anthropic 1,261 2026-11-09
46 Gemini 3 Flash Preview Minimal Google 1,260 2026-11-09
47 GPT-6 Sol Max OpenAI 1,258 2026-11-09
48 GPT-5.6 Luna Extra High OpenAI 1,255 2026-11-09
49 Kimi K2.5 Thinking Moonshot AI 1,252 2026-11-09
50 GPT-5.1 High OpenAI 1,251 2026-11-09
51 GPT-5.4 mini High OpenAI 1,250 2026-11-09
52 Grok 4.7 Extra High xAI 1,249 2026-11-09
53 MiMo-V2.6-Flash Xiaomi 1,248 2026-11-09
54 Gemini 2.5 Pro Google 1,247 2026-11-09
55 MiMo-V2.6-Pro Xiaomi 1,247 2026-11-09
56 Qwen3.5 397B-A17B Alibaba 1,246 2026-11-09
57 Step 5 Preview StepFun 1,245 2026-11-09
58 Qwen3.8 27B Alibaba 1,243 2026-11-09
59 GPT-5.2 High OpenAI 1,242 2026-11-09
60 Gemma 4 26B A4B IT Google 1,242 2026-11-09
61 Grok 4.3 xAI 1,242 2026-11-09
62 GPT-5.1 OpenAI 1,240 2026-11-09
63 Kimi K2.5 Non-reasoning Moonshot AI 1,236 2026-11-09
64 GPT-6 Luna Max OpenAI 1,235 2026-11-09
65 Gemini 3.1 Flash Lite Preview Google 1,235 2026-11-09
66 MiMo-V2.5 Xiaomi 1,234 2026-11-09
67 MiniMax-M3 MiniMax 1,232 2026-11-09
68 GLM-5V-Turbo Zhipu AI 1,232 2026-11-09
69 Mistral Large 4 Mistral 1,231 2026-11-09
70 Gemini 2.5 Flash (Sep 2025) Google 1,229 2026-11-09
71 GPT-5.2 OpenAI 1,228 2026-11-09
72 Qwen3.5 122B-A10B Alibaba 1,226 2026-11-09
73 GPT-5 OpenAI 1,225 2026-11-09
74 GPT-4.5 OpenAI 1,225 2026-11-09
75 MiMo-V2-Omni Xiaomi 1,216 2026-11-09
76 Qwen3.5 27B Alibaba 1,216 2026-11-09
77 o3 OpenAI 1,216 2026-11-09
78 Gemini 2.5 Flash Google 1,215 2026-11-09
79 Qwen3 VL 235B A22B Instruct Alibaba 1,214 2026-11-09
80 GPT-4.1 OpenAI 1,214 2026-11-09
81 GPT-5 High OpenAI 1,211 2026-11-09
82 Claude Opus 4 Thinking Anthropic 1,208 2026-11-09
83 Inkling Small Thinking Machines 1,208 2026-11-09
84 Claude Sonnet 4 Thinking Anthropic 1,206 2026-11-09
85 o4-mini OpenAI 1,201 2026-11-09
86 GPT-4.1 mini OpenAI 1,201 2026-11-09
87 Mistral Large 3 Mistral 1,200 2026-11-09
88 Mistral Medium 3.5 Mistral 1,199 2026-11-09
89 GPT-5.4 nano High OpenAI 1,199 2026-11-09
90 Grok 4.1 Fast (Reasoning) xAI 1,196 2026-11-09
91 o1 OpenAI 1,193 2026-11-09
92 Claude Sonnet 3.7 Thinking Anthropic 1,193 2026-11-09
93 Claude Opus 4 Anthropic 1,189 2026-11-09
94 Claude Sonnet 4 Anthropic 1,189 2026-11-09
95 Qwen3 VL 235B A22B Thinking Alibaba 1,188 2026-11-09
96 GPT-5 Mini High OpenAI 1,185 2026-11-09
97 Qwen-VL Max Alibaba 1,185 2026-11-09
98 Grok 4 xAI 1,184 2026-11-09
99 Gemini 1.5 Pro (Sept 2024) Google 1,180 2026-11-09
100 Claude Sonnet 3.7 Anthropic 1,175 2026-11-09
101 Gemini 2.0 Flash Google 1,172 2026-11-09
102 GPT-4o (2024-05-13) OpenAI 1,162 2026-11-09
103 Claude Sonnet 3.5 v2 Anthropic 1,161 2026-11-09
104 GLM-4.6V Zhipu AI 1,161 2026-11-09
105 Gemma 3 27B IT Google 1,160 2026-11-09
106 Mistral Medium 3.1 Mistral 1,160 2026-11-09
107 Mistral Medium 3 Mistral 1,155 2026-11-09
108 GLM-4.5V Zhipu AI 1,153 2026-11-09
109 GPT-5 Nano High OpenAI 1,147 2026-11-09
110 Claude 3.5 Sonnet Anthropic 1,146 2026-11-09
111 Llama 4 Maverick Meta 1,145 2026-11-09
112 Gemini 1.5 Flash (Sep 2024) Google 1,142 2026-11-09
113 Mistral Small 3.2 Mistral 1,140 2026-11-09
114 Gemini 2.0 Flash-Lite Google 1,136 2026-11-09
115 Llama 4 Scout Meta 1,128 2026-11-09
116 Claude Haiku 3.5 Anthropic 1,127 2026-11-09
117 Mistral Small 3.1 24B Mistral 1,127 2026-11-09
118 Qwen2.5-VL 72B Instruct Alibaba 1,121 2026-11-09
119 Gemini 1.5 Pro (May 2024) Google 1,120 2026-11-09
120 GPT-4o (2024-08-06) OpenAI 1,118 2026-11-09
121 GPT-4 Turbo OpenAI 1,112 2026-11-09
122 GPT-4o mini OpenAI 1,097 2026-11-09
123 Pixtral Large (latest) Mistral 1,095 2026-11-09
124 GPT-4.1 nano OpenAI 1,089 2026-11-09
125 Qwen2-VL-72B-Instruct Unknown 1,085 2026-11-09
126 Gemini 1.5 Flash 8B Google 1,071 2026-11-09
127 Claude 3 Opus Anthropic 1,062 2026-11-09
128 Gemini 1.5 Flash (May 2024) Google 1,059 2026-11-09
129 Llama-3.2-90B-Vision-Instruct Meta 1,032 2026-11-09
130 Qwen2-VL-7B-Instruct Unknown 1,031 2026-11-09
131 Pixtral 12B Mistral 1,025 2026-11-09
132 Claude 3 Sonnet Anthropic 1,017 2026-11-09
133 Aya Vision 32B Cohere 1,001 2026-11-09
134 Claude Haiku 3 Anthropic 1,000 2026-11-09
135 Llama-3.2-11B-Vision-Instruct Meta 993 2026-11-09
136 MiniCPM-V-2_6 Unknown 963 2026-11-09
137 Phi-3.5-vision-instruct Unknown 919 2026-11-09