Vibe Code Bench v1.1

Building complete web applications from a plain-language spec, graded by automated end-to-end tests. Run by Vals AI.

CategoryFrontend
MetricAccuracy (%)
SourceVals AI (evaluator)
LicenseNone stated
Benchmark pagewww.vals.ai
StatusScored
Weight1.1 within Frontend
FitDiscrimination 2.01, noise 0.10

Results

#ModelProviderResultDate
1 Claude Fable 5.2 High Anthropic 93.8% 2026-11-09
2 Claude Sonnet 5.5 Max Anthropic 92.4% 2026-11-09
3 Gemini 4 Argon High Google 91.9% 2026-11-09
4 Claude Haiku 5.5 Max Anthropic 90.4% 2026-11-09
5 Claude Fable 5 Max Anthropic 90.4% 2026-11-09
6 Claude Opus 5.5 Max Anthropic 90.3% 2026-11-09
7 Claude Fable 5.1 Max Anthropic 90.3% 2026-11-09
8 GPT-6 Astra Max OpenAI 89.6% 2026-11-09
9 Gemini 4 Carbon High Google 89.1% 2026-11-09
10 GPT-6.1 Sol Max OpenAI 88.9% 2026-11-09
11 Claude Opus 5 Anthropic 88.4% 2026-11-09
12 GPT-6 Sol Max OpenAI 87.8% 2026-11-09
13 DeepSeek V4.1 Flash 1017 Max DeepSeek 87.7% 2026-11-09
14 Grok 4.7 Extra High xAI 86.2% 2026-11-09
15 Muse Wonder Full Max Meta 86.0% 2026-11-09
16 Muse Spark 1.3 Max Meta 85.9% 2026-11-09
17 MiMo-V2.6-Pro Xiaomi 85.2% 2026-11-09
18 Kimi K3 Max Moonshot AI 85.0% 2026-11-09
19 Kimi K3.1 Pro Max Moonshot AI 84.9% 2026-11-09
20 DeepSeek V4.1 Flash High DeepSeek 84.7% 2026-11-09
21 GPT-6.1 Terra Max OpenAI 84.0% 2026-11-09
22 Ember-1 Fireworks 83.9% 2026-11-09
23 Muse Ember Max Meta 83.7% 2026-11-09
24 Muse Wonder Max Meta 83.1% 2026-11-09
25 Muse Spark 1.3 Extra High Meta 82.9% 2026-11-09
26 Claude Opus 4.8 Max Anthropic 82.7% 2026-11-09
27 DeepSeek V4 Pro 0813 Max DeepSeek 82.3% 2026-11-09
28 GPT-6 Luna Max OpenAI 81.6% 2026-11-09
29 Inkling 2 Small Thinking Machines 81.5% 2026-11-09
30 Claude Sonnet 5 Max Anthropic 81.3% 2026-11-09
31 Hy4 Tencent 81.0% 2026-11-09
32 GPT-5.6 Sol Max OpenAI 80.5% 2026-11-09
33 Muse Spark 1.2 Extra High Meta 79.1% 2026-11-09
34 MiMo-V2.6-Flash Xiaomi 79.0% 2026-11-09
35 Gemini 3.8 Flash High Google 78.7% 2026-11-09
36 Mistral Large 4 High Mistral 78.4% 2026-11-09
37 GLM-5.3 Max Zhipu AI 78.1% 2026-11-09
38 Claude Opus 4.8 Anthropic 77.5% 2026-11-09
39 Hy4 preview Tencent 77.5% 2026-11-09
40 GPT-5.6 Luna Max OpenAI 77.1% 2026-11-09
41 Grok 4.6 High xAI 76.2% 2026-11-09
42 Muse Spark Open Extra High Meta 76.2% 2026-11-09
43 DeepSeek V4 Flash 0731 High DeepSeek 74.7% 2026-11-09
44 GPT-5.6 Terra Max OpenAI 74.6% 2026-11-09
45 MiniMax-M3.1-Flash Max MiniMax 73.9% 2026-11-09
46 Muse Spark 1.1 Extra High Meta 72.2% 2026-11-09
47 Claude Opus 4.7 Max Anthropic 71.0% 2026-11-09
48 Step 5 Preview StepFun 70.4% 2026-11-09
49 Gemini 3.7 Flash High Google 70.4% 2026-11-09
50 GPT-5.5 Extra High OpenAI 69.8% 2026-11-09
51 Grok 4.5 High xAI 69.0% 2026-11-09
52 GPT-5.4 Extra High OpenAI 67.4% 2026-11-09
53 Beam 1.0 Reflection 66.4% 2026-11-09
54 Qwen3.8 27B Extra High Alibaba 64.9% 2026-11-09
55 Qwen3.8 Max Alibaba 64.7% 2026-11-09
56 Gemini 3.6 Flash High Google 64.0% 2026-11-09
57 GLM-5.2 Max Zhipu AI 64.0% 2026-11-09
58 GPT-5.3 Codex Extra High OpenAI 61.8% 2026-11-09
59 Mercury 3 High Inception 60.9% 2026-11-09
60 Claude Opus 4.6 Max Anthropic 57.6% 2026-11-09
61 Claude Sonnet 4.6 Anthropic 55.8% 2026-11-09
62 GPT-5.2 Extra High OpenAI 53.5% 2026-11-09
63 Claude Opus 4.6 Thinking Anthropic 53.5% 2026-11-09
64 Claude Sonnet 4.6 Max Anthropic 51.5% 2026-11-09
65 DeepSeek V4 Pro Max DeepSeek 49.9% 2026-11-09
66 Composer 2.5 Cursor 49.6% 2026-11-09
67 Gemini 3.5 Flash High Google 48.7% 2026-11-09
68 GPT-5.4 OpenAI 48.5% 2026-11-09
69 GPT-5.4 mini Extra High OpenAI 48.0% 2026-11-09
70 Qwen3.7 Max Alibaba 47.7% 2026-11-09
71 MiniMax-M3 MiniMax 47.6% 2026-11-09
72 Kimi K2.7 Code Moonshot AI 47.2% 2026-11-09
73 Qwen3.7 Plus Alibaba 46.4% 2026-11-09
74 MiMo-V2.5 Xiaomi 42.2% 2026-11-09
75 GPT-5.2 Codex High OpenAI 37.9% 2026-11-09
76 Kimi K2.6 Moonshot AI 37.9% 2026-11-09
77 Gemini 3.5 Flash Lite High Google 37.2% 2026-11-09
78 MiMo-V2.5-Pro Xiaomi 34.1% 2026-11-09
79 Gemini 3.1 Pro Preview High Google 32.0% 2026-11-09
80 GLM-5.1 Zhipu AI 31.5% 2026-11-09
81 GLM-5.3-Flash Max Zhipu AI 30.8% 2026-11-09
82 GPT-5.4 nano High OpenAI 26.1% 2026-11-09
83 Qwen3.6 Plus Alibaba 25.6% 2026-11-09
84 GPT-5.1 High OpenAI 24.6% 2026-11-09
85 GLM-5 Thinking Zhipu AI 23.4% 2026-11-09
86 Claude Sonnet 4.5 Thinking Anthropic 22.6% 2026-11-09
87 GPT-5.1 Codex Max High OpenAI 22.2% 2026-11-09
88 Claude Opus 4.5 Thinking Anthropic 20.6% 2026-11-09
89 Gemini 3 Flash Preview High Google 20.2% 2026-11-09
90 GPT-5 High OpenAI 20.1% 2026-11-09
91 Muse Spark Meta 19.7% 2026-11-09
92 Grok 4.3 High xAI 19.4% 2026-11-09
93 Inkling Thinking Machines 19.2% 2026-11-09
94 Inkling Small Thinking Machines 19.1% 2026-11-09
95 Kimi K2.5 Thinking Moonshot AI 17.5% 2026-11-09
96 Qwen3.5 Plus Thinking Alibaba 15.7% 2026-11-09
97 MiniMax-M2.5 MiniMax 14.9% 2026-11-09
98 Gemini 3 Pro Preview High Google 14.3% 2026-11-09
99 GPT-5 Mini High OpenAI 14.2% 2026-11-09
100 Grok Build 0.1 xAI 13.3% 2026-11-09
101 GPT-5.1 Codex High OpenAI 13.1% 2026-11-09
102 Qwen3.6 27B Alibaba 11.9% 2026-11-09
103 MiniMax-M2.7 MiniMax 11.9% 2026-11-09
104 Claude Haiku 4.5 Thinking Anthropic 11.4% 2026-11-09
105 Laguna M.1 Poolside 11.0% 2026-11-09
106 Nemotron 3 Ultra 550B A55B NVIDIA 7.6% 2026-11-09
107 Laguna XS.2 Poolside 5.2% 2026-11-09
108 DeepSeek V3.2 High DeepSeek 5.1% 2026-11-09
109 Grok 4.20 (Reasoning) xAI 4.1% 2026-11-09
110 Nemotron 3.5 Super VL 120B A12B High NVIDIA 3.7% 2026-11-09
111 Mercury 2.5 High Inception 3.7% 2026-11-09
112 Qwen3 Max Alibaba 3.5% 2026-11-09
113 GLM-4.6 Zhipu AI 3.1% 2026-11-09
114 Mistral Medium 3.5 High Mistral 2.9% 2026-11-09
115 Grok 4.1 Fast (Reasoning) xAI 1.2% 2026-11-09
116 Gemini 2.5 Pro Google 0.4% 2026-11-09
117 X-Ai/Grok-4-Fast-Reasoning xAI 0.0% 2026-11-09
118 Gemini 3.1 Flash Lite Preview High Google 0.0% 2026-11-09
119 Mistral Small 4 High Mistral 0.0% 2026-11-09