Gemma 3 12B IT

Released2025-03-12
Price per 1M$0.050 in · $0.15 out
Overall score31.4 · rank 229
Context window131,072 tokens
ProviderGoogle
WeightsOpen weights

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 31.4 229 8
Overall: Coding 24.6 233 4
Overall: Reasoning 37.4 206 3
Overall: Agentic work 31.1 229 4
Overall: Frontend 18.7 224 1
Coding 18.7 212 1
Agents 34.9 172 1
Reasoning 36.5 217 2
Math 38.7 168 1
General 41.1 159 3
Value vs price−8.7173

Evidence

Coding 18.7 ±4.7

BenchmarkResultSourceDate
SciCode 16.4% Epoch AI 2026-11-11

Agents 34.9 ±3.6

BenchmarkResultSourceDate
BFCL v4 30.4% BFCL 2026-04-12

Reasoning 36.5 ±3.5

BenchmarkResultSourceDate
GPQA Diamond 39.5% Epoch AI 2026-08-28
CritPt 0.0% Epoch AI 2026-11-11

Math 38.7 ±3.6

BenchmarkResultSourceDate
OTIS Mock AIME 2024-2025 16.7% Epoch AI 2026-08-28

General 41.1 ±3.2

BenchmarkResultSourceDate
LMArena Text 1,342 LMArena 2026-11-09
EQ-Bench Creative Writing v3 1,131 EQ-Bench 2026-11-11
EQ-Bench Longform Creative Writing 41.8% EQ-Bench 2026-11-11

Names matched to this model

gemma-3-12b, gemma-3-12b-it

Compare Gemma 3 12B IT with other models