Llama-3.1-8B-Instruct

Released2024-07-23
Price per 1M$0.050 in · $0.080 out
Overall score25.4 · rank 235
Context window128,000 tokens
ProviderMeta
WeightsOpen weights

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 25.4 235 9
Overall: Coding 19.9 237 5
Overall: Reasoning 31.7 228 4
Overall: Agentic work 27.8 234 5
Overall: Frontend 12.9 225 1
Coding 12.9 213 1
Agents 32.6 179 2
Reasoning 33.3 225 2
Math 29.6 192 2
General 26.0 186 2
Value vs price−13.9186

Evidence

Coding 12.9 ±4.7

BenchmarkResultSourceDate
SciCode 13.2% Epoch AI 2026-11-11

Agents 32.6 ±3.2

BenchmarkResultSourceDate
BFCL v4 25.8% BFCL 2026-04-12
BALROG 15.1% Epoch AI 2026-11-11

Reasoning 33.3 ±3.5

BenchmarkResultSourceDate
GPQA Diamond 27.0% Epoch AI 2026-08-27
CritPt 0.0% Epoch AI 2026-11-11

Math 29.6 ±2.0

BenchmarkResultSourceDate
MATH Level 5 22.9% Epoch AI 2025-01-27
OTIS Mock AIME 2024-2025 1.7% Epoch AI 2026-08-27

General 26.0 ±2.6

BenchmarkResultSourceDate
EQ-Bench Creative Writing v3 711 EQ-Bench 2026-11-11
LMArena Text 1,211 LMArena 2026-11-09

Names matched to this model

llama-3-1-8b, llama-3-1-8b-instruct, llama3-1-8b-instruct-q8

Compare Llama-3.1-8B-Instruct with other models