Llama 3.1-405B
| Released | 2024-07-23 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 36.6 (early, few results) |
| Provider | Meta |
| Weights | Open weights |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 36.6 | 6 | |
| Overall: Coding | 39.2 | 3 | |
| Overall: Reasoning | 37.6 | 5 | |
| Overall: Agentic work | 39.2 | 3 | |
| Reasoning | 39.2 | 3 | |
| Math | 35.6 | 2 | |
| General | 33.8 | 1 |
Evidence
Reasoning 39.2 ±3.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 50.9% | Epoch AI | 2025-01-27 |
| CritPt | 0.0% | Epoch AI | 2026-11-11 |
| SimpleBench | 23.0% | SimpleBench | 2026-11-11 |
| SimpleBench | 23.0% | Epoch AI | 2026-11-11 |
Math 35.6 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 49.8% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 9.7% | Epoch AI | 2025-02-25 |
General 33.8 ±3.5
| Benchmark | Result | Source | Date |
|---|---|---|---|
| EQ-Bench Creative Writing v3 | 868 | EQ-Bench | 2026-11-11 |
Names matched to this model
llama-3-1-405b, llama-3-1-405b-instruct, llama3-1-405b-instruct-q4-k