Mistral Nemo
| Released | 2024-07-18 |
|---|---|
| Price per 1M | $0.10 in · $0.12 out |
| Overall score | 31.2 · rank 231 |
| Context window | 128,000 tokens |
| Provider | Mistral |
| Weights | Open weights |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 31.2 | 231 | 6 |
| Overall: Coding | 32.3 | 222 | 3 |
| Overall: Reasoning | 27.9 | 231 | 2 |
| Overall: Agentic work | 33.0 | 224 | 3 |
| Agents | 33.9 | 176 | 2 |
| Reasoning | 29.3 | 227 | 1 |
| Math | 26.0 | 195 | 1 |
| General | 34.1 | 178 | 2 |
| Value vs price | −9.8 | 178 |
Evidence
Agents 33.9 ±3.2
Reasoning 29.3 ±4.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 29.9% | Epoch AI | 2025-01-27 |
Math 26.0 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 10.8% | Epoch AI | 2025-01-27 |
General 34.1 ±3.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| EQ-Bench Creative Writing v3 | 878 | EQ-Bench | 2026-11-11 |
| EQ-Bench Longform Creative Writing | 28.7% | EQ-Bench | 2026-11-11 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| BFCL v4 | 19.3% | BFCL | A stronger configuration result was used |
Names matched to this model
mistral-nemo, mistral-nemo-base-2407, mistral-nemo-instruct-2407, open-mistral-nemo-2407