phi-3-medium 14B
| Released | 2024-04-23 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 28.3 (early, few results) |
| Provider | Microsoft |
| Weights | Open weights |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 28.3 | 2 | |
| Overall: Coding | 28.2 | 1 | |
| Overall: Reasoning | 28.3 | 2 | |
| Overall: Agentic work | 28.2 | 1 | |
| Reasoning | 28.2 | 1 | |
| Math | 28.5 | 1 |
Evidence
Reasoning 28.2 ±4.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 27.6% | Epoch AI | 2025-01-31 |
Math 28.5 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 17.6% | Epoch AI | 2025-01-31 |
Names matched to this model
phi-3-medium-128k-instruct, phi-3-medium-14b