Hermes 2 Theta Llama-3 70B
| Released | 2024-06-20 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 31.6 (early, few results) |
| Provider | Nous Research |
| Weights | Open weights |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 31.6 | 3 | |
| Overall: Coding | 32.6 | 1 | |
| Overall: Reasoning | 31.5 | 3 | |
| Overall: Agentic work | 32.6 | 1 | |
| Reasoning | 32.6 | 1 | |
| Math | 30.0 | 2 |
Evidence
Reasoning 32.6 ±4.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 37.5% | Epoch AI | 2025-01-27 |
Math 30.0 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MATH Level 5 | 22.7% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 2.5% | Epoch AI | 2025-04-01 |
Names matched to this model
hermes-2-theta-llama-3-70b