Hermes 2 Theta Llama-3 70B

Released2024-06-20
Price per 1MNot listed
Overall score31.6 (early, few results)
ProviderNous Research
WeightsOpen weights

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 31.6 3
Overall: Coding 32.6 1
Overall: Reasoning 31.5 3
Overall: Agentic work 32.6 1
Reasoning 32.6 1
Math 30.0 2

Evidence

Reasoning 32.6 ±4.6

BenchmarkResultSourceDate
GPQA Diamond 37.5% Epoch AI 2025-01-27

Math 30.0 ±2.0

BenchmarkResultSourceDate
MATH Level 5 22.7% Epoch AI 2025-01-27
OTIS Mock AIME 2024-2025 2.5% Epoch AI 2025-04-01

Names matched to this model

hermes-2-theta-llama-3-70b

Compare Hermes 2 Theta Llama-3 70B with other models