Muse Spark 1.1
| Released | 2026-04-08 |
|---|---|
| Price per 1M | $1.25 in · $4.25 out |
| Overall score | 58.6 · rank 43 |
| Context window | 1,048,576 tokens |
| Provider | Meta |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 58.6 | 43 | 29 |
| Overall: Coding | 58.0 | 49 | 17 |
| Overall: Reasoning | 58.7 | 50 | 8 |
| Overall: Agentic work | 58.0 | 54 | 15 |
| Overall: Frontend | 57.3 | 47 | 9 |
| Coding | 58.2 | 45 | 5 |
| Agents | 57.4 | 57 | 6 |
| Reasoning | 60.2 | 43 | 4 |
| Math | 56.8 | 56 | 1 |
| Knowledge | 58.8 | 36 | 3 |
| Frontend | 56.6 | 42 | 2 |
| General | 62.2 | 18 | 6 |
| Multimodal | 59.3 | 25 | 2 |
| Value vs price | +8.8 | 38 |
Configurations
| Configuration | Balanced | Benchmarks |
|---|---|---|
| Unspecified setting | 60.2 ±2.0 | 12 |
| High | 60.8 ±5.3 | 3 |
| Extra High | 58.7 ±1.5 | 16 |
Evidence
Coding 58.2 ±2.4
| Benchmark | Result | Source | Date |
|---|---|---|---|
| DeepSWE | 53.3% | Epoch AI | 2026-11-11 |
| SWE-bench Verified (Vals run) | 82.0% | Vals AI | 2026-09-01 |
| SciCode | 58.8% | Epoch AI | 2026-11-11 |
| LiveCodeBench (Vals run) | 85.9% | Vals AI | 2026-09-01 |
| ProgramBench | 0.0% | Vals AI | 2026-11-09 |
Agents 57.4 ±2.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| APEX-Agents | 31.8% | Epoch AI | 2026-11-11 |
| Terminal-Bench 2.1 (Vals run) | 69.3% | Vals AI | 2026-10-01 |
| OSWorld-Verified | 80.7% | OSWorld-Verified | 2026-07-09 |
| tau2-bench Banking Knowledge | 40.5% | tau2-bench | 2026-07-23 |
| SkillsBench | 59.2% | Vals AI | 2026-10-29 |
| Vending-Bench 2 | $6,520 | Epoch AI | 2026-11-11 |
Reasoning 60.2 ±2.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Extended NYT Connections | 84.9% | Lech Mazur | 2026-11-10 |
| GPQA Diamond (Vals run) | 91.2% | Vals AI | 2026-09-01 |
| CritPt | 15.1% | Epoch AI | 2026-11-11 |
| Chess Puzzles | 34.0% | Epoch AI | 2026-10-13 |
Math 56.8 ±3.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| ProofBench | 39.0% | Epoch AI | 2026-11-11 |
Knowledge 58.8 ±3.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| SimpleQA Verified | 57.8% | Epoch AI | 2026-08-31 |
| MMLU-Pro (Vals run) | 88.7% | Vals AI | 2026-09-01 |
| Legal Research Bench | 38.0% | Vals AI | 2026-11-09 |
Frontend 56.6 ±0.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| Vibe Code Bench v1.1 | 72.2% | Vals AI | 2026-11-09 |
| LMArena WebDev | 1,542 | LMArena | 2026-11-09 |
General 62.2 ±1.6
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LLM Debate Benchmark | 1,631 | Lech Mazur | 2026-10-26 |
| EQ-Bench 4 | 1,244 | EQ-Bench | 2026-10-24 |
| EQ-Bench Creative Writing v3 | 1,928 | EQ-Bench | 2026-11-11 |
| LMArena Text | 1,491 | LMArena | 2026-11-09 |
| Creative Story-Writing (Lech Mazur) | 61.0% | Lech Mazur | 2026-10-23 |
| EQ-Bench Longform Creative Writing | 70.6% | EQ-Bench | 2026-11-11 |
Multimodal 59.3 ±2.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMMU-Pro (Vals run) | 86.6% | Vals AI | 2026-09-01 |
| LMArena Vision | 1,279 | LMArena | 2026-11-09 |
Results not used in the score
| Benchmark | Result | Source | Why not used |
|---|---|---|---|
| CritPt | 15.1% | Epoch AI | A stronger configuration result was used |
| SciCode | 58.8% | Epoch AI | A stronger configuration result was used |
Names matched to this model
muse-spark-1-1