Sources
In use
| Source | Role | License | Results | Every | Updated | State |
|---|---|---|---|---|---|---|
| Epoch AI Epoch AI |
Evaluator | CC BY 4.0 | 3,777 | 6h | 2026-11-11 | Healthy |
| MathArena SRI Lab, ETH Zurich |
Evaluator | None stated | 37 | 6h | 2026-11-11 | Healthy 3 unmatched |
| Vals AI Vals AI |
Evaluator | None stated | 1,516 | 6h | 2026-11-11 | Healthy 26 unmatched |
| models.dev models.dev (SST) |
Metadata | MIT | 0 | 6h | 2026-11-11 | Healthy |
| ARC Prize ARC Prize Foundation |
Original | Internal use | 633 | 6h | 2026-11-11 | Healthy 21 unmatched |
| BFCL UC Berkeley Gorilla team |
Original | Apache 2.0 | 80 | 24h | 2026-11-11 | Healthy 29 unmatched |
| EQ-Bench Sam Paech |
Original | None stated | 262 | 24h | 2026-11-11 | Healthy 44 unmatched |
| Kagi Kagi |
Original | None stated | 104 | 24h | 2026-11-11 | Healthy 37 unmatched |
| LMArena LMArena |
Original | CC BY 4.0 | 561 | 12h | 2026-11-11 | Healthy 148 unmatched |
| Lech Mazur Lech Mazur |
Original | None stated | 245 | 6h | 2026-11-11 | Healthy 9 unmatched |
| LiveBench LiveBench (Abacus.AI and collaborators) |
Original | None stated | 224 | 6h | 2026-11-11 | Healthy 2 unmatched |
| METR METR |
Original | None stated | 24 | 24h | 2026-11-11 | Healthy 1 unmatched |
| OSWorld-Verified XLANG Lab, University of Hong Kong |
Original | None stated | 27 | 24h | 2026-11-11 | Healthy 26 unmatched |
| SWE-rebench Nebius |
Original | None stated | 13 | 24h | 2026-11-11 | Healthy |
| SimpleBench SimpleBench team (AI Explained) |
Original | None stated | 101 | 6h | 2026-11-11 | Healthy 5 unmatched |
| Terminal-Bench Stanford / Laude Institute (Harbor) |
Original | Apache 2.0 | 35 | 6h | 2026-11-11 | Healthy |
| tau2-bench Sierra Research |
Original | MIT | 51 | 24h | 2026-11-11 | Healthy |
Reviewed, not used
| Source | Status | Why |
|---|---|---|
| SWE-bench board | Rejected | Stale; repeats Epoch's copy |
| LMArena Agent Arena | Candidate | Score scale not documented |
| OpenCompass, MMMU, OCRBench | Candidate | No data license or stale |
| LiteLLM price list | Candidate | Price cross-check only |
| Scale SEAL, HLE board | Rejected | Internal use only; Epoch has HLE |
| Artificial Analysis | Rejected | Needs an API key |
| OpenRouter | Rejected | Terms forbid copying |
| Open LLM Leaderboard | Rejected | Frozen since March 2025 |
| LLM-stats | Rejected | Vendor numbers; API blocked |
| BenchLeader, AGI Ranker | Rejected | Would count results twice |
| Vendor model cards | Rejected | Self-reported, not checked |
| LiveCodeBench, BigCodeBench, EvalPlus | Rejected | Stale or saturated |
| Design Arena | Rejected | Terms forbid crawlers |
| Yupp | Rejected | Behind an anti-bot wall |
| Fiction.LiveBench | Rejected | On hiatus; image only |
| LiveCodeBench Pro | Rejected | Site is gone |
| Aider polyglot (direct) | Rejected | Stale; Epoch has a copy |
Recent updates
| Started | Source | Outcome | Rows | New | Changed | Unmatched |
|---|---|---|---|---|---|---|
| 2026-11-11 15:33:24 UTC | METR | Ok | 26 | 0 | 0 | 1 |
| 2026-11-11 10:09:55 UTC | Vals AI | Ok | 1,605 | 3 | 0 | 85 |
| 2026-11-11 10:09:55 UTC | Terminal-Bench | Unchanged | 35 | 0 | 0 | 0 |
| 2026-11-11 10:09:55 UTC | SimpleBench | Unchanged | 111 | 0 | 0 | 0 |
| 2026-11-11 10:09:49 UTC | MathArena | Unchanged | 40 | 0 | 0 | 0 |
| 2026-11-11 10:09:45 UTC | LiveBench | Unchanged | 238 | 0 | 0 | 0 |
| 2026-11-11 10:09:42 UTC | Lech Mazur | Unchanged | 260 | 0 | 0 | 0 |
| 2026-11-11 10:09:41 UTC | Epoch AI | Ok | 4,609 | 37 | 0 | 0 |
| 2026-11-11 10:09:40 UTC | ARC Prize | Unchanged | 714 | 0 | 0 | 0 |
| 2026-11-11 10:09:38 UTC | models.dev | Ok | 580 | 0 | 0 | 0 |
| 2026-11-11 03:52:44 UTC | Vals AI | Ok | 1,605 | 10 | 0 | 85 |
| 2026-11-11 03:52:44 UTC | Terminal-Bench | Ok | 35 | 0 | 0 | 0 |
| 2026-11-11 03:52:44 UTC | tau2-bench | Ok | 51 | 0 | 0 | 0 |
| 2026-11-11 03:52:44 UTC | SWE-rebench | Ok | 13 | 1 | 0 | 0 |
| 2026-11-11 03:52:44 UTC | SimpleBench | Ok | 111 | 4 | 0 | 5 |
| 2026-11-11 03:52:44 UTC | OSWorld-Verified | Ok | 93 | 0 | 0 | 65 |
| 2026-11-11 03:52:44 UTC | METR | Ok | 26 | 0 | 0 | 1 |
| 2026-11-11 03:52:44 UTC | MathArena | Ok | 40 | 0 | 0 | 3 |
| 2026-11-11 03:52:44 UTC | LMArena | Ok | 742 | 6 | 0 | 168 |
| 2026-11-11 03:52:44 UTC | LiveBench | Ok | 238 | 0 | 0 | 14 |