Gemini 1.5 Flash (Sep 2024)
| Released | 2024-08-27 |
|---|---|
| Price per 1M | Not listed |
| Overall score | 34.7 · rank 220 |
| Provider | |
| Weights | Proprietary |
Scores
| Dimension | Score | Rank | Benchmarks |
|---|---|---|---|
| Overall: Balanced | 34.7 | 220 | 11 |
| Overall: Coding | 34.5 | 212 | 3 |
| Overall: Reasoning | 34.5 | 219 | 5 |
| Overall: Agentic work | 34.6 | 220 | 3 |
| Overall: Frontend | 36.7 | 193 | 4 |
| Coding | 34.3 | 193 | 1 |
| Agents | 34.4 | 174 | 1 |
| Reasoning | 36.1 | 218 | 1 |
| Math | 36.8 | 175 | 3 |
| Knowledge | 27.0 | 164 | 1 |
| General | 35.6 | 173 | 1 |
| Multimodal | 44.0 | 93 | 3 |
Evidence
Coding 34.3 ±5.3
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LiveCodeBench (Vals run) | 36.9% | Vals AI | 2026-09-01 |
Agents 34.4 ±7.1
Reasoning 36.1 ±4.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| GPQA Diamond | 47.3% | Epoch AI | 2025-01-27 |
| GPQA Diamond (Vals run) | 46.0% | Vals AI | 2026-09-01 |
Math 36.8 ±2.0
| Benchmark | Result | Source | Date |
|---|---|---|---|
| FrontierMath Tiers 1-3 (2025 set) | 0.0% | Epoch AI | 2025-03-07 |
| MATH Level 5 | 61.9% | Epoch AI | 2025-01-27 |
| OTIS Mock AIME 2024-2025 | 16.3% | Epoch AI | 2025-02-25 |
Knowledge 27.0 ±4.7
| Benchmark | Result | Source | Date |
|---|---|---|---|
| MMLU-Pro (Vals run) | 65.6% | Vals AI | 2026-09-01 |
General 35.6 ±4.1
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Text | 1,309 | LMArena | 2026-11-09 |
Multimodal 44.0 ±9.9
| Benchmark | Result | Source | Date |
|---|---|---|---|
| LMArena Vision | 1,142 | LMArena | 2026-11-09 |
| MMMU-Pro (Vals run) | 57.2% | Vals AI | 2026-09-01 |
| GeoBench | 76.0% | Epoch AI | 2026-11-11 |
Names matched to this model
gemini-1-5-flash-002, gemini-1-5-flash-exp-0827, gemini-1-5-flash-sep-2024