GPT-6 Sol

Released2026-09-22
Price per 1M$2.00 in · $10.00 out
Overall score62.4 · rank 15
Context window1,050,000 tokens
ProviderOpenAI
WeightsProprietary

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 62.4 15 37
Overall: Coding 62.2 14 27
Overall: Reasoning 63.7 13 17
Overall: Agentic work 62.4 14 25
Overall: Frontend 61.3 14 9
Coding 62.0 15 6
Agents 62.1 14 8
Reasoning 64.7 13 11
Math 65.0 10 4
Knowledge 59.4 30 2
Frontend 61.8 12 2
General 64.3 11 3
Multimodal 56.6 38 1
Value vs price+10.527

Buzz

Posts on XAbout 22 a day
Mood10% positive, 10% negative
Hacker News3 mentions this week
Checked2026-11-11

Configurations

ConfigurationBalancedBenchmarks
Unspecified setting 63.3 ±4.3 5
High 60.5 ±4.8 6
Low 56.2 ±4.9 5
Max 61.6 ±0.8 31
Medium 59.3 ±4.9 5
Non-reasoning 51.5 ±4.9 5
Extra High 62.4 ±4.2 6

Evidence

Coding 62.0 ±1.4

BenchmarkResultSourceDate
FrontierCode 49.3% Epoch AI 2026-11-11
WeirdML v3 19.7% Epoch AI 2026-11-11
MirrorCode 48.9% Epoch AI 2026-10-29
IOI 82.6% Vals AI 2026-10-29
SciCode 57.6% Epoch AI 2026-11-11
ProgramBench 2.0% Vals AI 2026-11-09

Agents 62.1 ±1.3

BenchmarkResultSourceDate
Terminal-Bench 4 50.3% Terminal-Bench 2026-09-22
SRE Bench 30.5% Vals AI 2026-11-05
Terminal-Bench-Science 30.0% Vals AI 2026-11-09
APEX-Agents 54.3% Epoch AI 2026-11-11
Terminal-Bench 4.0 (Vals run) 44.4% Vals AI 2026-11-09
Terminal-Bench 2.1 (Vals run) 83.1% Vals AI 2026-10-01
Tax Agent Bench 15.0% Vals AI 2026-11-09
Vending-Bench 2 $14,428 Epoch AI 2026-11-11
CyberBench v1.1 78.0% Vals AI 2026-11-05

Reasoning 64.7 ±1.3

BenchmarkResultSourceDate
ARC-AGI-2 89.6% Epoch AI 2026-11-11
ARC-AGI-2 (ARC Prize verified) 89.6% ARC Prize 2026-11-11
Extended NYT Connections 90.1% Lech Mazur 2026-11-10
MysteryMechanism 30.2% Vals AI 2026-11-09
GPQA Diamond 94.3% Epoch AI 2026-09-22
CritPt 30.9% Epoch AI 2026-11-11
ARC-AGI-1 (ARC Prize verified) 95.5% ARC Prize 2026-11-11
ARC-AGI-1 95.5% Epoch AI 2026-11-11
SimpleBench 73.1% SimpleBench 2026-09-24
BioMysteryBench 74.8% Vals AI 2026-11-09
ARC-AGI-3 23.0% ARC Prize 2026-11-11
Chess Puzzles 56.0% Epoch AI 2026-10-13
Mystery Game Puzzles 56.0% Epoch AI 2026-09-22

Math 65.0 ±1.7

BenchmarkResultSourceDate
FrontierMath Tiers 1-3 89.8% Epoch AI 2026-09-22
FrontierMath Tier 4 90.0% Epoch AI 2026-09-22
OTIS Mock AIME 2024-2025 100.0% Epoch AI 2026-09-22
ProofBench v1.1 83.0% Vals AI 2026-11-09
ProofBench 83.0% Epoch AI 2026-11-11

Knowledge 59.4 ±2.7

BenchmarkResultSourceDate
SimpleQA Verified 60.7% Epoch AI 2026-09-22
Legal Research Bench 28.8% Vals AI 2026-11-09

Frontend 61.8 ±0.7

BenchmarkResultSourceDate
Vibe Code Bench v1.1 87.8% Vals AI 2026-11-09
LMArena WebDev 1,674 LMArena 2026-11-09

General 64.3 ±7.0

BenchmarkResultSourceDate
LMArena Text 1,457 LMArena 2026-11-09
EQ-Bench Creative Writing v3 2,126 EQ-Bench 2026-11-11
EQ-Bench Longform Creative Writing 82.8% EQ-Bench 2026-11-11

Multimodal 56.6 ±4.1

BenchmarkResultSourceDate
LMArena Vision 1,258 LMArena 2026-11-09

Results not used in the score

BenchmarkResultSourceWhy not used
ARC-AGI-1 92.7% Epoch AI A stronger configuration result was used
ARC-AGI-1 91.0% Epoch AI A stronger configuration result was used
ARC-AGI-1 83.7% Epoch AI A stronger configuration result was used
ARC-AGI-1 72.2% Epoch AI A stronger configuration result was used
ARC-AGI-1 29.3% Epoch AI A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 92.7% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 91.0% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 83.7% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 72.2% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 29.3% ARC Prize A stronger configuration result was used
ARC-AGI-2 78.1% Epoch AI A stronger configuration result was used
ARC-AGI-2 68.9% Epoch AI A stronger configuration result was used
ARC-AGI-2 57.8% Epoch AI A stronger configuration result was used
ARC-AGI-2 31.5% Epoch AI A stronger configuration result was used
ARC-AGI-2 1.7% Epoch AI A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 78.1% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 68.9% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 57.8% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 31.5% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 1.7% ARC Prize A stronger configuration result was used
ARC-AGI-3 4.6% ARC Prize A stronger configuration result was used
ARC-AGI-3 1.8% ARC Prize A stronger configuration result was used
ARC-AGI-3 9.5% ARC Prize A stronger configuration result was used
ARC-AGI-3 0.9% ARC Prize A stronger configuration result was used
ARC-AGI-3 5.9% ARC Prize A stronger configuration result was used
ARC-AGI-3 0.4% ARC Prize A stronger configuration result was used
ARC-AGI-3 4.9% ARC Prize A stronger configuration result was used
ARC-AGI-3 0.1% ARC Prize A stronger configuration result was used
ARC-AGI-3 1.8% ARC Prize A stronger configuration result was used
ARC-AGI-3 0.3% ARC Prize A stronger configuration result was used
ARC-AGI-3 1.2% ARC Prize A stronger configuration result was used
CritPt 28.0% Epoch AI A stronger configuration result was used
CritPt 25.4% Epoch AI A stronger configuration result was used
CritPt 24.6% Epoch AI A stronger configuration result was used
CritPt 16.3% Epoch AI A stronger configuration result was used
CritPt 4.0% Epoch AI A stronger configuration result was used
SciCode 55.1% Epoch AI A stronger configuration result was used
SciCode 54.9% Epoch AI A stronger configuration result was used
SciCode 53.8% Epoch AI A stronger configuration result was used
SciCode 50.2% Epoch AI A stronger configuration result was used
SciCode 47.3% Epoch AI A stronger configuration result was used

Names matched to this model

gpt-6-sol

Compare GPT-6 Sol with other models