GPT-6.1 Sol

Released2026-09-29
Price per 1M$2.00 in · $10.00 out
Overall score64.9 · rank 6
Context window1,050,000 tokens
ProviderOpenAI
WeightsProprietary

Scores

DimensionScoreRankBenchmarks
Overall: Balanced 64.9 6 49
Overall: Coding 64.3 8 38
Overall: Reasoning 68.1 3 21
Overall: Agentic work 64.3 8 35
Overall: Frontend 63.6 7 13
Coding 64.0 9 9
Agents 63.4 8 13
Reasoning 68.6 5 13
Math 69.6 2 6
Knowledge 64.3 6 2
Frontend 63.8 7 3
General 62.3 16 2
Multimodal 61.5 9 1
Value vs price+13.014

Buzz

Posts on XAbout 121 a day
Mood17% positive, 6% negative
Hacker News34 mentions this week
Checked2026-11-11

Configurations

ConfigurationBalancedBenchmarks
Unspecified setting 66.6 ±1.9 11
High 63.1 ±4.8 6
Low 60.3 ±4.9 5
Max 64.2 ±0.9 37
Medium 63.1 ±4.0 6
Extra High 66.2 ±4.2 6

Evidence

Coding 64.0 ±1.7

BenchmarkResultSourceDate
FrontierCode 50.2% Epoch AI 2026-11-11
Code Migration v1.1 77.3% Vals AI 2026-11-09
LiveBench 2.0 Coding 82.1% LiveBench 2026-11-06
WeirdML v3 38.3% Epoch AI 2026-11-11
MirrorCode 61.1% Epoch AI 2026-10-05
IOI 96.9% Vals AI 2026-10-29
SWE-bench Multimodal 43.5% Vals AI 2026-11-09
SciCode 55.8% Epoch AI 2026-11-11
ProgramBench 3.0% Vals AI 2026-11-09

Agents 63.4 ±1.3

BenchmarkResultSourceDate
Terminal-Bench 4 60.9% Terminal-Bench 2026-09-29
SRE Bench 50.8% Vals AI 2026-11-05
Terminal-Bench-Science 52.9% Vals AI 2026-11-09
Terminal-Bench 4.0 (Vals run) 55.1% Vals AI 2026-11-09
APEX-Agents 60.0% Epoch AI 2026-11-11
LiveBench 2.0 Agentic 65.6% LiveBench 2026-11-06
LiveBench 2.0 Browser Use 93.3% LiveBench 2026-11-06
EMB v1.1 (Excel financial modeling) 71.1% Vals AI 2026-11-09
LiveBench 2.0 Research 90.0% LiveBench 2026-11-06
Tax Agent Bench 21.8% Vals AI 2026-11-09
Finance Agent v2.1 61.8% Vals AI 2026-11-09
Vending-Bench 2 $12,861 Epoch AI 2026-11-11
HLAB-Vals 1.1 (legal agent) 6.3% Vals AI 2026-11-09
CyberBench v1.1 39.3% Vals AI 2026-11-05

Reasoning 68.6 ±1.3

BenchmarkResultSourceDate
ARC-AGI-2 94.2% Epoch AI 2026-11-11
ARC-AGI-2 (ARC Prize verified) 94.2% ARC Prize 2026-11-11
Extended NYT Connections 97.8% Lech Mazur 2026-11-10
MysteryMechanism 46.4% Vals AI 2026-11-09
GPQA Diamond 95.4% Epoch AI 2026-09-29
CritPt 31.7% Epoch AI 2026-11-11
ARC-AGI-1 (ARC Prize verified) 98.5% ARC Prize 2026-11-11
ARC-AGI-1 98.5% Epoch AI 2026-11-11
SimpleBench 82.9% SimpleBench 2026-10-01
BioMysteryBench 79.6% Vals AI 2026-11-09
ARC-AGI-3 96.4% ARC Prize 2026-11-11
Chess Puzzles 68.0% Epoch AI 2026-10-13
LiveBench 2.0 Reasoning 92.6% LiveBench 2026-11-06
Mystery Game Puzzles 80.0% Epoch AI 2026-09-29
LiveBench 2.0 Data Analysis 82.7% LiveBench 2026-11-06

Math 69.6 ±2.2

BenchmarkResultSourceDate
FrontierMath Tiers 1-3 93.7% Epoch AI 2026-09-29
FrontierMath Tier 4 100.0% Epoch AI 2026-09-29
MathArena ArXivMath (latest month) 90.4% MathArena 2026-11-11
OTIS Mock AIME 2024-2025 100.0% Epoch AI 2026-09-29
ProofBench v1.1 99.0% Vals AI 2026-11-09
ProofBench 99.0% Epoch AI 2026-11-11
MathArena BrokenArXiv (latest month) 80.3% MathArena 2026-11-11

Knowledge 64.3 ±2.7

BenchmarkResultSourceDate
SimpleQA Verified 73.9% Epoch AI 2026-09-29
Legal Research Bench 38.5% Vals AI 2026-11-09

Frontend 63.8 ±2.0

BenchmarkResultSourceDate
LiveBench 2.0 Design 79.6% LiveBench 2026-11-06
Vibe Code Bench v1.1 88.9% Vals AI 2026-11-09
LMArena WebDev 1,743 LMArena 2026-11-09

General 62.3 ±2.6

BenchmarkResultSourceDate
EQ-Bench 4 1,272 EQ-Bench 2026-10-24
LMArena Text 1,482 LMArena 2026-11-09

Multimodal 61.5 ±4.1

BenchmarkResultSourceDate
LMArena Vision 1,293 LMArena 2026-11-09

Results not used in the score

BenchmarkResultSourceWhy not used
ARC-AGI-1 96.5% Epoch AI A stronger configuration result was used
ARC-AGI-1 95.5% Epoch AI A stronger configuration result was used
ARC-AGI-1 98.5% Epoch AI A stronger configuration result was used
ARC-AGI-1 93.5% Epoch AI A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 96.5% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 95.5% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 98.5% ARC Prize A stronger configuration result was used
ARC-AGI-1 (ARC Prize verified) 93.5% ARC Prize A stronger configuration result was used
ARC-AGI-2 86.7% Epoch AI A stronger configuration result was used
ARC-AGI-2 91.7% Epoch AI A stronger configuration result was used
ARC-AGI-2 91.7% Epoch AI A stronger configuration result was used
ARC-AGI-2 76.7% Epoch AI A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 86.7% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 91.7% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 91.7% ARC Prize A stronger configuration result was used
ARC-AGI-2 (ARC Prize verified) 76.7% ARC Prize A stronger configuration result was used
ARC-AGI-3 52.7% ARC Prize A stronger configuration result was used
ARC-AGI-3 96.2% ARC Prize A stronger configuration result was used
ARC-AGI-3 10.6% ARC Prize A stronger configuration result was used
ARC-AGI-3 91.0% ARC Prize A stronger configuration result was used
ARC-AGI-3 26.7% ARC Prize A stronger configuration result was used
ARC-AGI-3 95.0% ARC Prize A stronger configuration result was used
ARC-AGI-3 39.9% ARC Prize A stronger configuration result was used
ARC-AGI-3 3.9% ARC Prize A stronger configuration result was used
ARC-AGI-3 82.8% ARC Prize A stronger configuration result was used
CritPt 27.7% Epoch AI A stronger configuration result was used
CritPt 30.0% Epoch AI A stronger configuration result was used
CritPt 31.7% Epoch AI A stronger configuration result was used
CritPt 24.9% Epoch AI A stronger configuration result was used
Extended NYT Connections 95.5% Lech Mazur A stronger configuration result was used
SciCode 54.2% Epoch AI A stronger configuration result was used
SciCode 53.2% Epoch AI A stronger configuration result was used
SciCode 55.7% Epoch AI A stronger configuration result was used
SciCode 53.2% Epoch AI A stronger configuration result was used

Names matched to this model

gpt-6-1-sol

Compare GPT-6.1 Sol with other models