Benchmark menu

Model results

GPT-5.6 Sol

See how GPT-5.6 Sol performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

GPT-5.6 Sol

Provider: OpenAI

Rank
3
Status
Complete 3/3
Rank change
Baseline
Score
69.9
Last tested
2026-08-23
Settings tested
All settings tested

Scores by reasoning setting

Available settings

NoneLowMediumHighXHighMax

Checked on 2026-07-21 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
None55.8Tested and includedBaseline
Medium66.5Tested and includedBalanced
XHigh87.3Tested and includedIntensive

How settings are grouped

  • Baseline: None — tested and included
  • Balanced: Medium — tested and included
  • Intensive: XHigh — tested and included

Player program results

XHigh: 88% / 12% / 0% · n 8Medium: 100% / 0% / 0% · n 8None: 100% / 0% / 0% · n 8 All settings tested

Generation cost

Average estimated cost
$0.38
Median estimated cost
$0.23
Estimated range
$0.10–$1.17
Cost data
24 combinations / 24 recorded runs
Observed total
$9.23
Price source
Standard list-price estimate
Price list
boardgame-list-prices-2026-08-08
Average output
11k tokens
Output range
1.9k–35k tokens
Samples
24

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt