Benchmark menu

Model results

GPT 4.1

See how GPT 4.1 performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

GPT 4.1

Provider: OpenAI

Rank
20
Status
Partial 1/3
Rank change
Baseline
Score
41.5
Last tested
2026-08-05
Settings tested
Intensive not supported; Balanced not supported

Why this result is partial: one or more bracket scores are missing; three distinct provider settings are not documented; one or more documented settings are untested or ineligible; generation-quality evidence is missing. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Available settings

None

Checked on 2026-07-21 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
None41.5Tested and includedBaseline

How settings are grouped

  • Baseline: None — tested and included
  • Balanced: Not available for this model
  • Intensive: Not available for this model

Player program results

None: 63% / 37% / 0% · n 8 Intensive not supportedBalanced not supported

Generation cost

Average estimated cost
$0.06
Median estimated cost
$0.04
Estimated range
$0.03–$0.09
Cost data
8 combinations / 8 recorded runs
Observed total
$0.46
Price source
Standard list-price estimate
Price list
boardgame-list-prices-2026-08-08
Average output
4.4k tokens
Output range
2.3k–7.6k tokens
Samples
8

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt