Benchmark menu

Model results

GPT-5.4 Nano

See how GPT-5.4 Nano performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

GPT-5.4 Nano

Provider: OpenAI

Rank
26
Status
Partial 2/3
Rank change
Baseline
Score
37.9
Last tested
2026-08-05
Settings tested
Missing Intensive

Why this result is partial: one or more bracket scores are missing; one or more documented settings are untested or ineligible; generation-quality evidence is missing. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Available settings

NoneLowMediumHighXHigh

Checked on 2026-07-21 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
None36.1Tested and includedBaseline
Medium39.7Tested and includedBalanced

How settings are grouped

  • Baseline: None — tested and included
  • Balanced: Medium — tested and included
  • Intensive: XHigh — available, not tested in the current results

Player program results

Medium: 31% / 44% / 25% · n 16None: 31% / 44% / 25% · n 16 Missing IntensiveMany programs failed

Generation cost

Average estimated cost
$0.03
Median estimated cost
$0.02
Estimated range
$0.0049–$0.27
Cost data
17 combinations / 34 recorded runs
Observed total
$1.08
Price source
Combined: Recorded attempt + Standard list-price estimate
Price list
boardgame-list-prices-2026-07-12 + boardgame-list-prices-2026-08-08
Average output
22k tokens
Output range
2.7k–256k tokens
Samples
34

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt