Benchmark menu

Model results

Grok Build 0.1

See how Grok Build 0.1 performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

Grok Build 0.1

Provider: xAI

Rank
23
Status
Partial 1/3
Rank change
Baseline
Score
39.5
Last tested
2026-08-05
Settings tested
Intensive not supported; Baseline not supported

Why this result is partial: one or more bracket scores are missing; three distinct provider settings are not documented; one or more documented settings are untested or ineligible; generation-quality evidence is missing. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Available settings

Reasoning enabled

Checked on 2026-07-21 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
Reasoning enabled39.5Tested and includedBalanced

How settings are grouped

  • Baseline: Not available for this model
  • Balanced: Reasoning enabled — tested and included
  • Intensive: Not available for this model

Player program results

Reasoning enabled: 0% / 100% / 0% · n 8 Intensive not supportedBaseline not supportedMany programs needed repair

Generation cost

Average estimated cost
$0.06
Median estimated cost
$0.06
Estimated range
$0.05–$0.07
Cost data
8 combinations / 8 recorded runs
Observed total
$0.49
Price source
Provider-reported
Price list
Not recorded for this older data
Average output
22k tokens
Output range
16k–30k tokens
Samples
8

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt