Benchmark menu

Model results

Muse Spark 1.2

See how Muse Spark 1.2 performed, which reasoning settings were tested, how often it produced a working player program, and what those runs cost.

Muse Spark 1.2

Provider: Other

Rank
11
Status
Partial 3/3
Rank change
Baseline
Score
47.2
Last tested
2026-08-23
Settings tested
All settings tested

Why this result is partial: generation quality is below the publication threshold. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Available settings

MinimalMediumXHigh

Checked on 2026-08-08 · Provider documentation

Scores from tested settings

Tested settingScoreResult statusDisplay group
Minimal39.0Tested and includedBaseline
Medium51.3Tested and includedBalanced
XHigh51.3Tested and includedIntensive

How settings are grouped

  • Baseline: Minimal — tested and included
  • Balanced: Medium — tested and included
  • Intensive: XHigh — tested and included

Player program results

XHigh: 100% / 0% / 0% · n 2Medium: 88% / 0% / 12% · n 8Minimal: 88% / 12% / 0% · n 8 All settings tested

Generation cost

Average estimated cost
$0.05
Median estimated cost
$0.04
Estimated range
$0.02–$0.14
Cost data
18 combinations / 18 recorded runs
Observed total
$0.82
Price source
Provider-reported
Price list
boardgame-list-prices-2026-08-08
Average output
8.1k tokens
Output range
2.6k–31k tokens
Samples
18

Estimated cost gives equal weight to each model, game, and reasoning-setting combination.

Test setup

  • Combines this model's tested reasoning settings
  • Uses the standard GameBench player-program prompt