Score · relative 0–100: 1.6
Rank: 66
Status: Partial 3/3
Players generated: 2026-10-09
Match evidence updated: 2026-10-24
Results published: 2026-10-26

Compare in charts View player programs Back to leaderboard

Why this result is partial: every generation attempt of a reasoning setting failed, so that setting scores 0; generation quality is below the publication threshold. The rank uses the available reasoning-setting results.

Scores by reasoning setting

Full (Intensive group, tested and included)0.0
Low (Balanced group, tested and included)4.9
Non-thinking (Baseline group, tested and included)0.0

Every tested setting is included in the overall score.

Available settings and grouping

Available settings

Non-thinkingLowFull

Checked on 2026-09-03 · Provider documentation

How settings are grouped

Baseline: Non-thinking — tested and included
Balanced: Low — tested and included
Intensive: Full — tested and included

Scores by game

Go3 of 3 failed0.0
Chess3 of 3 failed0.0
Shogi3 of 3 failed0.0
Xiangqi2 of 3 failed12.9
Hex3 of 3 failed0.0
International Draughts3 of 3 failed0.0
Game of the Amazons3 of 3 failed0.0
Tumbleweed3 of 3 failed0.0

Each game counts every generation attempt, a failed one as 0 (“1 of 2 failed” marks games with failed attempts). Scores are relative within each game, across the included settings; they do not compare game difficulty.

What this result shows

Strongest included setting: Low (4.9).

Across included settings, the highest game score is Xiangqi (12.9); the lowest is 0.0, shared by 7 games. Each game counts every generation attempt, a failed one as 0. These are relative scores within each game, not direct comparisons of difficulty.

Match evidence measures these retained programs. It does not establish how a fresh generation will perform. Independent-generation variation is not estimated in this release.

Test protocol and evidence limits

Model identifier: ibm-granite/granite-4.2-8b
Provider route (catalog): openrouter
Prompt identity / profile: Not retained in this result set / Not retained in this result set
Prompt version: Not retained in this result set
Generation policy: Generation-quality admission policy (see methodology)
Requested output-token limits: 117964 (37 of 56 indexed attempts)

Generation evidence

Non-thinking: no working player program; every generation attempt failed, so the setting scores 0
Low: 1 contributing player programs across 1 games
Full: no working player program; every generation attempt failed, so the setting scores 0

Counts describe contributing programs, not independent replications: repairs and resends are not new independent samples. Independent-generation lineage is not retained.

Game	Reasoning group	Programs	Working-program strength	Raw rating	Combined record (W / D / L)
Xiangqi	Balanced	1 working of 1 attempt	38.8	1388.2	27 / 317 / 154

Each row covers all the model's programs in one game and setting. Strength and raw rating are attempt-weighted means; under them, each program's score and the lowest and highest rating describe the programs (not a confidence interval). The combined record adds up their matches: evidence volume, not strength.

Failures and budgets

23 model-code generation failures; 0 provider/infrastructure failures excluded from the generation denominator. Runtime player faults are separate: 0 recorded one-sided faults across contributing program rows. A crash or illegal move pinned on one program also counts as that program's loss in its match record; other faults, such as timeouts, are left out of rating evidence.

Repair/resend outcomes and available costs are included. Exact retry ceilings and execution budgets are not retained in this result set; see the methodology for the public policy. Do not infer a measured setting from a current provider catalog.

Player program results

Full: 0% / 0% / 100% · n 8Low: 0% / 13% / 87% · n 8Non-thinking: 0% / 0% / 100% · n 8 All three benchmark settings testedMany programs failed

Generation cost

$0.0045average estimated cost per game and reasoning setting

Median: $0.0029
Range: $0.0016–$0.01
Provider-reported total: $0.11
Cost data: 24 combinations · 24 runs
Price source: Provider-reported
Price list: boardgame-list-prices-2026-10-09
Average output: 14k tokens
Output range: 4.0k–39k tokens
Runs with output-token data: 24

How cost is measured

Comparison cost gives equal weight to each model, game, and reasoning-setting combination. Recorded generation attempts include repairs and resends when cost evidence is available; runtime compute and service operation are excluded. Cost and output-token counts use separate telemetry denominators. A list-price estimate is not actual expenditure; mixed evidence is not a uniform standard-price comparison.

Test protocol

Combines this model's tested reasoning settings
Player-program generation; retained protocol details are under “Test protocol and evidence limits” above

Granite 4.2 8B