Benchmark menu

Per-game leaderboard

GB2-03: Shogi

First compare each model and reasoning setting for GB2-03: Shogi. Then inspect the individual player programs behind those combined results.

Shogi

Shogi is a 9x9 chess-family game with promotion zones, captured-piece drops, repetition handling, and impasse scoring.

Scores here compare player programs using DuelLab's encoded rules for Shogi; they are not a broad measure of human play strength.

GB2-03: Shogi by model and setting

Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and the rating-evidence index combine those contributing programs. A zero index is a clipped endpoint, not zero uncertainty about future generations.

Reasoning level: Reasoning Variants Game: GB2-03: Shogi
GB2-03: Shogi - Reasoning Variants
Rank Model Reasoning Score Raw Elo W / D / L Rating-evidence index
1GPT-6 AstraXHigh100.02164.6229 / 8 / 10.0
2Claude Opus 5XHigh90.42071.2246 / 5 / 130.1
3Claude Fable 5.1XHigh89.92057.1420 / 20 / 200.0
4Claude Fable 5.1Low83.41987.6167 / 48 / 170.0
5Claude Fable 5.1Medium82.21975.0198 / 18 / 200.0
6GPT-6 AstraMedium81.81971.0163 / 67 / 80.0
7Claude Opus 5.5XHigh79.71969.967 / 1 / 016.4
8GLM 5.3Max77.31921.4208 / 23 / 370.0
9GPT-6 SolXHigh75.81930.660 / 0 / 418.3
10Claude Fable 5XHigh72.71873.7146 / 73 / 230.0
11Claude Opus 5Medium71.81870.8256 / 5 / 420.0
12Claude Opus 5.5Medium71.71885.556 / 3 / 717.3
13Qwen3.8 2.4t A95BXHigh70.61851.296 / 103 / 410.0
14Gemini 3.8 FlashMedium66.21803.7159 / 62 / 190.0
15GPT-5.6 SolXHigh61.01745.2247 / 7 / 590.0
16GLM 5.3 FlashMax60.61743.9133 / 54 / 630.0
17GLM 5.3High60.01738.6150 / 29 / 500.0
18Gemini 3.8 FlashHigh59.61734.1144 / 23 / 640.0
19GPT-6 AstraLow59.41731.0116 / 105 / 230.0
20Grok 4.7Medium58.31744.147 / 6 / 1118.3
21GLM 5.3 FlashHigh57.81714.7120 / 61 / 560.0
22GLM-5.3 FlashXMax57.81736.452 / 1 / 1516.4
23Ox AlphaMax57.31711.2614 / 211 / 2540.0
24GPT-5.6 SolMedium56.71699.2180 / 38 / 1050.0
25Grok 4.6Medium56.31698.8113 / 61 / 580.0
26Gemini 3.5 FlashHigh55.61690.7103 / 67 / 720.0
27Gemini 3.6 FlashHigh53.71666.9201 / 34 / 1050.0
28GPT-6 SolMedium53.41691.739 / 5 / 2018.3
29Qwen3.8 Max 0902XHigh51.71669.556 / 3 / 1514.0
30Hy4 PreviewHigh50.81640.5140 / 23 / 690.0
31Hy4 PreviewNone50.51636.680 / 92 / 700.0
32Kimi K3High49.61622.7159 / 104 / 800.0
33Muse Spark 1.3XHigh48.51615.095 / 86 / 560.0
34GPT-6 SolNone48.31635.049 / 7 / 1415.6
35DeepSeek V4 Pro 0813Max48.21611.5136 / 27 / 850.0
36Qwen3.8 MaxXHigh48.11610.6120 / 33 / 980.0
37Gemini 3.5 FlashMedium47.91609.8107 / 57 / 650.0
38Claude Sonnet 5XHigh44.71571.797 / 107 / 1150.0
39InklingMedium44.71570.3168 / 62 / 1110.0
40Qwen3.8 MaxMedium43.81564.896 / 74 / 860.0
41Ox AlphaHigh42.51550.5826 / 336 / 6840.0
42Qwen3.8 Max 0902Medium42.51573.135 / 10 / 2515.6
43Muse Spark 1.2XHigh41.71537.1177 / 60 / 1610.0
44Qwen3.8 FlashEnabled41.61541.5125 / 50 / 640.0
45GLM-5.3 FlashXHigh41.51562.527 / 10 / 3116.4
46Qwen3.8 27BMedium41.11532.4114 / 84 / 1230.0
47Gemini 3.8 FlashLow40.91531.4123 / 73 / 970.0
48Gemini 3.6 FlashMinimal40.01518.6319 / 236 / 2780.0
49DeepSeek V4.1 FlashMax39.81546.534 / 6 / 2418.3
50GLM 5.3 FlashLow38.01502.880 / 81 / 870.0
51Claude Opus 4.5Medium37.71495.082 / 150 / 1290.0
52Grok 4.5Medium37.51504.352 / 62 / 400.0
53Inkling SmallNone37.11493.162 / 142 / 440.0
54GPT-5.6 SolNone37.01487.0122 / 156 / 1230.0
55Gemini 3.6 FlashMedium36.91487.2245 / 146 / 3070.0
56Kimi K3Max36.91485.692 / 184 / 1180.0
57Muse Spark 1.3Minimal36.81487.3129 / 77 / 1020.0
58Claude Sonnet 5None36.71484.4115 / 144 / 1270.0
59MiMo-V2.6-FlashEnabled36.11505.737 / 5 / 2616.4
60Grok 4.6XHigh36.01479.1122 / 81 / 1130.0
61DeepSeek V4.1 FlashHigh35.71501.932 / 12 / 2217.3
62Qwen3.8 2.4t A95BLow35.71476.8101 / 45 / 1250.0
63Muse Spark 1.3Medium35.61476.7106 / 45 / 1010.0
64InklingNone35.51482.897 / 106 / 1010.0
65GPT-5.5XHigh35.21478.857 / 52 / 510.0
66Qwen3.8 2.4t A95BMedium35.11468.669 / 147 / 1010.0
67GLM 5.3Low34.61464.470 / 114 / 1110.0
68Kimi K3Low34.31457.9160 / 105 / 1410.0
69GPT 4.1None34.21467.859 / 43 / 700.0
70MiMo-V2.5Reasoning34.21468.837 / 74 / 430.0
71Qwen3.8 Max 0902Low34.11487.226 / 11 / 2320.3
72Claude Opus 5.5Low33.31474.65 / 50 / 1515.6
73Minimax M3None33.21455.656 / 59 / 650.0
74Gemini 3.5 Flash LiteHigh32.81442.1288 / 167 / 3010.0
75Claude Opus 4.5Historical32.71454.949 / 36 / 490.0
76DeepSeek V4 ProXHigh32.31439.185 / 137 / 1060.0
77GPT-5.4 MiniNone32.21447.85 / 132 / 130.0
78Ox AlphaLow32.11439.6430 / 1007 / 6240.0
79Claude Sonnet 5Medium32.01434.598 / 119 / 1570.0
80Mistral Medium 3.5None32.01438.769 / 75 / 1020.0
81Qwen3.8 FlashNone31.81436.166 / 87 / 1010.0
82Gemini 3.5 Flash LiteMinimal31.71429.4170 / 111 / 1770.0
83GPT-6 LunaXHigh31.41455.423 / 3 / 4216.4
84Mistral Medium 3.5High31.21430.960 / 81 / 910.0
85InklingMax30.81419.9123 / 159 / 1520.0
86Grok 4.6Low30.81426.21 / 214 / 270.0
87Muse Glimmer 30BLow30.61424.365 / 105 / 760.0
88GPT-5.4 MiniMedium30.61429.735 / 76 / 520.0
89GPT-6 LunaMedium30.61447.219 / 13 / 3417.3
90Claude Opus 5None30.41428.9139 / 51 / 1180.0
91DeepSeek V4 Pro 0813None30.41422.239 / 123 / 780.0
92Muse Spark 1.2Medium30.11413.9127 / 116 / 1420.0
93GLM-5.2XHigh30.11419.247 / 119 / 700.0
94Qwen3.8 MaxMinimal30.11417.960 / 121 / 780.0
95GPT-5.6 TerraXHigh30.01418.951 / 98 / 750.0
96Muse Spark 1.2Minimal29.91411.4161 / 61 / 1720.0
97GPT-5.4Medium29.91411.970 / 189 / 1110.0
98Hy4 PreviewLow29.81416.227 / 151 / 530.0
99GPT-OSS 120BLow29.81415.859 / 73 / 1020.0
100MiMo-V2.6-ProNone29.71437.020 / 13 / 3516.4
101Seed 2.0 CodeMedium29.51411.662 / 57 / 1310.0
102Laguna S 2.1Enabled29.21403.3169 / 316 / 3370.0
103GPT-OSS 120BHigh29.01407.769 / 95 / 770.0
104GLM-5.2Reasoning28.91415.460 / 111 / 970.3
105DeepSeek V4 FlashHigh28.81405.551 / 128 / 520.0
106Muse Glimmer 30BXHigh28.61403.447 / 114 / 770.0
107Inkling SmallMax28.11395.7100 / 76 / 1120.0
108DeepSeek V4 Pro 0813High28.01393.4108 / 48 / 1620.0
109GLM-5.3 FlashXLow27.71416.915 / 16 / 3517.3
110GPT-5.6 LunaMedium27.51386.488 / 135 / 1460.0
111GPT-6 LunaNone27.51414.919 / 10 / 3518.3
112LongCat 2.0Enabled27.51385.587 / 165 / 1310.0
113Mercury 2.5 PreviewNone27.41385.989 / 103 / 1390.0
114MiMo-V2.6-FlashNone27.21411.715 / 14 / 3717.3
115Claude Fable 5Low27.21387.941 / 115 / 840.0
116DeepSeek V4 FlashMedium26.91395.734 / 31 / 532.1
117LongCat 2.0None26.91390.667 / 125 / 1180.0
118GPT-5.4XHigh26.81378.4111 / 138 / 1460.0
119GLM-5.2Reasoning26.61382.054 / 94 / 940.0
120GPT-5.5None26.61387.636 / 61 / 590.0
121Seed 2.0 CodeHigh26.61378.372 / 110 / 1220.0
122Claude Opus 4.5None25.41373.529 / 86 / 610.0
123DeepSeek V4.1 FlashNone25.31389.319 / 20 / 3115.6
124GLM-5.2Medium25.21375.18 / 83 / 430.0
125Inkling SmallMedium25.11364.963 / 94 / 940.0
126DeepSeek V4 ProNone25.01364.267 / 102 / 730.0
127GPT-OSS 120BMedium24.91363.953 / 101 / 880.0
128Claude Opus 4.5High24.31352.3126 / 99 / 1530.0
129Seed 2.0 CodeLow24.11352.398 / 86 / 1240.0
130Grok 4.5High24.01349.488 / 151 / 1180.0
131Laguna S 2.1None23.81351.4138 / 234 / 2280.0
132GPT-5.6 TerraNone23.71351.529 / 119 / 860.0
133Nex N2 ProEnabled23.71356.427 / 70 / 610.0
134GPT-5.6 LunaXHigh23.51343.268 / 174 / 1450.0
135Nex N2 ProNone23.41354.116 / 91 / 410.0
136Claude Opus 4.8Medium23.21351.323 / 82 / 550.0
137GPT-5.4 NanoNone22.91348.334 / 60 / 660.0
138Granite 4.2 8BFull22.51337.16 / 182 / 680.0
139GPT-5.4None22.31332.737 / 168 / 1130.0
140Nemotron 3 Ultra 550B A55BNone22.01340.213 / 77 / 520.0
141Muse Glimmer 30BMedium21.81329.762 / 85 / 1070.0
142Gemini 3.5 Flash LiteMedium21.71324.9146 / 304 / 2580.0
143GPT 5High21.21330.926 / 57 / 630.0
144DeepSeek V4 FlashNone20.21313.846 / 93 / 1010.0
145MiMo-V2.5-ProNone19.91315.230 / 82 / 560.0
146GPT-5.6 LunaNone19.41301.515 / 183 / 1160.0
147Qwen3.7 MaxNone19.01307.212 / 94 / 480.0
148DeepSeek V4 FlashXHigh18.71297.640 / 104 / 980.0
149O3High18.41288.290 / 124 / 1800.0
150GPT-5.6 TerraMedium18.11291.721 / 122 / 870.0
151Claude Fable 5Medium18.01290.022 / 66 / 1440.0
152Hy3 PreviewNone18.01291.742 / 62 / 1000.0
153GPT 5Medium17.71295.119 / 60 / 570.0
154Grok Build 0.1Enabled17.41290.031 / 60 / 670.0
155GPT-5.5Medium17.11286.228 / 65 / 610.0
156GLM-5.2High16.91279.011 / 114 / 1050.0
157North Mini CodeEnabled15.71300.313 / 46 / 9732.7
158Gemini 3.5 FlashMinimal15.01258.341 / 53 / 1460.0
159DeepSeek V4 ProHigh13.71244.344 / 69 / 1270.0
160Ling 3.0 FlashNone13.01239.653 / 139 / 2000.0
161GPT 5Low0.71119.96 / 21 / 716.5
162Grok 4.5Low0.01093.121 / 90 / 2530.0

Individual player programs

Each row is one accepted player program for GB2-03: Shogi. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.

Showing 193 player programs.
Player IDModelReasoningStatusScoreEloConfidenceW / D / LRated / attemptedOpponentsCapped drawsFaults / playersGeneration
E-529bc866427d95d5Claude Fable 5.1LowRated83.41988—167 / 48 / 17232 / 2389800 / 1First try · 2026-09-03
E-5c6dabbae6a319cfClaude Fable 5.1MediumRated82.21975—198 / 18 / 20236 / 23610500 / 1First try · 2026-09-03
E-9f7c077c66189b69Claude Fable 5.1XHighRated88.92047—202 / 16 / 12230 / 23010300 / 1First try · 2026-09-03
E-094b2010aac066a0Seed 2.0 CodeLowRated24.11352—98 / 86 / 124308 / 314139170 / 1First try · 2026-09-03
E-2c690364f0f3c464Seed 2.0 CodeMediumRated29.51412—62 / 57 / 131250 / 25010750 / 1Repaired · 2026-09-03
E-be0e8179bdce6f89Seed 2.0 CodeHighRated26.61378—72 / 110 / 122304 / 304131110 / 1First try · 2026-09-03
E-08c47845dab131f7Claude Fable 5LowRated27.21388—41 / 115 / 84240 / 240107240 / 1First try · 2026-09-03
E-2ed1d3826a8e383bClaude Fable 5MediumRated18.01290—22 / 66 / 144232 / 23210120 / 1First try · 2026-09-03
E-54089f474d2eb1afClaude Fable 5XHighRated72.71874—146 / 73 / 23242 / 24810200 / 1First try · 2026-09-03
E-b53393b05159fc95Claude Fable 5.1XHighRated90.82067—218 / 4 / 8230 / 23010400 / 1First try · 2026-09-08
E-1975db22db58e9b0Claude Opus 4.5Thinking field omittedRated25.41374—29 / 86 / 61176 / 17671240 / 1First try · 2026-07-02
E-cef4890e88806969Claude Opus 4.5Legacy_shared_thinking_budgetRated32.71455—49 / 36 / 49134 / 1345910 / 1First try · 2026-07-02
E-d5810442d7094396Claude Opus 4.5High effort + 32,000 thinking tokensRated24.31352—126 / 99 / 153378 / 378128170 / 1First try · 2026-07-21
E-dfb18dba94eee30bClaude Opus 4.5Medium effort + 16,000 thinking tokensRated37.71495—82 / 150 / 129361 / 362127330 / 1First try · 2026-07-21
E-823b961281482cd1Claude Opus 4.8MediumRated23.21351—23 / 82 / 55160 / 1606280 / 1First try · 2026-07-02
E-38759212c025e8ebClaude Opus 5XHighRated88.92055—126 / 1 / 9136 / 1365800 / 1First try · 2026-07-25
E-49aaba66f6b19080Claude Opus 5Thinking disabledRated25.61378—71 / 12 / 65148 / 1486100 / 1First try · 2026-07-25
E-7caa6c5081d57676Claude Opus 5XHighRated91.92088—120 / 4 / 4128 / 1285600 / 1First try · 2026-07-25
E-bd02f4c2907d0a7cClaude Opus 5MediumRated74.81903—119 / 4 / 20143 / 1446700 / 1First try · 2026-07-25
E-d8babc5495b1a188Claude Opus 5MediumRated68.91838—137 / 1 / 22160 / 1606100 / 1First try · 2026-07-25
E-ecf847457e616425Claude Opus 5Thinking disabledRated35.31480—68 / 39 / 53160 / 1626510 / 1First try · 2026-07-25
E-0ac738bb34b1e7c8Claude Opus 5.5XHighRated79.71970—67 / 1 / 068 / 683400 / 1First try · 2026-09-22
E-8b93ed37e8717e57Claude Opus 5.5MediumRated71.71885—56 / 3 / 766 / 663300 / 1First try · 2026-09-22
E-e1060972858d5fecClaude Opus 5.5LowRated33.31475—5 / 50 / 1570 / 703500 / 1First try · 2026-09-22
E-0d68a6f35cd9e672Claude Sonnet 5Thinking disabledRated36.71484—115 / 144 / 127386 / 386136250 / 1First try · 2026-08-09
E-7dde7ed705ef7793Claude Sonnet 5XHighRated44.71572—97 / 107 / 115319 / 32011520 / 1First try · 2026-08-09
E-db41eba0d9c3a185Claude Sonnet 5MediumRated32.01435—98 / 119 / 157374 / 374133290 / 1First try · 2026-08-09
E-0f669ae82234cf76North Mini CodeEnabledLimited data22.51399—1 / 10 / 920 / 201000 / 1Repaired · 2026-07-02
E-2466b739a7e77f28DeepSeek V4 FlashXHighRated18.71298—40 / 104 / 98242 / 242108250 / 1First try · 2026-09-03
E-32e04fe5ad231857DeepSeek V4 FlashHighRated26.91396—34 / 31 / 53118 / 1185120 / 1First try · 2026-07-01
E-83ea8f16d2ab6c6cDeepSeek V4 FlashReasoning disabledRated20.21314—46 / 93 / 101240 / 24010510 / 1First try · 2026-09-03
E-adb91cece5ac758bDeepSeek V4 FlashHighRated28.81406—51 / 128 / 52231 / 232102220 / 1First try · 2026-09-03
E-31e88f6cf51549fcDeepSeek V4 ProHighRated13.71244—44 / 69 / 127240 / 24010670 / 1Repaired · 2026-09-03
E-993e82e4ffee6a60DeepSeek V4 ProReasoning disabledRated25.01364—67 / 102 / 73242 / 248105100 / 1Repaired · 2026-09-03
E-b1eaa0bd288a35b4DeepSeek V4 ProXHighRated32.31439—85 / 137 / 106328 / 32813830 / 1First try · 2026-09-03
E-1e1b2c86ddb95e65DeepSeek V4 Pro 0813HighRated28.01393—108 / 48 / 162318 / 32413310 / 1Repaired · 2026-09-03
E-2924d511eb55c853DeepSeek V4 Pro 0813Reasoning disabledRated30.41422—39 / 123 / 78240 / 246101100 / 1First try · 2026-09-03
E-eb128c27574f7647DeepSeek V4 Pro 0813MaxRated48.21611—136 / 27 / 85248 / 24810610 / 1First try · 2026-09-03
E-31186fc43198f6e5DeepSeek V4.1 FlashMaxRated39.81546—34 / 6 / 2464 / 643200 / 1First try · 2026-09-18
E-71f58b17f1537d89DeepSeek V4.1 FlashHighRated35.71502—32 / 12 / 2266 / 663300 / 1First try · 2026-09-18
E-b52c9509b7a980deDeepSeek V4.1 FlashNoneRated25.31389—19 / 20 / 3170 / 703560 / 1First try · 2026-09-18
E-0eb4abdf6bd630c6Gemini 3.5 FlashMinimalRated15.01258—41 / 53 / 146240 / 24010590 / 1Repaired · 2026-09-03
E-7444dbf10025da62Gemini 3.5 FlashHighRated55.61691—103 / 67 / 72242 / 24210320 / 1Repaired · 2026-09-03
E-f150131080df95feGemini 3.5 FlashMediumRated47.91610—107 / 57 / 65229 / 23010370 / 1First try · 2026-09-03
E-28274045fbc35ae9Gemini 3.5 Flash LiteMinimalRated31.71429—170 / 111 / 177458 / 458152220 / 1Repaired · 2026-07-24
E-7ed90f1b43d80cf9Gemini 3.5 Flash LiteHighRated38.71505—199 / 64 / 147410 / 41014180 / 1First try · 2026-07-24
E-c7e8525629d5d658Gemini 3.5 Flash LiteMediumRated24.41353—89 / 134 / 136359 / 35911790 / 1First try · 2026-07-24
E-d485651284072880Gemini 3.5 Flash LiteHighRated26.81380—89 / 103 / 154346 / 346116130 / 1First try · 2026-07-24
E-d9a1854998f1794fGemini 3.5 Flash LiteMediumRated19.01297—57 / 170 / 122349 / 350117410 / 1First try · 2026-07-24
E-1d4a922c11c37a8dGemini 3.6 FlashMediumRated43.61559—156 / 74 / 117347 / 34911690 / 1First try · 2026-07-24
E-2e4f025f94dafe33Gemini 3.6 FlashMediumRated30.21416—89 / 72 / 190351 / 35111520 / 1First try · 2026-07-24
E-6743f1c221046d65Gemini 3.6 FlashMinimalRated40.91528—188 / 89 / 139416 / 417138100 / 1First try · 2026-07-24
E-80b8c1a18d6dd238Gemini 3.6 FlashMinimalRated39.21510—131 / 147 / 139417 / 41714080 / 1First try · 2026-07-24
E-97580ecf1bd06d40Gemini 3.6 FlashHighRated53.71667—201 / 34 / 105340 / 34012460 / 1First try · 2026-07-24
E-2849c51d2af45e7aGemini 3.8 FlashHighRated59.61734—144 / 23 / 64231 / 23210110 / 1Repaired · 2026-09-03
E-2ae0160d57f11d16Gemini 3.8 FlashMediumRated66.21804—159 / 62 / 19240 / 24610300 / 1First try · 2026-09-03
E-bb04521b5e8e5fdeGemini 3.8 FlashLowRated40.91531—123 / 73 / 97293 / 294128180 / 1First try · 2026-09-03
E-c7da9914f86ee846GPT 4.1NoneRated34.21468—59 / 43 / 70172 / 1727020 / 1Repaired · 2026-07-02
E-c541923774f0cd7bGPT 5LowWaiting———0 / 0 / 00 / 0000 / 1Repaired · 2026-07-21
E-cc568b7069d5a0fdGPT 5HighRated21.21331—26 / 57 / 63146 / 1475961 / 1First try · 2026-07-02
E-e724ba162431d43aGPT 5MediumRated17.71295—19 / 60 / 57136 / 1365820 / 1First try · 2026-07-02
E-09687fbb17ec9c64GPT-5.4XHighRated26.81378—111 / 138 / 146395 / 399138130 / 1First try · 2026-08-09
E-c535d0dba39ffdb8GPT-5.4MediumRated29.91412—70 / 189 / 111370 / 376122120 / 1First try · 2026-08-09
E-ca34006c666b7c30GPT-5.4NoneRated22.31333—37 / 168 / 113318 / 318108160 / 1First try · 2026-08-09
E-35117a2e624d7970GPT-5.4 MiniNoneRated32.21448—5 / 132 / 13150 / 1506200 / 1First try · 2026-07-02
E-9e39bdd48b7328c7GPT-5.4 MiniMediumRated30.61430—35 / 76 / 52163 / 16364110 / 1Repaired · 2026-07-02
E-f2a7b43bf689e68eGPT-5.4 NanoNoneRated22.91348—34 / 60 / 66160 / 1606430 / 1First try · 2026-07-09
E-446036823932df16GPT-5.5NoneRated26.61388—36 / 61 / 59156 / 15665110 / 1First try · 2026-07-02
E-c002b0ea38b845f8GPT-5.5MediumRated17.11286—28 / 65 / 61154 / 1546370 / 1First try · 2026-07-02
E-e53a932f820d9724GPT-5.5XHighRated35.21479—57 / 52 / 51160 / 1616930 / 1First try · 2026-07-02
E-0fbc2c4195016fbeGPT-5.6 LunaXHighRated23.51343—68 / 174 / 145387 / 390140120 / 1First try · 2026-08-09
E-47dd28046ef904f9GPT-5.6 LunaNoneRated19.41302—15 / 183 / 116314 / 314107150 / 1First try · 2026-08-09
E-d4115a59dfe21984GPT-5.6 LunaMediumRated27.51386—88 / 135 / 146369 / 369127120 / 1First try · 2026-08-09
E-79655cafc06e8943GPT-5.6 SolNoneRated37.01487—122 / 156 / 123401 / 402139200 / 1First try · 2026-08-09
E-826bd7fcad40bd61GPT-5.6 SolMediumRated56.71699—180 / 38 / 105323 / 32411600 / 1First try · 2026-08-09
E-d2ec4e4765cdd61aGPT-5.6 SolXHighRated61.01745—247 / 7 / 59313 / 31410800 / 1First try · 2026-08-09
E-1b9303bccd1ae3a7GPT-5.6 TerraMediumRated18.11292—21 / 122 / 87230 / 23010030 / 1First try · 2026-09-03
E-9e34338c99f9d8f2GPT-5.6 TerraXHighRated30.01419—51 / 98 / 75224 / 2309970 / 1First try · 2026-09-03
E-ea197beced004a2bGPT-5.6 TerraNoneRated23.71352—29 / 119 / 86234 / 234101240 / 1First try · 2026-09-03
E-18e6aa627f4b1222GPT-6 AstraXHighRated100.02165—229 / 8 / 1238 / 23810200 / 1First try · 2026-09-05
E-4633465f951f8caeGPT-6 AstraMediumRated81.81971—163 / 67 / 8238 / 23810600 / 1First try · 2026-09-05
E-ef2e204393ad0d26GPT-6 AstraLowRated59.41731—116 / 105 / 23244 / 24410700 / 1First try · 2026-09-05
E-0777bd93e4c8b6f0GPT-6 LunaXHighRated31.41455—23 / 3 / 4268 / 683400 / 1First try · 2026-09-22
E-8ac222c2856db302GPT-6 LunaMediumRated30.61447—19 / 13 / 3466 / 663330 / 1First try · 2026-09-22
E-c26e29639d58001aGPT-6 LunaNoneRated27.51415—19 / 10 / 3564 / 643220 / 1First try · 2026-09-22
E-049711eb0d28bfa8GPT-6 SolXHighRated75.81931—60 / 0 / 464 / 643200 / 1First try · 2026-09-22
E-121a04b85cf6e078GPT-6 SolNoneRated48.31635—49 / 7 / 1470 / 703500 / 1First try · 2026-09-22
E-a9236c7d538a85d8GPT-6 SolMediumRated53.41692—39 / 5 / 2064 / 643200 / 1First try · 2026-09-22
E-bd221d161d87ac89Granite 4.2 8BFullRated22.51337—6 / 182 / 68256 / 25610700 / 1Repaired · 2026-09-03
E-8d642aadefff3c56Mercury 2.5 PreviewNoneRated27.41386—89 / 103 / 139331 / 332141170 / 1First try · 2026-09-03
E-2524de3c7d4a81b7Ling 3.0 FlashBaseline track (legacy evidence incomplete)Rated9.71204—22 / 67 / 111200 / 2007300 / 1Repaired · 2026-07-24
E-641ddca04b054d56Ling 3.0 FlashBaseline track (legacy evidence incomplete)Rated16.41275—31 / 72 / 89192 / 1927620 / 1Repaired · 2026-07-24
E-198e8ddfe9f7ce20LongCat 2.0NoneRated17.21288—19 / 61 / 72152 / 1526380 / 1Repaired · 2026-07-24
E-84709c769628f9a2LongCat 2.0NoneRated36.51493—48 / 64 / 46158 / 15862120 / 1First try · 2026-07-24
E-d3a5befe76215b48LongCat 2.0EnabledRated27.51386—87 / 165 / 131383 / 384129490 / 1First try · 2026-07-24
E-3191f2c6f975e8b9Muse Glimmer 30BXHighRated28.61403—47 / 114 / 77238 / 238103210 / 1First try · 2026-09-03
E-b33063dca8a3637eMuse Glimmer 30BMediumRated21.81330—62 / 85 / 107254 / 25411230 / 1Repaired · 2026-09-03
E-cbbc4b626f619169Muse Glimmer 30BLowRated30.61424—65 / 105 / 76246 / 246110110 / 1Repaired · 2026-09-03
E-0ed752547c3943baMuse Spark 1.2MinimalRated29.91411—161 / 61 / 172394 / 39414120 / 1First try · 2026-08-13
E-4d97f32199e2a33dMuse Spark 1.2MediumRated30.11414—127 / 116 / 142385 / 386138210 / 1First try · 2026-08-13
E-967e1c4101f2c062Muse Spark 1.2XHighRated41.71537—177 / 60 / 161398 / 398138160 / 1First try · 2026-08-13
E-3c41519fe25ad4f4Muse Spark 1.3MinimalRated36.81487—129 / 77 / 102308 / 31413520 / 1Repaired · 2026-09-03
E-77e89ace09a10b87Muse Spark 1.3MediumRated35.61477—106 / 45 / 101252 / 25810930 / 1First try · 2026-09-03
E-84fabe2ffe1ea0f4Muse Spark 1.3XHighRated48.51615—95 / 86 / 56237 / 23810410 / 1First try · 2026-09-03
E-44cc758f104a74abMinimax M3Reasoning disabledRated33.21456—56 / 59 / 65180 / 1807800 / 1First try · 2026-07-02
E-52d117f4012e1cf8Mistral Medium 3.5NoneRated32.01439—69 / 75 / 102246 / 24611140 / 1First try · 2026-09-08
E-95026ec7eab708bfMistral Medium 3.5HighRated31.21431—60 / 81 / 91232 / 23810010 / 1Repaired · 2026-09-08
E-09859be1b47131a0Kimi K3LowRated34.31458—160 / 105 / 141406 / 40614060 / 1First try · 2026-07-24
E-8f139a9e4d538859Kimi K3MaxRated36.91486—92 / 184 / 118394 / 400140110 / 1First try · 2026-07-24
E-980b1f419104e27aKimi K3HighRated49.61623—159 / 104 / 80343 / 34411680 / 1First try · 2026-07-24
E-57ad2863cbf32d58Nex N2 ProReasoning enabledRated23.71356—27 / 70 / 61158 / 1586550 / 1Repaired · 2026-07-02
E-a05d4cef5f788f16Nex N2 ProReasoning disabledRated23.41354—16 / 91 / 41148 / 1485880 / 1Repaired · 2026-07-02
E-eb6e8a61f620acfdNemotron 3 Ultra 550B A55BReasoning disabledRated22.01340—13 / 77 / 52142 / 1425970 / 1Repaired · 2026-07-02
E-9f7b8b1adc2ddba7O3HighRated18.41288—90 / 124 / 180394 / 39413120 / 1First try · 2026-07-03
E-58981aa1a0bddbbeGPT-OSS 120BMediumRated24.91364—53 / 101 / 88242 / 242102260 / 1First try · 2026-09-03
E-a0a2adac9a627e8cGPT-OSS 120BLowRated29.81416—59 / 73 / 102234 / 23410630 / 1First try · 2026-09-03
E-e493fe935e5e9229GPT-OSS 120BHighRated29.01408—69 / 95 / 77241 / 242106240 / 1First try · 2026-09-03
E-08762a3df1a52f6bLaguna S 2.1EnabledRated26.31373—43 / 199 / 122364 / 364120130 / 1First try · 2026-07-24
E-7acc466aeae25d41Laguna S 2.1NoneRated23.11338—107 / 167 / 162436 / 43714950 / 1First try · 2026-07-24
E-91efdb0c216f8504Laguna S 2.1NoneRated24.51365—31 / 67 / 66164 / 1647450 / 1Repaired · 2026-07-24
E-936fb7956df3d03bLaguna S 2.1EnabledRated32.11433—126 / 117 / 215458 / 458149290 / 1Repaired · 2026-07-24
E-3325ebad2ef000c1Qwen3.7 MaxReasoning disabledRated19.01307—12 / 94 / 48154 / 15458120 / 1First try · 2026-07-02
E-37985d0233db3e2cQwen3.8 2.4t A95BLowRated35.71477—101 / 45 / 125271 / 27211540 / 1First try · 2026-09-03
E-466175b20ceec15fQwen3.8 2.4t A95BXHighRated70.61851—96 / 103 / 41240 / 24611110 / 1First try · 2026-09-03
E-711e132559d270f7Qwen3.8 2.4t A95BMediumRated35.11469—69 / 147 / 101317 / 320138150 / 1First try · 2026-09-03
E-e10f1e2e4f909d4dQwen3.8 27BMediumRated41.11532—114 / 84 / 123321 / 32213660 / 1First try · 2026-09-03
E-08e7f60de87ced74Qwen3.8 FlashReasoning enabledRated41.61542—125 / 50 / 64239 / 24011330 / 1Repaired · 2026-09-03
E-51427a3b0556ffc2Qwen3.8 FlashReasoning disabledRated31.81436—66 / 87 / 101254 / 25410860 / 1First try · 2026-09-03
E-5481497913530d6bQwen3.8 MaxMediumRated43.81565—96 / 74 / 86256 / 25611580 / 1First try · 2026-08-08
E-d2322903ed52a2c3Qwen3.8 MaxXHighRated48.11611—120 / 33 / 98251 / 25110440 / 1First try · 2026-08-08
E-da44e2f9cd203f91Qwen3.8 MaxMinimalRated30.11418—60 / 121 / 78259 / 259105200 / 1First try · 2026-08-08
E-3f82c8d09cfe6499Qwen3.8 Max 0902XhighRated51.71669—56 / 3 / 1574 / 743720 / 1Repaired · 2026-09-18
E-51a228e6efe1242cQwen3.8 Max 0902LowRated34.11487—26 / 11 / 2360 / 603030 / 1First try · 2026-09-18
E-7b5960f6419642a4Qwen3.8 Max 0902MediumRated42.51573—35 / 10 / 2570 / 703530 / 1First try · 2026-09-18
E-01ad48d5f93e32a0Ox AlphaHighRated31.01425—100 / 75 / 126301 / 302127250 / 1First try · 2026-08-21
E-14673673976cc3ebOx AlphaHighRated35.61475—107 / 68 / 128303 / 30412960 / 1First try · 2026-08-21
E-213cbd917b9e3b75Ox AlphaLowRated16.91279—22 / 97 / 111230 / 23010100 / 1First try · 2026-08-21
E-41517f1495980c1fOx AlphaMaxRated73.01877—175 / 12 / 41228 / 23410110 / 1First try · 2026-08-21
E-449a1a79eee8c26fOx AlphaHighRated74.11888—187 / 6 / 43236 / 23610300 / 1First try · 2026-08-22
E-463b747dfc9e53e2Ox AlphaMaxRated56.91713—106 / 9 / 26141 / 323880182 / 1First try · 2026-08-22
E-7aeb7747204eb58bOx AlphaHighRated28.61401—93 / 87 / 118298 / 299136110 / 1First try · 2026-08-22
E-7c7b61f033bf610fOx AlphaHighRated33.91460—84 / 49 / 99232 / 238105120 / 1Repaired · 2026-08-21
E-82c718cb6269d828Ox AlphaMaxRated67.71821—153 / 54 / 27234 / 23410200 / 1Repaired · 2026-08-22
E-88583455f6e29fddOx AlphaMaxRated39.11515—97 / 36 / 103236 / 23610540 / 1First try · 2026-08-21
E-8ba70fb303bf5927Ox AlphaLowRated29.51411—40 / 164 / 56260 / 266113130 / 1Repaired · 2026-08-21
E-91f209f8f1ca6da4Ox AlphaLowRated29.61410—39 / 162 / 115316 / 317137331 / 1Repaired · 2026-08-22
E-9f1a927cfaf6d760Ox AlphaLowRated37.91502—92 / 101 / 61254 / 254113110 / 1Repaired · 2026-08-21
E-a03a524a03b22367Ox AlphaLowRated26.91385—49 / 117 / 69235 / 23610180 / 1First try · 2026-08-21
E-a4422e1fd753be13Ox AlphaLowRated39.61520—71 / 88 / 76235 / 23610550 / 1First try · 2026-08-21
E-acf0cd8991a453efOx AlphaLowRated45.71583—92 / 110 / 91293 / 297129130 / 1First try · 2026-08-22
E-b1c61a0495f26448Ox AlphaHighRated38.61509—113 / 35 / 94242 / 24210460 / 1First try · 2026-08-21
E-d5879b5524510a71Ox AlphaHighRated55.91694—142 / 16 / 76234 / 24010320 / 1First try · 2026-08-21
E-de081f655675d088Ox AlphaMaxRated49.91630—83 / 100 / 57240 / 24011050 / 1First try · 2026-08-22
E-eb6d338f3b9c76c6Ox AlphaLowRated30.81426—25 / 168 / 45238 / 238102260 / 1First try · 2026-08-21
E-2346cd049910cc0aHy3 PreviewNoneRated18.01292—42 / 62 / 100204 / 2047200 / 1First try · 2026-07-02
E-5ebbebd4837b7653Hy4 PreviewNoneRated50.51637—80 / 92 / 70242 / 24210740 / 1Repaired · 2026-09-03
E-7644c3ff1282403cHy4 PreviewHighRated50.81641—140 / 23 / 69232 / 23810000 / 1First try · 2026-09-03
E-ec9707cf9a4dca7dHy4 PreviewLowRated29.81416—27 / 151 / 53231 / 23210240 / 1First try · 2026-09-03
E-77829668b3641188InklingMediumRated44.71570—168 / 62 / 111341 / 344113110 / 1First try · 2026-07-24
E-78048b7c08122f1cInklingNoneRated29.31417—33 / 60 / 57150 / 1505780 / 1Repaired · 2026-07-24
E-adf1f0bb193bd39bInklingNoneRated41.71549—64 / 46 / 44154 / 15458140 / 1First try · 2026-07-24
E-f9259c1ced4fba75InklingMaxRated30.81420—123 / 159 / 152434 / 434148160 / 1First try · 2026-07-24
E-5ee731d79dc75fa4Inkling SmallMaxRated28.11396—100 / 76 / 112288 / 28811980 / 1First try · 2026-08-09
E-7a0adb70b85361e4Inkling SmallNoneRated37.11493—62 / 142 / 44248 / 254107130 / 1First try · 2026-08-09
E-a17a40d8dd4cbb06Inkling SmallMediumRated25.11365—63 / 94 / 94251 / 25110580 / 1Repaired · 2026-08-09
E-02f7e54245bd5c85Grok 4.5LowRated0.01093—21 / 90 / 253364 / 36412200 / 1Repaired · 2026-07-24
E-c0c60ca46f3ce498Grok 4.5HighRated24.01349—88 / 151 / 118357 / 358112271 / 1First try · 2026-07-24
E-cbed46472ce4dd05Grok 4.5MediumRated37.51504—52 / 62 / 40154 / 1546750 / 1First try · 2026-07-24
E-0d3a59ac2b4666e6Grok 4.6XHighRated36.01479—122 / 81 / 113316 / 31613240 / 1First try · 2026-09-03
E-2599a67e493fd43aGrok 4.6LowRated30.81426—1 / 214 / 27242 / 24210500 / 1First try · 2026-09-03
E-b36464413bd15532Grok 4.6MediumRated56.31699—113 / 61 / 58232 / 23810210 / 1First try · 2026-09-03
E-ae8e0b4e131843e6Grok 4.7MediumRated58.31744—47 / 6 / 1164 / 643210 / 1First try · 2026-09-22
E-2a93343a8a88fd59Grok Build 0.1Reasoning enabledRated17.41290—31 / 60 / 67158 / 1586530 / 1Repaired · 2026-07-02
E-b10e12eb6aef112eMiMo-V2.5Reasoning disabledRated34.21469—37 / 74 / 43154 / 1546560 / 1First try · 2026-07-02
E-b0948c64dddf57adMiMo-V2.5-ProReasoning disabledRated19.91315—30 / 82 / 56168 / 1686690 / 1Repaired · 2026-07-02
E-924bbb1816e24617MiMo-V2.6-FlashReasoning enabledRated36.11506—37 / 5 / 2668 / 683420 / 1Repaired · 2026-09-22
E-cc11313284afbc58MiMo-V2.6-FlashReasoning disabledRated27.21412—15 / 14 / 3766 / 663320 / 1First try · 2026-09-22
E-704bcadff274fed4MiMo-V2.6-ProReasoning disabledRated29.71437—20 / 13 / 3568 / 683400 / 1First try · 2026-09-22
E-2ab01958bc20a7c7GLM-5.2XHighRated30.11419—47 / 119 / 70236 / 236102270 / 1First try · 2026-09-03
E-40aa28533b1afda1GLM-5.2HighRated25.21375—8 / 83 / 43134 / 13454330 / 1Repaired · 2026-07-11
E-4cab1ccd88bbeb2eGLM-5.2Reasoning disabledRated33.21462—33 / 58 / 35126 / 1265810 / 1First try · 2026-07-02
E-583be34ca1fb2631GLM-5.2Reasoning disabledRated24.71369—27 / 53 / 62142 / 14260110 / 1Repaired · 2026-07-11
E-59fd24f683d6f54aGLM-5.2Reasoning disabledRated26.61382—54 / 94 / 94242 / 242104120 / 1First try · 2026-09-03
E-c3d1dca1b4c0647eGLM-5.2HighRated16.91279—11 / 114 / 105230 / 230102210 / 1First try · 2026-09-03
E-03a7ef5a648fbf94GLM 5.3HighRated60.01739—150 / 29 / 50229 / 2309920 / 1First try · 2026-09-03
E-bf97b86c39a0471cGLM 5.3MaxRated77.31921—208 / 23 / 37268 / 27411610 / 1First try · 2026-09-03
E-e159cb9df9fc19e9GLM 5.3LowRated34.61464—70 / 114 / 111295 / 296127110 / 1First try · 2026-09-03
E-0ad0f940c9870985GLM 5.3 FlashMaxRated60.61744—133 / 54 / 63250 / 25011520 / 1First try · 2026-09-03
E-4f456c37c09ef2fbGLM 5.3 FlashHighRated57.81715—120 / 61 / 56237 / 23810300 / 1First try · 2026-09-03
E-6b691e1931098371GLM 5.3 FlashLowRated38.01503—80 / 81 / 87248 / 248107150 / 1Repaired · 2026-09-03
E-0328e9aeef9fc87bGLM-5.3 FlashXHighRated41.51562—27 / 10 / 3168 / 683420 / 1First try · 2026-09-22
E-0dddba3c08d0342cGLM-5.3 FlashXMaxRated57.81736—52 / 1 / 1568 / 683400 / 1First try · 2026-09-22
E-e850b2340631f3f0GLM-5.3 FlashXLowRated27.71417—15 / 16 / 3566 / 663330 / 1First try · 2026-09-22