Benchmark menu

Per-game leaderboard

GB2-04: Xiangqi

First compare each model and reasoning setting for GB2-04: Xiangqi. Then inspect the individual player programs behind those combined results.

Xiangqi

Xiangqi is a 9x10 chess-family game with palaces, river restrictions, cannon screens, horse-leg and elephant-eye blocking, and flying-general legality.

Scores here compare player programs using DuelLab's encoded rules for Xiangqi; they are not a broad measure of human play strength.

GB2-04: Xiangqi by model and setting

Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and the rating-evidence index combine those contributing programs. A zero index is a clipped endpoint, not zero uncertainty about future generations.

Reasoning level: Reasoning Variants Game: GB2-04: Xiangqi
GB2-04: Xiangqi - Reasoning Variants
Rank Model Reasoning Score Raw Elo W / D / L Rating-evidence index
1GPT-6 AstraXHigh99.11977.5212 / 18 / 80.0
2GPT-6 AstraMedium94.31946.1202 / 22 / 120.0
3Claude Opus 5.5XHigh92.61949.483 / 12 / 36.5
4Claude Fable 5XHigh88.41907.5185 / 27 / 290.0
5Claude Fable 5.1XHigh84.41881.7401 / 34 / 470.0
6GPT-6 AstraLow83.41875.1185 / 27 / 320.0
7GPT-5.6 SolXHigh76.31825.7239 / 44 / 250.0
8Claude Opus 5XHigh75.71826.5304 / 60 / 500.0
9GPT-5.6 SolMedium74.91816.4212 / 77 / 260.0
10GLM 5.3 FlashHigh71.31795.1152 / 55 / 610.0
11Grok 4.7Medium71.11810.473 / 11 / 88.1
12Claude Opus 5.5Medium68.51792.475 / 10 / 117.0
13GLM 5.3High68.11774.9191 / 36 / 220.0
14GPT-6 SolXHigh66.11778.465 / 15 / 108.7
15GLM 5.3 FlashMax63.51744.9159 / 52 / 350.0
16Qwen3.8 Max 0902XHigh61.41750.065 / 10 / 711.1
17GLM-5.3 FlashXMax59.41734.252 / 33 / 68.4
18Ox AlphaMax55.61693.6391 / 239 / 960.0
19Claude Fable 5.1Low54.91689.8122 / 75 / 350.0
20Kimi K3Max54.51681.8194 / 112 / 620.0
21Qwen3.8 27BXHigh54.01682.5132 / 77 / 490.0
22MiMo-V2.6-ProEnabled52.61688.738 / 54 / 66.5
23GPT-6 SolMedium52.31686.851 / 31 / 147.0
24DeepSeek V4.1 FlashMax51.91686.254 / 26 / 89.2
25MiMo-V2.6-FlashEnabled49.41671.247 / 14 / 2310.5
26Claude Opus 5.5Low48.11660.533 / 52 / 97.5
27Grok 4.6Medium43.51614.298 / 101 / 490.0
28Gemini 3.6 FlashHigh43.21608.1310 / 233 / 1840.0
29Qwen3.8 MaxXHigh41.71602.6102 / 106 / 390.0
30GLM 5.3 FlashLow38.41581.6101 / 96 / 470.0
31Muse Spark 1.3Medium36.71570.192 / 103 / 570.0
32GPT-5.4XHigh36.61566.4104 / 166 / 480.0
33Gemini 3.8 FlashMedium36.41566.661 / 160 / 610.0
34Gemini 3.5 FlashMedium36.41567.367 / 134 / 590.0
35GPT-6 LunaXHigh36.01583.132 / 37 / 179.9
36Grok 4.6XHigh36.01562.2104 / 141 / 830.0
37Qwen3.8 FlashEnabled35.51562.538 / 157 / 530.0
38Claude Opus 4.8XHigh34.91560.594 / 88 / 260.0
39Claude Sonnet 5XHigh34.81554.096 / 182 / 660.0
40GLM-5.2High34.21553.957 / 117 / 700.0
41Claude Fable 5.1Medium33.61550.593 / 109 / 360.0
42Hy4 PreviewHigh32.31541.776 / 119 / 530.0
43GLM-5.2XHigh31.11533.372 / 88 / 900.0
44Claude Opus 5None30.01527.6155 / 162 / 1290.0
45Ox AlphaHigh28.51516.3202 / 404 / 1680.0
46MiMo-V2.6-ProNone28.21531.419 / 58 / 138.7
47GPT-5.4 NanoMedium28.21516.069 / 124 / 330.0
48GLM-5.3 FlashXHigh28.11530.322 / 54 / 168.1
49Claude Fable 5Medium27.61510.960 / 131 / 550.0
50MiMo-V2.5-ProEnabled27.21509.356 / 124 / 440.0
51Claude Opus 4.5None27.01509.841 / 121 / 380.0
52Ox AlphaLow26.51501.6150 / 546 / 2070.0
53GPT-5.6 LunaMedium26.31499.744 / 213 / 550.0
54GLM-5.3 FlashXLow25.91516.514 / 57 / 179.2
55DeepSeek V4 ProXHigh25.01493.141 / 149 / 700.0
56Kimi K3Low24.71486.4103 / 195 / 1200.0
57LongCat 2.0None24.71493.744 / 122 / 490.0
58GPT-5.4 MiniMedium23.91488.049 / 147 / 320.0
59Nemotron 3 Ultra 550B A55BNone23.91489.018 / 164 / 240.0
60Muse Glimmer 30BXHigh23.21479.861 / 173 / 740.0
61DeepSeek V4 Pro 0813None23.01479.520 / 199 / 630.0
62Mercury 2.5 PreviewNone22.91479.219 / 212 / 330.0
63Qwen3.8 27BNone22.61475.663 / 180 / 690.0
64Grok 4.5High22.21471.293 / 157 / 1140.0
65Claude Sonnet 5None22.01471.643 / 211 / 520.0
66Muse Spark 1.2Minimal20.81462.352 / 256 / 600.0
67GPT-5.5Medium20.61465.932 / 153 / 490.0
68Kimi K3High20.31457.060 / 308 / 710.0
69Gemini 3.5 Flash LiteMinimal20.21456.1161 / 494 / 2220.0
70Gemini 3.8 FlashHigh20.01462.093 / 36 / 1100.0
71InklingMax19.71453.467 / 266 / 930.0
72GLM 5.3Low19.61458.836 / 172 / 440.0
73Gemma 4 31BEnabled19.11456.815 / 185 / 240.0
74Inkling SmallMedium19.11452.259 / 189 / 780.0
75GLM-5.2Reasoning19.01455.532 / 153 / 510.0
76Hy3 PreviewNone19.01457.443 / 132 / 290.0
77MiMo-V2.5Reasoning18.91456.613 / 157 / 360.0
78Qwen3.8 2.4t A95BLow18.81450.437 / 224 / 590.0
79Mercury 2.5 PreviewMedium18.61452.616 / 177 / 440.0
80Muse Glimmer 30BMedium18.51451.620 / 191 / 410.0
81Step 3.7 FlashMedium18.51451.623 / 195 / 320.0
82Qwen3.8 2.4t A95BXHigh18.51451.750 / 140 / 560.0
83GPT-6 LunaMedium18.31466.511 / 51 / 288.7
84GPT 5High18.01450.317 / 149 / 460.0
85GPT-OSS 120BHigh17.81447.336 / 162 / 420.0
86Gemini 3.5 Flash LiteHigh17.71442.185 / 466 / 1700.0
87Qwen3.8 Max 0902Medium17.51461.812 / 57 / 209.0
88Grok 4.5Medium17.51445.126 / 175 / 410.0
89Gemini 3.5 Flash LiteMedium17.01439.553 / 469 / 950.0
90Gemini 3.6 FlashMinimal16.91435.659 / 586 / 1500.0
91Seed 2.0 CodeMedium16.81440.124 / 178 / 480.0
92Claude Sonnet 5Medium16.71435.858 / 208 / 870.0
93MiMo-V2.5Reasoning16.61441.340 / 307 / 790.0
94Grok Build 0.1Enabled16.51439.010 / 198 / 340.0
95GLM-5.2Reasoning16.41440.155 / 265 / 880.0
96Gemini 3.1 Flash LiteMedium16.21437.530 / 167 / 350.0
97Gemini 3.8 FlashLow16.11436.438 / 130 / 720.0
98Inkling SmallNone16.11433.637 / 211 / 520.0
99Claude Opus 4.8Medium15.91435.510 / 180 / 420.0
100Nex N2 ProNone15.91434.813 / 198 / 330.0
101Qwen3.7 PlusNone15.61434.717 / 174 / 240.0
102DeepSeek V4 FlashXHigh15.51429.642 / 163 / 930.0
103Mercury 2.5 PreviewHigh15.41430.515 / 207 / 500.0
104Claude Opus 5Medium15.41432.3117 / 192 / 1610.0
105Gemini 3.5 FlashLow15.41437.721 / 110 / 250.0
106GPT-5.6 TerraXHigh15.41431.719 / 177 / 380.0
107MiMo-V2.5High15.21447.116 / 164 / 4011.8
108Seed 2.0 CodeLow15.11429.123 / 199 / 300.0
109Gemini 3.1 Flash LiteHigh14.81429.117 / 157 / 440.0
110Hy4 PreviewNone14.71427.517 / 178 / 390.0
111Ling 3.0 FlashNone14.61425.118 / 223 / 290.0
112Muse Glimmer 30BLow14.61423.521 / 207 / 740.0
113Gemini 3.5 FlashHigh14.51423.650 / 140 / 920.0
114LongCat 2.0Enabled14.31420.266 / 425 / 2220.0
115Mistral Medium 3.5High14.31423.520 / 187 / 490.0
116Inkling SmallMax14.31421.438 / 175 / 900.0
117DeepSeek V4.1 FlashHigh14.21439.916 / 42 / 348.1
118GPT-5.4 MiniNone14.21424.035 / 153 / 460.0
119DeepSeek V4 ProHigh14.01419.748 / 171 / 790.0
120GPT 5Medium13.91422.138 / 155 / 470.0
121Gemma 4 31BNone13.81422.126 / 166 / 340.0
122North Mini CodeEnabled13.71437.815 / 175 / 5013.8
123DeepSeek V4 Pro 0813Max13.61416.356 / 167 / 990.0
124Qwen3.8 MaxMinimal13.61418.930 / 180 / 460.0
125DeepSeek V4 ProNone13.51418.721 / 200 / 310.0
126GPT-5.6 TerraNone13.41417.327 / 175 / 660.0
127DeepSeek V4 FlashHigh13.41416.414 / 199 / 710.0
128GPT-5.6 LunaNone13.31414.534 / 222 / 620.0
129Nemotron 3 Ultra 550B A55BHigh13.11418.313 / 159 / 440.0
130Qwen3.8 MaxMedium13.11414.713 / 200 / 640.0
131Seed 2.0 CodeHigh13.01415.921 / 169 / 480.0
132Grok 4.6Low12.91412.525 / 199 / 780.0
133Muse Spark 1.3Minimal12.81413.933 / 158 / 610.0
134Claude Opus 4.5Historical12.61415.629 / 317 / 720.0
135Qwen3.8 2.4t A95BMedium12.61413.620 / 168 / 520.0
136GPT-6 SolNone12.51428.69 / 50 / 338.1
137Mistral Medium 3.5None12.31411.726 / 121 / 900.0
138GPT-5.6 LunaXHigh11.91406.333 / 188 / 830.0
139DeepSeek V4 FlashMedium11.91410.014 / 164 / 420.0
140Muse Spark 1.2Medium11.51403.055 / 181 / 780.0
141GPT-5.5None11.31406.625 / 141 / 510.0
142Ling 3.0 FlashEnabled11.31420.328 / 309 / 6716.2
143Hy4 PreviewLow11.21404.916 / 146 / 680.0
144GPT-6 LunaNone11.21418.69 / 52 / 376.5
145Claude Opus 4.5High11.11396.955 / 246 / 1420.0
146Qwen3.8 FlashNone11.01402.322 / 189 / 490.0
147Grok 4.7Low11.01420.320 / 20 / 469.9
148GPT-5.5XHigh10.61401.820 / 133 / 650.0
149GLM-5.2Medium10.51401.920 / 148 / 380.0
150Claude Opus 4.8None10.51400.911 / 169 / 400.0
151Hy3 PreviewHigh10.51399.78 / 184 / 480.0
152Kimi K2.7 CodeEnabled10.11397.618 / 168 / 440.0
153GPT-5.4None10.01391.538 / 210 / 1270.0
154Qwen3.7 MaxEnabled9.91395.943 / 151 / 490.0
155GPT-5.6 SolNone9.91390.335 / 247 / 1040.0
156Claude Opus 4.5Medium9.41393.520 / 172 / 370.0
157InklingNone9.11390.951 / 306 / 1090.0
158DeepSeek V4.1 FlashNone8.81405.77 / 55 / 249.9
159Minimax M3Enabled8.81389.120 / 174 / 360.0
160InklingMedium8.51382.914 / 266 / 600.0
161GPT-5.6 TerraMedium8.31382.547 / 149 / 1080.0
162Grok 4.5Low8.01378.627 / 281 / 640.0
163Gemini 3.5 FlashMinimal7.91383.821 / 169 / 380.0
164O3Medium7.41378.714 / 202 / 440.0
165Laguna S 2.1Enabled6.91370.636 / 243 / 1110.0
166Gemini 3.6 FlashMedium6.51371.156 / 424 / 1350.0
167MiMo-V2.5Medium6.41374.138 / 295 / 1150.0
168GPT 4.1None6.41373.511 / 168 / 530.0
169GPT-OSS 120BMedium6.31369.117 / 210 / 970.0
170Claude Fable 5Low4.51357.426 / 193 / 930.0
171GPT-5.4Medium2.11341.732 / 159 / 1190.0
172Qwen3.8 Max 0902Low0.41350.12 / 51 / 378.7
173DeepSeek V4 Pro 0813High0.01331.241 / 95 / 1060.0

Individual player programs

Each row is one accepted player program for GB2-04: Xiangqi. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.

Showing 195 player programs.
Player IDModelReasoningStatusScoreEloConfidenceW / D / LRated / attemptedOpponentsCapped drawsFaults / playersGeneration
E-1b8d36cd3de27ebcClaude Fable 5.1MediumRated33.61551—93 / 109 / 36238 / 23810500 / 1First try · 2026-09-03
E-3e4a4bc7a0fd46f1Claude Fable 5.1LowRated54.91690—122 / 75 / 35232 / 23210400 / 1First try · 2026-09-03
E-7002caf3e34510f6Claude Fable 5.1XHighRated68.91780—192 / 16 / 30238 / 23810800 / 1First try · 2026-09-03
E-2aa78dde167f733fSeed 2.0 CodeMediumRated16.81440—24 / 178 / 48250 / 2509500 / 1Repaired · 2026-09-03
E-a431449a13617b4bSeed 2.0 CodeHighRated13.01416—21 / 169 / 48238 / 2409700 / 1Repaired · 2026-09-03
E-e080bf4c75437bbcSeed 2.0 CodeLowRated15.11429—23 / 199 / 30252 / 25210200 / 1First try · 2026-09-03
E-979085a7b009c0d8Claude Fable 5MediumRated27.61511—60 / 131 / 55246 / 2469900 / 1First try · 2026-09-03
E-e34f220d213bb5a8Claude Fable 5XHighRated88.41907—185 / 27 / 29241 / 2429200 / 1First try · 2026-09-03
E-fd0d4720b4df6af2Claude Fable 5LowRated4.51357—26 / 193 / 93312 / 31413400 / 1First try · 2026-09-03
E-6c73f19c641d4021Claude Fable 5.1XHighRated100.01983—209 / 18 / 17244 / 2449900 / 1First try · 2026-09-08
E-8c9e611d78967342Claude Opus 4.5Legacy_shared_thinking_budgetRated9.71397—5 / 158 / 29192 / 1927500 / 1First try · 2026-07-02
E-9a77e43e752532c8Claude Opus 4.5Thinking field omittedRated27.01510—41 / 121 / 38200 / 2006800 / 1First try · 2026-07-02
E-cbae2963ded72d76Claude Opus 4.5Medium effort + 16,000 thinking tokensRated9.41393—20 / 172 / 37229 / 2328601 / 1First try · 2026-07-21
E-e3449ff084425b16Claude Opus 4.5Legacy_shared_thinking_budgetRated15.61434—24 / 159 / 43226 / 2268100 / 1First try · 2026-07-02
E-f40463f635c43598Claude Opus 4.5High effort + 32,000 thinking tokensRated11.11397—55 / 246 / 142443 / 44313700 / 1First try · 2026-07-21
E-6344242dae68be1bClaude Opus 4.8XHighRated34.91560—94 / 88 / 26208 / 2086600 / 1First try · 2026-07-03
E-688a139ef8557587Claude Opus 4.8Thinking field omittedRated10.51401—11 / 169 / 40220 / 2208000 / 1First try · 2026-07-02
E-caf91ab5b69b1e64Claude Opus 4.8MediumRated15.91436—10 / 180 / 42232 / 2328200 / 1First try · 2026-07-02
E-048d3dcf802043b4Claude Opus 5MediumRated12.11411—38 / 113 / 79230 / 2308400 / 1First try · 2026-07-25
E-4c98514bdb0eaf10Claude Opus 5XHighRated61.01731—136 / 30 / 40206 / 2067400 / 1First try · 2026-07-25
E-72e9307528761b35Claude Opus 5Thinking disabledRated20.41465—42 / 108 / 76226 / 2268200 / 1First try · 2026-07-25
E-9e7782014171d35fClaude Opus 5Thinking disabledRated39.61590—113 / 54 / 53220 / 2208200 / 1First try · 2026-07-25
E-a02883202d334eecClaude Opus 5XHighRated90.31922—168 / 30 / 10208 / 2087400 / 1First try · 2026-07-25
E-d0f0a2b1c4bbddaeClaude Opus 5MediumRated18.81454—79 / 79 / 82240 / 2408400 / 1First try · 2026-07-25
E-651d5f685213405fClaude Opus 5.5LowRated48.11660—33 / 52 / 994 / 944700 / 1First try · 2026-09-22
E-d01a435c350a4a98Claude Opus 5.5MediumRated68.51792—75 / 10 / 1196 / 964800 / 1First try · 2026-09-22
E-d512f5c88a2f7092Claude Opus 5.5XHighRated92.61949—83 / 12 / 398 / 984900 / 1Repaired · 2026-09-22
E-7031fd4afe7acb91Claude Sonnet 5MediumRated16.71436—58 / 208 / 87353 / 35412200 / 1First try · 2026-08-09
E-74d5848169176dddClaude Sonnet 5XHighRated34.81554—96 / 182 / 66344 / 34411900 / 1First try · 2026-08-09
E-d4f6be4f3a2580efClaude Sonnet 5Thinking disabledRated22.01472—43 / 211 / 52306 / 30610500 / 1First try · 2026-08-09
E-1460cf3cd86be35cNorth Mini CodeEnabledRated20.01493—3 / 41 / 448 / 482400 / 1Repaired · 2026-07-02
E-5d143d6301429619DeepSeek V4 FlashHighRated11.91410—14 / 164 / 42220 / 2208400 / 1First try · 2026-07-01
E-8611bdf4a218bdf6DeepSeek V4 FlashXHighRated15.51430—42 / 163 / 93298 / 29812900 / 1Repaired · 2026-09-03
E-c032fca061843c32DeepSeek V4 FlashHighRated13.41416—14 / 199 / 71284 / 28411500 / 1Repaired · 2026-09-03
E-63d86bfed69d889bDeepSeek V4 ProHighRated14.01420—48 / 171 / 79298 / 29812600 / 1Repaired · 2026-09-03
E-e085b61a1d6ce07bDeepSeek V4 ProReasoning disabledRated13.51419—21 / 200 / 31252 / 25210300 / 1Repaired · 2026-09-03
E-fbe0b7f528a63870DeepSeek V4 ProXHighRated25.01493—41 / 149 / 70260 / 26010000 / 1Repaired · 2026-09-03
E-51febed9dbd63920DeepSeek V4 Pro 0813MaxRated13.61416—56 / 167 / 99322 / 32213100 / 1First try · 2026-09-03
E-6fa9bc1a814d7dd8DeepSeek V4 Pro 0813HighRated0.01331—41 / 95 / 106242 / 2429800 / 1First try · 2026-09-03
E-a50f8a13df1be0b6DeepSeek V4 Pro 0813Reasoning disabledRated23.01479—20 / 199 / 63282 / 28211500 / 1Repaired · 2026-09-03
E-8be730fa1b540588DeepSeek V4.1 FlashNoneRated8.81406—7 / 55 / 2486 / 864300 / 1First try · 2026-09-18
E-df5041881b312f3cDeepSeek V4.1 FlashMaxRated51.91686—54 / 26 / 888 / 884400 / 1First try · 2026-09-18
E-e4ef4e94986831c4DeepSeek V4.1 FlashHighRated14.21440—16 / 42 / 3492 / 924600 / 1First try · 2026-09-18
E-2be6f5c895691cb3Gemini 3.1 Flash LiteHighRated14.81429—17 / 157 / 44218 / 2187400 / 1Repaired · 2026-07-02
E-860c31323fa5eda7Gemini 3.1 Flash LiteMediumRated16.21437—30 / 167 / 35232 / 2348502 / 1Repaired · 2026-07-02
E-33e6ff93f425b731Gemini 3.5 FlashLowWaiting———0 / 0 / 00 / 0000 / 1First try · 2026-07-21
E-4ed1efa10b9f2e9eGemini 3.5 FlashMediumRated36.41567—67 / 134 / 59260 / 26011100 / 1First try · 2026-09-03
E-a08ce3c2248c6d12Gemini 3.5 FlashHighRated14.51424—50 / 140 / 92282 / 28211400 / 1Repaired · 2026-09-03
E-d026b50bd5b38eb9Gemini 3.5 FlashMinimalRated7.91384—21 / 169 / 38228 / 22810000 / 1First try · 2026-09-03
E-39ebef34ae0ea1cbGemini 3.5 Flash LiteHighRated13.21413—25 / 254 / 70349 / 35111000 / 1First try · 2026-07-24
E-5c270e2afa7b70f5Gemini 3.5 Flash LiteMediumRated15.31430—26 / 188 / 43257 / 2609800 / 1First try · 2026-07-24
E-6098de52ddfabfb1Gemini 3.5 Flash LiteMediumRated18.81449—27 / 281 / 52360 / 36711600 / 1First try · 2026-07-24
E-6a79049fd9ab6f5dGemini 3.5 Flash LiteMinimalRated23.11476—82 / 243 / 92417 / 42413900 / 1First try · 2026-07-24
E-953992515ec1424dGemini 3.5 Flash LiteHighRated22.31472—60 / 212 / 100372 / 37212100 / 1First try · 2026-07-24
E-b05b0185d0e8dc2aGemini 3.5 Flash LiteMinimalRated17.31437—79 / 251 / 130460 / 46014800 / 1Repaired · 2026-07-24
E-0b528ba96380a3b5Gemini 3.6 FlashMinimalRated20.91461—36 / 328 / 63427 / 42713800 / 1First try · 2026-07-24
E-846809faa1345207Gemini 3.6 FlashMinimalRated12.91410—23 / 258 / 87368 / 36811900 / 1Repaired · 2026-07-24
E-a5a73c81dfcf4540Gemini 3.6 FlashHighRated32.41538—96 / 138 / 124358 / 35811500 / 1First try · 2026-07-24
E-ccfb6c993d1622b0Gemini 3.6 FlashHighRated54.01678—214 / 95 / 60369 / 37212700 / 1Repaired · 2026-07-24
E-cefb1dec9ce36375Gemini 3.6 FlashMediumRated7.71377—23 / 263 / 75361 / 36111800 / 1First try · 2026-07-24
E-d109ab12db58a65fGemini 3.6 FlashMediumRated5.31365—33 / 161 / 60254 / 2549300 / 1First try · 2026-07-24
E-33ce3a08827dc190Gemini 3.8 FlashLowRated16.11436—38 / 130 / 72240 / 24010500 / 1First try · 2026-09-03
E-70b1c31234aaa223Gemini 3.8 FlashHighRated20.01462—93 / 36 / 110239 / 24010600 / 1First try · 2026-09-03
E-b793ae66c0000c32Gemini 3.8 FlashMediumRated36.41567—61 / 160 / 61282 / 28211700 / 1First try · 2026-09-03
E-62ca2464f2212fc9Gemma 4 31BReasoning enabledRated19.11457—15 / 185 / 24224 / 2268102 / 1Repaired · 2026-07-02
E-ec0cf4b37c805eeeGemma 4 31BReasoning disabledRated13.81422—26 / 166 / 34226 / 2267500 / 1First try · 2026-07-02
E-ecb06954153be8d5GPT 4.1NoneRated6.41373—11 / 168 / 53232 / 2328500 / 1First try · 2026-07-02
E-6f1aae863396df76GPT 5MediumRated13.91422—38 / 155 / 47240 / 2409200 / 1First try · 2026-07-02
E-7e3da77777a95e31GPT 5HighRated18.01450—17 / 149 / 46212 / 2128500 / 1Repaired · 2026-07-02
E-5cd71ee548acca75GPT-5.4NoneRated10.01391—38 / 210 / 127375 / 37512400 / 1First try · 2026-08-09
E-8d6c86dd58efc4beGPT-5.4XHighRated36.61566—104 / 166 / 48318 / 32111800 / 1First try · 2026-08-09
E-cae96a5e03c2613eGPT-5.4MediumRated2.11342—32 / 159 / 119310 / 31011300 / 1First try · 2026-08-09
E-0880cdf1a43cb90cGPT-5.4 MiniNoneRated14.21424—35 / 153 / 46234 / 2348700 / 1First try · 2026-07-02
E-74f5bcc8ad3796a5GPT-5.4 MiniMediumRated23.91488—49 / 147 / 32228 / 2288600 / 1First try · 2026-07-02
E-a32cb67d48c62b3bGPT-5.4 NanoMediumRated28.21516—69 / 124 / 33226 / 2267400 / 1Repaired · 2026-07-09
E-64bf5daf186f8119GPT-5.5XHighRated10.61402—20 / 133 / 65218 / 2188700 / 1First try · 2026-07-02
E-9e7bdad81107b7e4GPT-5.5MediumRated20.61466—32 / 153 / 49234 / 2348600 / 1First try · 2026-07-02
E-ba1aa87056709e9aGPT-5.5NoneRated11.31407—25 / 141 / 51217 / 2189200 / 1First try · 2026-07-02
E-0a9286b0c21ae9beGPT-5.6 LunaXHighRated11.91406—33 / 188 / 83304 / 30410900 / 1First try · 2026-08-09
E-2c7615f28028f790GPT-5.6 LunaNoneRated13.31415—34 / 222 / 62318 / 31810600 / 1First try · 2026-08-09
E-3c11110e415436c3GPT-5.6 LunaMediumRated26.31500—44 / 213 / 55312 / 31211800 / 1First try · 2026-08-09
E-66db807b1be40f67GPT-5.6 SolNoneRated9.91390—35 / 247 / 104386 / 38612600 / 1First try · 2026-08-09
E-6b542c5d0dcf2279GPT-5.6 SolXHighRated76.31826—239 / 44 / 25308 / 30811500 / 1First try · 2026-08-09
E-7f8aa62c2a56b424GPT-5.6 SolMediumRated74.91816—212 / 77 / 26315 / 31611601 / 1First try · 2026-08-09
E-235db38ccb3b52c2GPT-5.6 TerraMediumRated8.31383—47 / 149 / 108304 / 30412900 / 1First try · 2026-09-03
E-7a0c66cfb012d407GPT-5.6 TerraNoneRated13.41417—27 / 175 / 66268 / 26812000 / 1First try · 2026-09-03
E-f512a1f91eb1e0e2GPT-5.6 TerraXHighRated15.41432—19 / 177 / 38234 / 2349900 / 1First try · 2026-09-03
E-03f8ff0d1cf7b904GPT-6 AstraLowRated83.41875—185 / 27 / 32244 / 24410100 / 1First try · 2026-09-05
E-154ed79df2f33a60GPT-6 AstraXHighRated99.11977—212 / 18 / 8238 / 2389600 / 1First try · 2026-09-05
E-8863403f24a275fdGPT-6 AstraMediumRated94.31946—202 / 22 / 12236 / 23610500 / 1First try · 2026-09-05
E-1ef9a39c7098e66eGPT-6 LunaXHighRated36.01583—32 / 37 / 1786 / 864300 / 1First try · 2026-09-22
E-45b49e4fa29c67d2GPT-6 LunaNoneRated11.21419—9 / 52 / 3798 / 984900 / 1First try · 2026-09-22
E-47cd17eddb8a0568GPT-6 LunaMediumRated18.31466—11 / 51 / 2890 / 904500 / 1First try · 2026-09-22
E-c13d1b408221104dGPT-6 SolMediumRated52.31687—51 / 31 / 1496 / 964800 / 1Repaired · 2026-09-22
E-c7b9ef402e6f763eGPT-6 SolNoneRated12.51429—9 / 50 / 3392 / 924600 / 1First try · 2026-09-22
E-ca73d8cf5d48a8e6GPT-6 SolXHighRated66.11778—65 / 15 / 1090 / 904500 / 1First try · 2026-09-22
E-17e1f393fa178f71Mercury 2.5 PreviewMediumRated18.61453—16 / 177 / 44237 / 23810400 / 1First try · 2026-09-03
E-c2d325e1bfdcee6fMercury 2.5 PreviewHighRated15.41430—15 / 207 / 50272 / 27211200 / 1First try · 2026-09-03
E-d6f7a2049e8748b8Mercury 2.5 PreviewNoneRated22.91479—19 / 212 / 33264 / 26411100 / 1First try · 2026-09-03
E-20e94e7276184071Ling 3.0 FlashEnabledRated9.41428—3 / 30 / 942 / 422100 / 1Repaired · 2026-07-24
E-f38039bb8cc277a1Ling 3.0 FlashBaseline track (legacy evidence incomplete)Rated14.61425—18 / 223 / 29270 / 2709500 / 1First try · 2026-07-24
E-4ccf296e55b59be3LongCat 2.0EnabledRated19.11452—54 / 178 / 109341 / 387122046 / 1Repaired · 2026-07-24
E-9c9e87bb30b3cb99LongCat 2.0EnabledRated9.61389—12 / 247 / 113372 / 37212000 / 1First try · 2026-07-24
E-9e1d4bf411e97fa6LongCat 2.0NoneRated24.71494—44 / 122 / 49215 / 2168900 / 1First try · 2026-07-24
E-27e1dc3a8d8ad2c2Muse Glimmer 30BLowRated14.61423—21 / 207 / 74302 / 30212600 / 1Repaired · 2026-09-03
E-47c1826002c584a6Muse Glimmer 30BMediumRated18.51452—20 / 191 / 41252 / 25210900 / 1First try · 2026-09-03
E-bf91298a10a6397fMuse Glimmer 30BXHighRated23.21480—61 / 173 / 74308 / 30812300 / 1First try · 2026-09-03
E-3f1d300b580e2822Muse Spark 1.2MinimalRated20.81462—52 / 256 / 60368 / 36812800 / 1First try · 2026-08-13
E-57e6f935250459a2Muse Spark 1.2MediumRated11.51403—55 / 181 / 78314 / 31411000 / 1First try · 2026-08-13
E-a69fbe484a81a956Muse Spark 1.3MediumRated36.71570—92 / 103 / 57252 / 25210700 / 1First try · 2026-09-03
E-ca18827f54c732d4Muse Spark 1.3MinimalRated12.81414—33 / 158 / 61252 / 25410800 / 1First try · 2026-09-03
E-c60620c3c72a6064Minimax M3Reasoning enabledRated8.81389—20 / 174 / 36230 / 2307700 / 1Repaired · 2026-07-02
E-31a80f0cb86c5432Mistral Medium 3.5HighRated14.31424—20 / 187 / 49256 / 25610600 / 1Repaired · 2026-09-08
E-49f08876055e8799Mistral Medium 3.5NoneRated12.31412—26 / 121 / 90237 / 23810200 / 1First try · 2026-09-08
E-eb97811a38950c20Kimi K2.7 CodeReasoning enabledRated10.11398—18 / 168 / 44230 / 2307800 / 1Repaired · 2026-07-02
E-3c06949f23d4a77fKimi K3LowRated24.71486—103 / 195 / 120418 / 41814000 / 1Repaired · 2026-07-24
E-601725df2c678708Kimi K3MaxRated54.51682—194 / 112 / 62368 / 36812300 / 1Repaired · 2026-07-24
E-7c724729d138057bKimi K3HighRated20.31457—60 / 308 / 71439 / 44314000 / 1First try · 2026-07-24
E-6f4b3b55e4ec7cf5Nex N2 ProReasoning disabledRated15.91435—13 / 198 / 33244 / 2449000 / 1Repaired · 2026-07-11
E-958dea26b779a042Nemotron 3 Ultra 550B A55BHighRated13.11418—13 / 159 / 44216 / 2167600 / 1Repaired · 2026-07-11
E-f36b99b3d76fbb35Nemotron 3 Ultra 550B A55BReasoning disabledRated23.91489—18 / 164 / 24206 / 2067500 / 1First try · 2026-07-02
E-7e92e17a121661f4O3MediumRated7.41379—14 / 202 / 44260 / 2609600 / 1First try · 2026-07-02
E-40b5d09055384964GPT-OSS 120BMediumRated6.31369—17 / 210 / 97324 / 32613700 / 1Repaired · 2026-09-03
E-a4ab5e8396931df5GPT-OSS 120BHighRated17.81447—36 / 162 / 42240 / 24010000 / 1First try · 2026-09-03
E-e996fd38983e3b7fLaguna S 2.1EnabledRated6.91371—36 / 243 / 111390 / 39012800 / 1Repaired · 2026-07-24
E-ea08328e287de1adQwen3.7 MaxReasoning enabledRated9.91396—43 / 151 / 49243 / 2448500 / 1First try · 2026-07-02
E-84b9a07f75f324e2Qwen3.7 PlusReasoning disabledRated15.61435—17 / 174 / 24215 / 2168200 / 1First try · 2026-07-02
E-16801a4d5a2b10a7Qwen3.8 2.4t A95BMediumRated12.61414—20 / 168 / 52240 / 2409800 / 1First try · 2026-09-03
E-3eb5db5f12f236dcQwen3.8 2.4t A95BLowRated18.81450—37 / 224 / 59320 / 32012800 / 1First try · 2026-09-03
E-a2b8f19ccdac94e4Qwen3.8 2.4t A95BXHighRated18.51452—50 / 140 / 56246 / 24610600 / 1Repaired · 2026-09-03
E-3373d088557abd38Qwen3.8 27BReasoning disabledRated22.61476—63 / 180 / 69312 / 31212500 / 1Repaired · 2026-09-03
E-9c208ef629907bb2Qwen3.8 27BXHighRated54.01682—132 / 77 / 49258 / 25810700 / 1First try · 2026-09-03
E-79b89e2c50731093Qwen3.8 FlashReasoning enabledRated35.51562—38 / 157 / 53248 / 24810600 / 1First try · 2026-09-03
E-a3a85623290687aeQwen3.8 FlashReasoning disabledRated11.01402—22 / 189 / 49260 / 26010800 / 1First try · 2026-09-03
E-1f87c69eddf28f4eQwen3.8 MaxMediumRated13.11415—13 / 200 / 64277 / 27811100 / 1First try · 2026-08-08
E-2c5709bd26aef5e5Qwen3.8 MaxXHighRated41.71603—102 / 106 / 39247 / 24710500 / 1First try · 2026-08-18
E-91e0eadd75202409Qwen3.8 MaxMinimalRated13.61419—30 / 180 / 46256 / 25610000 / 1First try · 2026-08-08
E-42bb35e90762af83Qwen3.8 Max 0902LowRated0.41350—2 / 51 / 3790 / 904500 / 1First try · 2026-09-18
E-c3ad8f8153773ec4Qwen3.8 Max 0902MediumRated17.51462—12 / 57 / 2089 / 904500 / 1First try · 2026-09-18
E-fda2a71e653ba484Qwen3.8 Max 0902XhighRated61.41750—65 / 10 / 782 / 824100 / 1First try · 2026-09-18
E-2aaa1a2095c3d9b6Ox AlphaLowRated19.71456—42 / 194 / 88324 / 32413100 / 1First try · 2026-08-22
E-43ae1b9ca4bd7996Ox AlphaHighRated38.71583—74 / 121 / 55250 / 25010100 / 1Repaired · 2026-08-22
E-454f79b70ee12fe0Ox AlphaMaxRated93.21939—202 / 28 / 8238 / 23810600 / 1First try · 2026-08-22
E-6139f660620fd73bOx AlphaHighRated27.51510—76 / 122 / 44242 / 24210300 / 1First try · 2026-08-22
E-6a2b79a57d322daeOx AlphaMaxRated35.01560—102 / 98 / 40240 / 24010100 / 1First try · 2026-08-22
E-92dc825a33843ff8Ox AlphaLowRated22.81476—49 / 219 / 71339 / 34012900 / 1Repaired · 2026-08-22
E-ac806e30e1bd1958Ox AlphaLowRated37.11573—59 / 133 / 48240 / 24010100 / 1Repaired · 2026-08-22
E-be47453e36658247Ox AlphaHighRated19.41456—52 / 161 / 69282 / 28211000 / 1First try · 2026-08-22
E-d89754cdf98b2ae2Ox AlphaMaxRated38.51582—87 / 113 / 48248 / 24811100 / 1First try · 2026-08-22
E-25e56c6bfae33c62Step 3.7 FlashMediumRated18.51452—23 / 195 / 32250 / 2508700 / 1Repaired · 2026-07-02
E-3fd10f7865cc280eHy3 PreviewNoneRated19.01457—43 / 132 / 29204 / 2047300 / 1Repaired · 2026-07-02
E-51c104b34ef2a244Hy3 PreviewHighRated10.51400—8 / 184 / 48240 / 2409300 / 1First try · 2026-07-02
E-57fea636001e1361Hy4 PreviewHighRated32.31542—76 / 119 / 53248 / 2489400 / 1First try · 2026-09-03
E-805ec3d0dca6e5c3Hy4 PreviewNoneRated14.71428—17 / 178 / 39234 / 23410100 / 1First try · 2026-09-03
E-a0de6259daf8e531Hy4 PreviewLowRated11.21405—16 / 146 / 68230 / 2309600 / 1First try · 2026-09-03
E-646ff33c7bab8b13InklingNoneRated4.91364—37 / 122 / 73232 / 2328100 / 1First try · 2026-07-24
E-ddc16fa197bfc7c5InklingNoneRated13.21418—14 / 184 / 36234 / 2368701 / 1First try · 2026-07-24
E-f130161523da1e6bInklingMaxRated19.71453—67 / 266 / 93426 / 42613400 / 1First try · 2026-07-24
E-fce01db31ecf26d2InklingMediumRated8.51383—14 / 266 / 60340 / 34011500 / 1First try · 2026-07-24
E-20d371c6aae692a2Inkling SmallMediumRated19.11452—59 / 189 / 78326 / 32612800 / 1Repaired · 2026-08-09
E-a50e6392704c24e8Inkling SmallNoneRated16.11434—37 / 211 / 52300 / 30111800 / 1First try · 2026-08-09
E-df6d76539ff35338Inkling SmallMaxRated14.31421—38 / 175 / 90303 / 30312000 / 1Repaired · 2026-08-18
E-07caaa12175b0b3cGrok 4.5HighRated22.21471—93 / 157 / 114364 / 36411400 / 1First try · 2026-07-24
E-5a4033db1131bf1dGrok 4.5LowRated8.01379—27 / 281 / 64372 / 37211700 / 1First try · 2026-07-24
E-ba6a8e6d7fc9a48dGrok 4.5MediumRated17.51445—26 / 175 / 41242 / 2428900 / 1First try · 2026-07-24
E-34fc96241edb02daGrok 4.6MediumRated43.51614—98 / 101 / 49248 / 24810100 / 1Repaired · 2026-09-03
E-512d12dc51a88103Grok 4.6LowRated12.91412—25 / 199 / 78302 / 30211800 / 1First try · 2026-09-03
E-cabe8933cf2c203fGrok 4.6XHighRated36.01562—104 / 141 / 83328 / 32813400 / 1First try · 2026-09-03
E-509c5d749c7fba7fGrok 4.7LowRated11.01420—20 / 20 / 4686 / 864300 / 1First try · 2026-09-23
E-9a4089c5547a95c3Grok 4.7MediumRated71.11810—73 / 11 / 892 / 924600 / 1First try · 2026-09-22
E-85934b32572399daGrok Build 0.1Reasoning enabledRated16.51439—10 / 198 / 34242 / 2428700 / 1Repaired · 2026-07-02
E-00e6914e513b1656MiMo-V2.5Reasoning enabledRated11.31406—18 / 150 / 56224 / 2247400 / 1Repaired · 2026-07-02
E-23e877112cb95491MiMo-V2.5Reasoning enabledRated1.51342—20 / 145 / 59224 / 2248300 / 1Repaired · 2026-07-01
E-2f7e15b8aa123825MiMo-V2.5Reasoning enabledRated18.91457—13 / 157 / 36206 / 2068400 / 1Repaired · 2026-07-02
E-7ad356726cce2b22MiMo-V2.5Reasoning disabledRated18.91455—32 / 143 / 45220 / 2208300 / 1Repaired · 2026-07-01
E-d58c55e107783a21MiMo-V2.5Reasoning disabledRated14.41427—8 / 164 / 34206 / 2067800 / 1Repaired · 2026-07-02
E-f8929b12716a2221MiMo-V2.5HighRated17.71475—5 / 42 / 754 / 542700 / 1Repaired · 2026-07-02
E-ffdebde8a72ed049MiMo-V2.5-ProReasoning enabledRated27.21509—56 / 124 / 44224 / 2247800 / 1Repaired · 2026-07-02
E-066f34d02b630f51MiMo-V2.6-FlashReasoning enabledRated49.41671—47 / 14 / 2384 / 844200 / 1Repaired · 2026-09-22
E-93cc618248ca3498MiMo-V2.6-ProReasoning enabledRated52.61689—38 / 54 / 698 / 984900 / 1First try · 2026-09-22
E-aff2ef6c72e32ac8MiMo-V2.6-ProReasoning disabledRated28.21531—19 / 58 / 1390 / 904500 / 1First try · 2026-09-22
E-1d5f5ff0402ff944GLM-5.2Reasoning disabledRated16.31440—24 / 143 / 29196 / 1967200 / 1Repaired · 2026-07-02
E-5e99d0de9a256377GLM-5.2HighRated34.21554—57 / 117 / 70244 / 2449800 / 1First try · 2026-09-03
E-78e36459347d3f38GLM-5.2XHighRated31.11533—72 / 88 / 90250 / 25010800 / 1First try · 2026-09-03
E-912f31ad14c4bf0aGLM-5.2HighRated10.51402—20 / 148 / 38206 / 2066800 / 1Repaired · 2026-07-11
E-f776c26a98306f5dGLM-5.2Reasoning disabledRated16.41440—31 / 122 / 59212 / 2127500 / 1First try · 2026-07-11
E-fc8d4cc9bcd38e05GLM-5.2Reasoning disabledRated19.01456—32 / 153 / 51236 / 2369600 / 1Repaired · 2026-09-03
E-4ae5adf893239ec8GLM 5.3LowRated19.61459—36 / 172 / 44252 / 25210300 / 1First try · 2026-09-03
E-c2bce9f934aadf7bGLM 5.3HighRated68.11775—191 / 36 / 22249 / 25010701 / 1Repaired · 2026-09-03
E-94e38f2c3fd2dfddGLM 5.3 FlashMaxRated63.51745—159 / 52 / 35246 / 2469700 / 1First try · 2026-09-03
E-a5f4f135a9636cdfGLM 5.3 FlashLowRated38.41582—101 / 96 / 47244 / 24410300 / 1First try · 2026-09-03
E-c3661ce5b6533804GLM 5.3 FlashHighRated71.31795—152 / 55 / 61268 / 26810300 / 1First try · 2026-09-03
E-3013ec6b8dad2b39GLM-5.3 FlashXLowRated25.91516—14 / 57 / 1788 / 884400 / 1First try · 2026-09-22
E-785d1448a7a91b7bGLM-5.3 FlashXMaxRated59.41734—52 / 33 / 691 / 924600 / 1First try · 2026-09-22
E-ac2639eaa5fdc259GLM-5.3 FlashXHighRated28.11530—22 / 54 / 1692 / 924600 / 1First try · 2026-09-22