Game profile
Hex
Hex is a connection game on a hexagonal grid where players race to join opposite board edges, with a swap option after the first move.
Scores here compare player programs using DuelLab's encoded rules for Hex; they are not a broad measure of human play strength.
By model and setting
GB2-05: Hex by model and setting
Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and the rating-evidence index combine those contributing programs. A zero index is a clipped endpoint, not zero uncertainty about future generations.
| Rank | Model | Reasoning | Score | Raw Elo | W / D / L | Rating-evidence index |
|---|---|---|---|---|---|---|
| 1 |  GPT-6 Astra | XHigh | 100.0 | 2307.4 | 244 / 0 / 0 | 0.0 |
| 2 | GPT-6 Astra | Low | 97.5 | 2268.9 | 225 / 0 / 7 | 0.0 |
| 3 |  GLM 5.3 | Max | 93.2 | 2200.0 | 222 / 0 / 16 | 0.0 |
| 4 |  Claude Fable 5.1 | XHigh | 92.0 | 2180.6 | 211 / 0 / 13 | 0.0 |
| 5 |  Qwen3.8 Max | Minimal | 90.9 | 2161.6 | 231 / 0 / 18 | 0.0 |
| 6 | Claude Opus 5 | XHigh | 90.6 | 2162.1 | 320 / 0 / 28 | 0.0 |
| 7 | Claude Fable 5.1 | Low | 88.8 | 2129.7 | 235 / 0 / 15 | 0.0 |
| 8 | Claude Opus 5 | None | 88.2 | 2122.2 | 383 / 0 / 31 | 0.0 |
| 9 | Claude Fable 5.1 | Medium | 87.1 | 2102.6 | 211 / 0 / 21 | 0.0 |
| 10 | Claude Opus 5.5 | XHigh | 86.5 | 2109.9 | 82 / 0 / 2 | 10.5 |
| 11 | GPT-6 Astra | Medium | 85.7 | 2081.1 | 216 / 0 / 16 | 0.0 |
| 12 | GPT-5.4 | XHigh | 82.3 | 2022.6 | 296 / 0 / 34 | 0.0 |
| 13 | Claude Opus 5 | Medium | 82.3 | 2027.7 | 371 / 0 / 47 | 0.0 |
| 14 |  Grok 4.6 | XHigh | 81.7 | 2016.8 | 208 / 0 / 32 | 0.0 |
| 15 |  Gemini 3.6 Flash | High | 80.7 | 1995.7 | 599 / 0 / 115 | 0.0 |
| 16 | Grok 4.7 | Medium | 79.8 | 2003.8 | 82 / 0 / 6 | 9.2 |
| 17 | Claude Opus 5.5 | Low | 78.8 | 1986.9 | 79 / 0 / 9 | 9.2 |
| 18 | Grok 4.6 | Medium | 78.7 | 1969.8 | 193 / 0 / 45 | 0.0 |
| 19 | GPT-6 Sol | Medium | 78.3 | 1977.1 | 86 / 0 / 8 | 7.5 |
| 20 | Qwen3.8 Max 0902 | XHigh | 78.0 | 1976.2 | 73 / 0 / 5 | 12.5 |
| 21 | GPT-6 Sol | XHigh | 75.3 | 1932.3 | 81 / 0 / 5 | 9.9 |
| 22 | GPT-5.6 Sol | Medium | 74.4 | 1897.1 | 243 / 0 / 75 | 0.0 |
| 23 | GLM 5.3 Flash | Max | 74.2 | 1896.2 | 177 / 0 / 73 | 0.0 |
| 24 |  DeepSeek V4.1 Flash | Max | 73.4 | 1903.1 | 73 / 0 / 9 | 11.1 |
| 25 | GPT-5.5 | Medium | 73.2 | 1885.7 | 127 / 0 / 45 | 0.0 |
| 26 | GPT-5.6 Sol | XHigh | 72.5 | 1866.3 | 253 / 0 / 85 | 0.0 |
| 27 | Claude Opus 5.5 | Medium | 71.9 | 1877.0 | 78 / 0 / 14 | 8.1 |
| 28 | GLM 5.3 | High | 70.6 | 1839.9 | 148 / 0 / 98 | 0.0 |
| 29 | Grok 4.5 | High | 70.1 | 1826.8 | 269 / 0 / 93 | 0.0 |
| 30 | GPT 5 | High | 69.9 | 1832.7 | 118 / 0 / 56 | 0.0 |
| 31 | Gemini 3.5 Flash | Medium | 68.4 | 1803.9 | 156 / 0 / 98 | 0.0 |
| 32 | DeepSeek V4 Pro 0813 | Max | 67.6 | 1791.2 | 190 / 0 / 64 | 0.0 |
| 33 | Claude Fable 5 | Medium | 67.3 | 1787.6 | 160 / 0 / 96 | 0.0 |
| 34 | GPT-5.5 | XHigh | 67.2 | 1789.0 | 150 / 0 / 36 | 0.0 |
| 35 | Claude Fable 5 | Low | 67.0 | 1782.9 | 160 / 0 / 94 | 0.0 |
| 36 | Qwen3.8 2.4t A95B | XHigh | 66.9 | 1781.9 | 147 / 0 / 95 | 0.0 |
| 37 | GPT-5.4 | Medium | 65.9 | 1762.7 | 220 / 0 / 98 | 0.0 |
| 38 | GPT-6 Sol | None | 65.8 | 1779.6 | 65 / 0 / 25 | 8.7 |
| 39 | Gemini 3.6 Flash | Medium | 65.8 | 1757.1 | 579 / 0 / 251 | 0.0 |
| 40 | Gemini 3.8 Flash | High | 64.3 | 1740.4 | 147 / 0 / 97 | 0.0 |
| 41 | Qwen3.8 Flash | Enabled | 64.3 | 1739.6 | 164 / 0 / 84 | 0.0 |
| 42 | Grok 4.5 | Medium | 63.6 | 1730.9 | 135 / 0 / 69 | 0.0 |
| 43 | Qwen3.8 Max | Medium | 63.1 | 1720.9 | 143 / 0 / 99 | 0.0 |
| 44 |  Hy3 Preview | High | 61.5 | 1699.5 | 113 / 0 / 63 | 0.0 |
| 45 | GPT 5 | Medium | 60.0 | 1674.5 | 128 / 0 / 64 | 0.0 |
| 46 | Gemini 3.5 Flash | High | 59.9 | 1667.0 | 173 / 0 / 145 | 0.0 |
| 47 |  Ox Alpha | Max | 59.2 | 1656.8 | 457 / 0 / 349 | 0.0 |
| 48 | Hy4 Preview | High | 58.9 | 1653.2 | 142 / 0 / 100 | 0.0 |
| 49 | Qwen3.8 27B | XHigh | 58.8 | 1648.0 | 198 / 0 / 132 | 0.0 |
| 50 | GPT-5.6 Terra | Medium | 58.3 | 1641.5 | 168 / 0 / 128 | 0.0 |
| 51 | Qwen3.8 2.4t A95B | Medium | 58.2 | 1639.2 | 174 / 0 / 156 | 0.0 |
| 52 | GLM-5.3 FlashX | Max | 57.7 | 1651.9 | 53 / 0 / 33 | 9.9 |
| 53 |  MiMo-V2.6-Flash | Enabled | 56.7 | 1633.7 | 54 / 0 / 40 | 7.5 |
| 54 |  Kimi K3 | Low | 56.2 | 1604.1 | 295 / 0 / 202 | 0.0 |
| 55 | Qwen3.8 Max 0902 | Low | 56.1 | 1627.3 | 56 / 0 / 30 | 9.9 |
| 56 | GLM-5.2 | High | 56.0 | 1603.9 | 169 / 0 / 153 | 0.0 |
| 57 | GPT-5.4 | None | 55.5 | 1596.3 | 184 / 0 / 148 | 0.0 |
| 58 | DeepSeek V4 Pro | High | 55.2 | 1591.7 | 169 / 0 / 155 | 0.0 |
| 59 | Muse Spark 1.3 | Medium | 55.1 | 1591.4 | 138 / 0 / 136 | 0.0 |
| 60 |  Seed 2.0 Code | High | 55.0 | 1587.9 | 167 / 0 / 163 | 0.0 |
| 61 | GLM-5.2 | XHigh | 54.7 | 1586.9 | 112 / 0 / 132 | 0.0 |
| 62 | Grok 4.6 | Low | 54.5 | 1581.7 | 149 / 0 / 149 | 0.0 |
| 63 |  Mistral Medium 3.5 | High | 54.3 | 1579.0 | 150 / 0 / 114 | 0.0 |
| 64 | DeepSeek V4 Flash | High | 54.2 | 1576.6 | 172 / 0 / 150 | 0.0 |
| 65 | GLM 5.3 Flash | High | 54.2 | 1576.0 | 151 / 0 / 175 | 0.0 |
| 66 | Hy4 Preview | None | 53.9 | 1569.9 | 167 / 0 / 167 | 0.0 |
| 67 | Kimi K3 | High | 53.7 | 1564.0 | 266 / 0 / 214 | 0.0 |
| 68 | Ox Alpha | Low | 53.3 | 1563.0 | 448 / 0 / 394 | 0.0 |
| 69 | GPT-5.6 Luna | XHigh | 53.1 | 1555.6 | 245 / 0 / 191 | 0.0 |
| 70 | Muse Spark 1.2 | Minimal | 52.9 | 1553.2 | 215 / 0 / 201 | 0.0 |
| 71 | Qwen3.7 Plus | Enabled | 52.8 | 1558.3 | 121 / 0 / 105 | 0.0 |
| 72 | GPT-6 Luna | XHigh | 52.8 | 1573.1 | 54 / 0 / 38 | 8.1 |
| 73 | Grok Build 0.1 | Enabled | 52.6 | 1554.7 | 137 / 0 / 97 | 0.0 |
| 74 | GLM 5.3 | Low | 52.6 | 1551.1 | 164 / 0 / 128 | 0.0 |
| 75 | Claude Opus 4.8 | XHigh | 52.4 | 1552.7 | 115 / 0 / 103 | 0.0 |
| 76 | Claude Sonnet 5 | XHigh | 52.3 | 1545.5 | 179 / 0 / 161 | 0.0 |
| 77 | GPT-OSS 120B | High | 52.3 | 1548.9 | 126 / 0 / 126 | 0.0 |
| 78 | Claude Fable 5 | XHigh | 52.3 | 1546.9 | 157 / 0 / 139 | 0.0 |
| 79 | Hy4 Preview | Low | 52.2 | 1543.7 | 168 / 0 / 150 | 0.0 |
| 80 |  Nemotron 3 Ultra 550B A55B | None | 52.1 | 1550.4 | 109 / 0 / 73 | 0.0 |
| 81 | Kimi K2.7 Code | Enabled | 52.1 | 1548.1 | 106 / 0 / 98 | 0.0 |
| 82 | O3 | High | 51.8 | 1535.7 | 860 / 0 / 749 | 0.0 |
| 83 | Claude Sonnet 5 | Medium | 51.8 | 1535.4 | 188 / 0 / 200 | 0.0 |
| 84 | Grok 4.5 | Low | 51.7 | 1533.1 | 199 / 0 / 206 | 0.0 |
| 85 | GPT-5.6 Terra | XHigh | 51.4 | 1531.1 | 187 / 0 / 139 | 0.0 |
| 86 | GLM-5.3 FlashX | Low | 51.3 | 1546.7 | 46 / 0 / 54 | 6.0 |
| 87 | MiMo-V2.6-Flash | None | 51.2 | 1548.0 | 43 / 0 / 49 | 8.1 |
| 88 | Gemini 3.8 Flash | Low | 51.1 | 1526.5 | 162 / 0 / 156 | 0.0 |
| 89 | Gemini 3.6 Flash | Minimal | 50.9 | 1520.3 | 485 / 0 / 424 | 0.0 |
| 90 | Gemma 4 31B | Enabled | 50.7 | 1524.1 | 130 / 0 / 110 | 0.0 |
| 91 | GPT-5.6 Sol | None | 50.4 | 1512.3 | 228 / 0 / 178 | 0.0 |
| 92 | GPT-5.4 Mini | Medium | 50.2 | 1517.3 | 122 / 0 / 96 | 0.0 |
| 93 | GLM-5.2 | Medium | 50.0 | 1517.5 | 95 / 0 / 81 | 0.0 |
| 94 | DeepSeek V4 Flash | None | 49.7 | 1507.4 | 145 / 0 / 107 | 0.0 |
| 95 | North Mini Code | Enabled | 49.7 | 1521.7 | 132 / 0 / 108 | 8.7 |
| 96 | O3 | Medium | 49.5 | 1505.4 | 114 / 0 / 112 | 0.0 |
| 97 | Seed 2.0 Code | Medium | 49.4 | 1502.6 | 152 / 0 / 106 | 0.0 |
| 98 | Muse Spark 1.2 | Medium | 49.4 | 1496.8 | 209 / 0 / 211 | 0.0 |
| 99 | Muse Glimmer 30B | XHigh | 48.9 | 1491.8 | 141 / 0 / 177 | 0.0 |
| 100 | Laguna S 2.1 | None | 48.8 | 1495.6 | 233 / 0 / 195 | 0.0 |
| 101 |  Step 3.7 Flash | Medium | 48.8 | 1494.6 | 108 / 0 / 118 | 0.0 |
| 102 | GPT-5.5 | None | 48.3 | 1490.1 | 94 / 0 / 86 | 0.0 |
| 103 | Gemini 3.8 Flash | Medium | 48.3 | 1484.9 | 114 / 0 / 126 | 0.0 |
| 104 | GPT-5.4 Nano | Medium | 48.0 | 1482.7 | 220 / 0 / 206 | 0.0 |
| 105 | Claude Opus 4.5 | Medium | 47.8 | 1470.9 | 240 / 0 / 216 | 0.0 |
| 106 | Claude Opus 4.5 | High | 47.7 | 1468.1 | 246 / 0 / 232 | 0.0 |
| 107 | Ox Alpha | High | 47.6 | 1473.1 | 382 / 0 / 420 | 0.0 |
| 108 | DeepSeek V4.1 Flash | High | 47.4 | 1488.6 | 38 / 0 / 44 | 11.1 |
| 109 | Claude Opus 4.5 | None | 47.2 | 1470.5 | 111 / 0 / 83 | 0.0 |
| 110 | Claude Opus 4.5 | Historical | 47.2 | 1470.8 | 193 / 0 / 181 | 0.0 |
| 111 | GPT-6 Luna | Medium | 47.0 | 1482.6 | 46 / 0 / 40 | 9.9 |
| 112 | Claude Opus 4.8 | Medium | 46.6 | 1459.3 | 119 / 0 / 103 | 0.0 |
| 113 | Qwen3.8 27B | Medium | 46.6 | 1455.5 | 159 / 0 / 135 | 0.0 |
| 114 | GLM-5.2 | Reasoning | 46.5 | 1459.5 | 183 / 0 / 207 | 0.0 |
| 115 | DeepSeek V4 Pro 0813 | High | 46.5 | 1454.8 | 152 / 0 / 116 | 0.0 |
| 116 | MiMo-V2.5 | Reasoning | 46.1 | 1455.3 | 83 / 0 / 91 | 0.0 |
| 117 | Muse Spark 1.3 | Minimal | 45.9 | 1445.3 | 140 / 0 / 164 | 0.0 |
| 118 | DeepSeek V4 Pro | XHigh | 45.9 | 1443.9 | 138 / 0 / 164 | 0.0 |
| 119 | GPT-6 Luna | None | 45.8 | 1461.4 | 36 / 0 / 56 | 8.1 |
| 120 | GPT 5 | Low | 45.7 | 1454.1 | 58 / 0 / 66 | 1.0 |
| 121 | Qwen3.8 Max | XHigh | 43.5 | 1405.3 | 143 / 0 / 183 | 0.0 |
| 122 | Qwen3.7 Max | Enabled | 43.0 | 1399.2 | 131 / 0 / 145 | 0.0 |
| 123 | Step 3.7 Flash | High | 43.0 | 1403.1 | 105 / 0 / 93 | 0.0 |
| 124 | Qwen3.8 Max 0902 | Medium | 41.8 | 1398.2 | 37 / 0 / 55 | 8.1 |
| 125 | DeepSeek V4 Pro | None | 41.5 | 1376.3 | 119 / 0 / 131 | 0.0 |
| 126 | GPT-5.6 Luna | Medium | 41.2 | 1369.2 | 161 / 0 / 158 | 0.0 |
| 127 | Qwen3.7 Plus | None | 41.2 | 1374.2 | 90 / 0 / 112 | 0.0 |
| 128 | GLM 5.3 Flash | Low | 41.0 | 1370.0 | 115 / 0 / 127 | 0.0 |
| 129 | Inkling Small | Max | 40.3 | 1356.3 | 129 / 0 / 158 | 0.0 |
| 130 | Qwen3.7 Max | None | 40.1 | 1355.3 | 105 / 0 / 129 | 0.0 |
| 131 | Mercury 2.5 Preview | None | 39.9 | 1350.4 | 127 / 0 / 133 | 0.0 |
| 132 | Grok 4.7 | Low | 39.0 | 1357.3 | 22 / 0 / 54 | 13.2 |
| 133 | MiMo-V2.5 | Reasoning | 38.5 | 1330.6 | 105 / 0 / 133 | 0.0 |
| 134 | Step 3.7 Flash | Low | 37.8 | 1313.8 | 152 / 0 / 238 | 0.0 |
| 135 | MiMo-V2.6-Pro | None | 37.3 | 1326.9 | 27 / 0 / 65 | 8.1 |
| 136 | Qwen3.8 2.4t A95B | Low | 36.8 | 1304.1 | 94 / 0 / 134 | 0.0 |
| 137 | GLM-5.3 FlashX | High | 36.6 | 1314.2 | 28 / 0 / 66 | 7.5 |
| 138 | Nemotron 3 Ultra 550B A55B | High | 36.3 | 1297.1 | 157 / 0 / 225 | 0.0 |
| 139 |  Nex N2 Pro | None | 36.0 | 1292.5 | 79 / 0 / 127 | 0.0 |
| 140 | MiMo-V2.5-Pro | Enabled | 35.8 | 1287.7 | 75 / 0 / 145 | 0.0 |
| 141 | Laguna S 2.1 | Enabled | 35.8 | 1280.2 | 283 / 0 / 554 | 0.0 |
| 142 | LongCat 2.0 | Enabled | 35.5 | 1276.3 | 325 / 0 / 513 | 0.0 |
| 143 | DeepSeek V4.1 Flash | None | 34.6 | 1283.8 | 26 / 0 / 64 | 8.7 |
| 144 |  Minimax M3 | None | 33.8 | 1254.7 | 92 / 0 / 140 | 0.0 |
| 145 | GPT-5.6 Luna | None | 31.1 | 1208.3 | 97 / 0 / 217 | 0.0 |
| 146 | Claude Opus 4.8 | None | 30.9 | 1211.7 | 67 / 0 / 137 | 0.0 |
| 147 | Inkling | None | 30.6 | 1206.1 | 138 / 0 / 266 | 0.0 |
| 148 | Claude Sonnet 5 | None | 30.4 | 1197.6 | 97 / 0 / 225 | 0.0 |
| 149 | MiMo-V2.5 | Medium | 29.0 | 1179.1 | 82 / 0 / 138 | 0.0 |
| 150 | Qwen3.8 Flash | None | 26.8 | 1143.3 | 58 / 0 / 202 | 0.0 |
| 151 | MiMo-V2.5-Pro | None | 26.4 | 1138.4 | 73 / 0 / 143 | 0.0 |
| 152 | Gemini 3.5 Flash Lite | High | 25.9 | 1124.3 | 185 / 0 / 573 | 0.0 |
| 153 | GLM-5.2 | Reasoning | 25.5 | 1123.7 | 49 / 0 / 187 | 0.0 |
| 154 | Mistral Medium 3.5 | None | 24.9 | 1113.9 | 35 / 0 / 195 | 0.0 |
| 155 | MiMo-V2.5 | Reasoning | 24.3 | 1106.4 | 117 / 0 / 271 | 0.0 |
| 156 | Hy3 Preview | None | 24.1 | 1099.8 | 73 / 0 / 183 | 0.0 |
| 157 | DeepSeek V4 Flash | Medium | 24.1 | 1103.8 | 97 / 0 / 269 | 0.0 |
| 158 | Inkling | Medium | 23.2 | 1086.1 | 71 / 0 / 171 | 0.0 |
| 159 | GPT-OSS 120B | Medium | 22.7 | 1078.4 | 48 / 0 / 204 | 0.0 |
| 160 | Gemini 3.1 Flash Lite | Medium | 22.5 | 1076.5 | 58 / 0 / 150 | 0.0 |
| 161 | Mercury 2.5 Preview | Medium | 22.0 | 1066.0 | 51 / 0 / 217 | 0.0 |
| 162 | GPT-5.4 Mini | None | 21.6 | 1064.7 | 44 / 0 / 146 | 0.0 |
| 163 | Inkling | Max | 21.6 | 1055.9 | 155 / 0 / 613 | 0.0 |
| 164 | Gemini 3.5 Flash Lite | Medium | 21.1 | 1047.5 | 148 / 0 / 634 | 0.0 |
| 165 | GPT-OSS 120B | Low | 20.9 | 1051.2 | 49 / 0 / 181 | 0.0 |
| 166 | Nex N2 Pro | Enabled | 20.3 | 1042.2 | 50 / 0 / 166 | 0.0 |
| 167 | Gemini 3.5 Flash | Low | 20.2 | 1049.5 | 27 / 0 / 91 | 2.1 |
| 168 | Seed 2.0 Code | Low | 19.8 | 1032.4 | 44 / 0 / 192 | 0.0 |
| 169 | Muse Glimmer 30B | Medium | 19.4 | 1026.2 | 43 / 0 / 183 | 0.0 |
| 170 | LongCat 2.0 | None | 19.0 | 1021.1 | 90 / 0 / 334 | 0.0 |
| 171 | Inkling Small | Medium | 17.5 | 995.7 | 25 / 0 / 211 | 0.0 |
| 172 | Gemini 3.5 Flash | Minimal | 17.5 | 994.8 | 42 / 0 / 204 | 0.0 |
| 173 | GPT 4.1 | None | 16.5 | 981.5 | 42 / 0 / 168 | 0.0 |
| 174 | Gemma 4 31B | None | 16.2 | 976.7 | 44 / 0 / 170 | 0.0 |
| 175 | Gemini 3.1 Flash Lite | High | 14.5 | 951.1 | 37 / 0 / 161 | 0.0 |
| 176 | Gemini 3.1 Flash Lite | None | 14.0 | 943.8 | 29 / 0 / 147 | 0.0 |
| 177 | Gemini 3.5 Flash Lite | Minimal | 13.9 | 932.4 | 105 / 0 / 721 | 0.0 |
| 178 | GPT-5.4 Nano | None | 13.3 | 931.2 | 62 / 0 / 342 | 0.0 |
| 179 | Inkling Small | None | 6.9 | 828.1 | 10 / 0 / 224 | 0.0 |
| 180 | Muse Glimmer 30B | Low | 6.2 | 816.7 | 19 / 0 / 215 | 0.0 |
| 181 | Minimax M3 | Enabled | 0.0 | 717.0 | 4 / 0 / 248 | 0.0 |
Underlying results
Individual player programs
Each row is one accepted player program for GB2-05: Hex. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.
Showing 212 player programs.
| Player ID | Model | Reasoning | Status | Score | Elo | Confidence | W / D / L | Rated / attempted | Opponents | Capped draws | Faults / players | Generation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| E-0d57686336af5f53 | Claude Fable 5.1 | Medium | Rated | 87.1 | 2103 | — | 211 / 0 / 21 | 232 / 232 | 100 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-44ec1bd2d32e7f19 | Claude Fable 5.1 | Low | Rated | 88.8 | 2130 | — | 235 / 0 / 15 | 250 / 250 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-40f186761fd62a24 | Seed 2.0 Code | High | Rated | 55.0 | 1588 | — | 167 / 0 / 163 | 330 / 330 | 142 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-42ff68fc0dfc382d | Seed 2.0 Code | Medium | Rated | 49.4 | 1503 | — | 152 / 0 / 106 | 258 / 258 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-9e9cc208a8353816 | Seed 2.0 Code | Low | Rated | 19.8 | 1032 | — | 44 / 0 / 192 | 236 / 236 | 99 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-74891ad59419f58e | Claude Fable 5 | XHigh | Rated | 52.3 | 1547 | — | 157 / 0 / 139 | 296 / 296 | 125 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-9e28736481da4a88 | Claude Fable 5 | Medium | Rated | 67.3 | 1788 | — | 160 / 0 / 96 | 256 / 256 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e9b069b56cfc37cd | Claude Fable 5 | Low | Rated | 67.0 | 1783 | — | 160 / 0 / 94 | 254 / 254 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-f1eb379197580e01 | Claude Fable 5.1 | XHigh | Rated | 92.0 | 2181 | — | 211 / 0 / 13 | 224 / 224 | 98 | 0 | 0 / 1 | Repaired · 2026-09-08 |
| E-7e9bc3ebc12ef500 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 47.8 | 1481 | — | 91 / 0 / 93 | 184 / 184 | 75 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-934b5bc34a7e20b9 | Claude Opus 4.5 | Thinking field omitted | Rated | 47.2 | 1470 | — | 111 / 0 / 83 | 194 / 194 | 85 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-a75e9d71efa4a6bc | Claude Opus 4.5 | Medium effort + 16,000 thinking tokens | Rated | 47.8 | 1471 | — | 240 / 0 / 216 | 456 / 456 | 146 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ccacc93776fb7c88 | Claude Opus 4.5 | High effort + 32,000 thinking tokens | Rated | 47.7 | 1468 | — | 246 / 0 / 232 | 478 / 478 | 145 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ff0722d17402bafa | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 46.5 | 1460 | — | 102 / 0 / 88 | 190 / 190 | 81 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-233f9cae6335e53d | Claude Opus 4.8 | Thinking field omitted | Rated | 30.9 | 1212 | — | 67 / 0 / 137 | 204 / 204 | 85 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-6774d700e60de31a | Claude Opus 4.8 | XHigh | Rated | 52.4 | 1553 | — | 115 / 0 / 103 | 218 / 218 | 82 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-924d7e6ee41b562e | Claude Opus 4.8 | Medium | Rated | 46.6 | 1459 | — | 119 / 0 / 103 | 222 / 222 | 86 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-09963ffe0b0fa5fd | Claude Opus 5 | Thinking disabled | Rated | 85.2 | 2075 | — | 190 / 0 / 18 | 208 / 208 | 87 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-32c377b229530444 | Claude Opus 5 | Medium | Rated | 78.2 | 1962 | — | 185 / 0 / 31 | 216 / 216 | 85 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-3f3686d02d1503fa | Claude Opus 5 | XHigh | Rated | 98.1 | 2282 | — | 170 / 0 / 0 | 170 / 170 | 70 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-a35dfc1adc62e4eb | Claude Opus 5 | XHigh | Rated | 83.1 | 2042 | — | 150 / 0 / 28 | 178 / 178 | 70 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-b53cb955b1d8baab | Claude Opus 5 | Thinking disabled | Rated | 91.2 | 2169 | — | 193 / 0 / 13 | 206 / 206 | 79 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-d7111b534ebcaba2 | Claude Opus 5 | Medium | Rated | 86.4 | 2093 | — | 186 / 0 / 16 | 202 / 202 | 86 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-122583de77d058b0 | Claude Opus 5.5 | Low | Rated | 78.8 | 1987 | — | 79 / 0 / 9 | 88 / 88 | 44 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-17a0ec0d72fab9d9 | Claude Opus 5.5 | XHigh | Rated | 86.5 | 2110 | — | 82 / 0 / 2 | 84 / 84 | 42 | 0 | 0 / 1 | Repaired · 2026-09-22 |
| E-a813de0189d45524 | Claude Opus 5.5 | Medium | Rated | 71.9 | 1877 | — | 78 / 0 / 14 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-66c9ddb5d274adfe | Claude Sonnet 5 | Thinking disabled | Rated | 30.4 | 1198 | — | 97 / 0 / 225 | 322 / 322 | 114 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-750cee28d20157cb | Claude Sonnet 5 | XHigh | Rated | 52.3 | 1545 | — | 179 / 0 / 161 | 340 / 340 | 123 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-77d8a88f79b44f7d | Claude Sonnet 5 | Medium | Rated | 51.8 | 1535 | — | 188 / 0 / 200 | 388 / 388 | 132 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-a0518a43c688d1e2 | North Mini Code | Enabled | Rated | 50.7 | 1547 | — | 38 / 0 / 28 | 66 / 66 | 33 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-06a41d0e11b18b77 | DeepSeek V4 Flash | High | Rated | 25.0 | 1119 | — | 46 / 0 / 138 | 184 / 184 | 74 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-13e71034a4088d5e | DeepSeek V4 Flash | Reasoning disabled | Rated | 49.7 | 1507 | — | 145 / 0 / 107 | 252 / 252 | 106 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-2c1cbd253f3a9d69 | DeepSeek V4 Flash | High | Rated | 23.1 | 1089 | — | 51 / 0 / 131 | 182 / 182 | 73 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-b79bedbd8892c1ff | DeepSeek V4 Flash | High | Rated | 54.2 | 1577 | — | 172 / 0 / 150 | 322 / 322 | 137 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-3fda6393d3f8a481 | DeepSeek V4 Pro | High | Rated | 55.2 | 1592 | — | 169 / 0 / 155 | 324 / 324 | 139 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-5511b1ad2a348e14 | DeepSeek V4 Pro | XHigh | Rated | 45.9 | 1444 | — | 138 / 0 / 164 | 302 / 302 | 132 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-fbac67873fd3ca35 | DeepSeek V4 Pro | Reasoning disabled | Rated | 41.5 | 1376 | — | 119 / 0 / 131 | 250 / 250 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-27fea439656cbd2e | DeepSeek V4 Pro 0813 | High | Rated | 46.5 | 1455 | — | 152 / 0 / 116 | 268 / 268 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-c2f829f127b429f0 | DeepSeek V4 Pro 0813 | Max | Rated | 67.6 | 1791 | — | 190 / 0 / 64 | 254 / 254 | 110 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-3a972af4535d3e2f | DeepSeek V4.1 Flash | Max | Rated | 73.4 | 1903 | — | 73 / 0 / 9 | 82 / 82 | 41 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-5c7d181090052b3a | DeepSeek V4.1 Flash | High | Rated | 47.4 | 1489 | — | 38 / 0 / 44 | 82 / 82 | 41 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-f9fd2655c50439e9 | DeepSeek V4.1 Flash | None | Rated | 34.6 | 1284 | — | 26 / 0 / 64 | 90 / 90 | 45 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-7603462aff103041 | Gemini 3.1 Flash Lite | Medium | Rated | 22.5 | 1076 | — | 58 / 0 / 150 | 208 / 208 | 79 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-a72dd193e1dc4331 | Gemini 3.1 Flash Lite | High | Rated | 14.5 | 951 | — | 37 / 0 / 161 | 198 / 198 | 72 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-d979b43c3aeea657 | Gemini 3.1 Flash Lite | Reasoning disabled | Rated | 14.0 | 944 | — | 29 / 0 / 147 | 176 / 176 | 69 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-009cca5c5833f45f | Gemini 3.5 Flash | Medium | Rated | 68.4 | 1804 | — | 156 / 0 / 98 | 254 / 254 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-67727c8d669d58d7 | Gemini 3.5 Flash | High | Rated | 59.9 | 1667 | — | 173 / 0 / 145 | 318 / 318 | 134 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-a13c4c9fdf6b244d | Gemini 3.5 Flash | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ff17c8693c990964 | Gemini 3.5 Flash | Minimal | Rated | 17.5 | 995 | — | 42 / 0 / 204 | 246 / 246 | 100 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-06abb3c93d2072c8 | Gemini 3.5 Flash Lite | High | Rated | 29.9 | 1188 | — | 94 / 0 / 290 | 384 / 384 | 120 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-214f636367cbdac4 | Gemini 3.5 Flash Lite | Minimal | Rated | 11.9 | 900 | — | 53 / 0 / 373 | 426 / 426 | 133 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-3dd83d6fa9f8f758 | Gemini 3.5 Flash Lite | Medium | Rated | 19.3 | 1018 | — | 70 / 0 / 318 | 388 / 388 | 123 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-5b803013ec40d15d | Gemini 3.5 Flash Lite | High | Rated | 21.9 | 1061 | — | 91 / 0 / 283 | 374 / 374 | 120 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8826ab29e7591ece | Gemini 3.5 Flash Lite | Medium | Rated | 22.9 | 1077 | — | 78 / 0 / 316 | 394 / 394 | 125 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-a870d09d3e1a40d4 | Gemini 3.5 Flash Lite | Minimal | Rated | 15.9 | 965 | — | 52 / 0 / 348 | 400 / 400 | 127 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-5bcc61f900210bfa | Gemini 3.6 Flash | Medium | Rated | 81.7 | 2011 | — | 345 / 0 / 33 | 378 / 378 | 133 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8b9ff59d79afb558 | Gemini 3.6 Flash | High | Rated | 92.7 | 2187 | — | 328 / 0 / 20 | 348 / 348 | 117 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-9bef179ce22a6c93 | Gemini 3.6 Flash | Minimal | Rated | 49.6 | 1498 | — | 243 / 0 / 224 | 467 / 467 | 151 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c4f143aad203feb3 | Gemini 3.6 Flash | High | Rated | 68.7 | 1805 | — | 271 / 0 / 95 | 366 / 366 | 122 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-d95a1da824d70f6d | Gemini 3.6 Flash | Medium | Rated | 49.8 | 1503 | — | 234 / 0 / 218 | 452 / 452 | 148 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e23af86eb5787555 | Gemini 3.6 Flash | Minimal | Rated | 52.3 | 1542 | — | 242 / 0 / 200 | 442 / 442 | 142 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-bc069396b6820e71 | Gemini 3.8 Flash | High | Rated | 64.3 | 1740 | — | 147 / 0 / 97 | 244 / 244 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-cb6b426c5204ddae | Gemini 3.8 Flash | Low | Rated | 51.1 | 1526 | — | 162 / 0 / 156 | 318 / 318 | 132 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d83c5cb7ab40f0dd | Gemini 3.8 Flash | Medium | Rated | 48.3 | 1485 | — | 114 / 0 / 126 | 240 / 240 | 103 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e8e17fbbdd12faa4 | Gemma 4 31B | Reasoning disabled | Rated | 16.2 | 977 | — | 44 / 0 / 170 | 214 / 214 | 81 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-fd1bc1e2e6ac48fb | Gemma 4 31B | Reasoning enabled | Rated | 50.7 | 1524 | — | 130 / 0 / 110 | 240 / 240 | 91 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1b9f1f7b70f02927 | GPT 4.1 | None | Rated | 16.5 | 981 | — | 42 / 0 / 168 | 210 / 210 | 87 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-9e5b308c41a36374 | GPT 5 | Medium | Rated | 60.0 | 1675 | — | 128 / 0 / 64 | 192 / 192 | 75 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-c5ad048b6fb4e93d | GPT 5 | High | Rated | 69.9 | 1833 | — | 118 / 0 / 56 | 174 / 174 | 68 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-d03d2c6a69fc3e16 | GPT 5 | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | Repaired · 2026-07-21 |
| E-34e3865fc087a754 | GPT-5.4 | Medium | Rated | 65.9 | 1763 | — | 220 / 0 / 98 | 318 / 318 | 117 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-a09c0b14cae46193 | GPT-5.4 | None | Rated | 55.5 | 1596 | — | 184 / 0 / 148 | 332 / 332 | 129 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-dcce778d7a3114fa | GPT-5.4 | XHigh | Rated | 82.3 | 2023 | — | 296 / 0 / 34 | 330 / 330 | 121 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-0791f6b66243ec1a | GPT-5.4 Mini | Medium | Rated | 50.2 | 1517 | — | 122 / 0 / 96 | 218 / 218 | 86 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-427bdffeacc6c394 | GPT-5.4 Mini | None | Rated | 21.6 | 1065 | — | 44 / 0 / 146 | 190 / 190 | 77 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3311575b341ee4a8 | GPT-5.4 Nano | None | Rated | 16.2 | 978 | — | 34 / 0 / 158 | 192 / 192 | 74 | 0 | 0 / 1 | Repaired · 2026-07-09 |
| E-6c37eeef15b82287 | GPT-5.4 Nano | None | Rated | 10.4 | 885 | — | 28 / 0 / 184 | 212 / 212 | 79 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-8e40431df091d53f | GPT-5.4 Nano | Medium | Rated | 70.4 | 1840 | — | 156 / 0 / 42 | 198 / 198 | 73 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-a0d8c8fd6b01598c | GPT-5.4 Nano | Medium | Rated | 25.6 | 1125 | — | 64 / 0 / 164 | 228 / 228 | 86 | 0 | 0 / 1 | First try · 2026-07-09 |
| E-6f42dbbf02274b56 | GPT-5.5 | None | Rated | 48.3 | 1490 | — | 94 / 0 / 86 | 180 / 180 | 73 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-762e9d80a60b41ed | GPT-5.5 | XHigh | Rated | 67.2 | 1789 | — | 150 / 0 / 36 | 186 / 186 | 74 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ffa82d1e96e897ab | GPT-5.5 | Medium | Rated | 73.2 | 1886 | — | 127 / 0 / 45 | 172 / 172 | 74 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-3b8df7a8d128f873 | GPT-5.6 Luna | XHigh | Rated | 53.1 | 1556 | — | 245 / 0 / 191 | 436 / 436 | 144 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-6879be00992f95f0 | GPT-5.6 Luna | None | Rated | 31.1 | 1208 | — | 97 / 0 / 217 | 314 / 314 | 107 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-8056d7cf3d4b6248 | GPT-5.6 Luna | Medium | Rated | 41.2 | 1369 | — | 161 / 0 / 158 | 319 / 319 | 110 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-225037bcf869a775 | GPT-5.6 Sol | XHigh | Rated | 72.5 | 1866 | — | 253 / 0 / 85 | 338 / 338 | 124 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-c9acd4a3fb993f97 | GPT-5.6 Sol | Medium | Rated | 74.4 | 1897 | — | 243 / 0 / 75 | 318 / 318 | 114 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-d29c6c5eb08da2d9 | GPT-5.6 Sol | None | Rated | 50.4 | 1512 | — | 228 / 0 / 178 | 406 / 406 | 136 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-5e58d70e910d2d64 | GPT-5.6 Terra | XHigh | Rated | 51.4 | 1531 | — | 187 / 0 / 139 | 326 / 326 | 137 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-bae96581de22f0a2 | GPT-5.6 Terra | Medium | Rated | 58.3 | 1641 | — | 168 / 0 / 128 | 296 / 296 | 125 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-84a392f4c3b1b8df | GPT-6 Astra | XHigh | Rated | 100.0 | 2307 | — | 244 / 0 / 0 | 244 / 244 | 108 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-9bf97597e76765ac | GPT-6 Astra | Medium | Rated | 85.7 | 2081 | — | 216 / 0 / 16 | 232 / 232 | 104 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-bcfaa85bf834db66 | GPT-6 Astra | Low | Rated | 97.5 | 2269 | — | 225 / 0 / 7 | 232 / 232 | 102 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-0cb2626f37719828 | GPT-6 Luna | XHigh | Rated | 52.8 | 1573 | — | 54 / 0 / 38 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-88588162fa1b46c9 | GPT-6 Luna | None | Rated | 45.8 | 1461 | — | 36 / 0 / 56 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-cbc4300314f4e808 | GPT-6 Luna | Medium | Rated | 47.0 | 1483 | — | 46 / 0 / 40 | 86 / 86 | 43 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-198d18d67eb82f6d | GPT-6 Sol | None | Rated | 65.8 | 1780 | — | 65 / 0 / 25 | 90 / 90 | 45 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-5fda0fd12201228d | GPT-6 Sol | XHigh | Rated | 75.3 | 1932 | — | 81 / 0 / 5 | 86 / 86 | 43 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-65dcf2ee9a0cf52e | GPT-6 Sol | Medium | Rated | 78.3 | 1977 | — | 86 / 0 / 8 | 94 / 94 | 47 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-3513a7dff7785bbe | Mercury 2.5 Preview | Medium | Rated | 22.0 | 1066 | — | 51 / 0 / 217 | 268 / 268 | 116 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-fb50150d8aeec77b | Mercury 2.5 Preview | None | Rated | 39.9 | 1350 | — | 127 / 0 / 133 | 260 / 260 | 114 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-067ab716d64e3e9a | LongCat 2.0 | None | Rated | 17.8 | 1002 | — | 38 / 0 / 174 | 212 / 214 | 82 | 0 | 2 / 1 | Repaired · 2026-07-24 |
| E-73a7ad076eeaa6ae | LongCat 2.0 | Enabled | Rated | 49.8 | 1503 | — | 245 / 0 / 197 | 442 / 442 | 136 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8b7eb63d4f53d846 | LongCat 2.0 | Enabled | Rated | 21.3 | 1050 | — | 80 / 0 / 316 | 396 / 396 | 126 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8cc657b7db4428cb | LongCat 2.0 | None | Rated | 20.2 | 1041 | — | 52 / 0 / 160 | 212 / 214 | 79 | 0 | 2 / 1 | First try · 2026-07-24 |
| E-1976d9eba9109758 | Muse Glimmer 30B | Medium | Rated | 19.4 | 1026 | — | 43 / 0 / 183 | 226 / 226 | 99 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-2e1662101014e29f | Muse Glimmer 30B | XHigh | Rated | 48.9 | 1492 | — | 141 / 0 / 177 | 318 / 318 | 136 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d6493e27c9be185c | Muse Glimmer 30B | Low | Rated | 6.2 | 817 | — | 19 / 0 / 215 | 234 / 234 | 98 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-1fbf9ab6a0c6d3ee | Muse Spark 1.2 | Minimal | Rated | 52.9 | 1553 | — | 215 / 0 / 201 | 416 / 416 | 141 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-782ab5805e8c7fe1 | Muse Spark 1.2 | Medium | Rated | 49.4 | 1497 | — | 209 / 0 / 211 | 420 / 420 | 149 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-0a98fc26a786d7b3 | Muse Spark 1.3 | Medium | Rated | 55.1 | 1591 | — | 138 / 0 / 136 | 274 / 274 | 118 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-42ff0af1a88c2f81 | Muse Spark 1.3 | Minimal | Rated | 45.9 | 1445 | — | 140 / 0 / 164 | 304 / 304 | 131 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-33797d7b77c7800c | Minimax M3 | Reasoning disabled | Rated | 33.8 | 1255 | — | 92 / 0 / 140 | 232 / 232 | 89 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-fb8ac45946e32e22 | Minimax M3 | Reasoning enabled | Rated | 0.0 | 717 | — | 4 / 0 / 248 | 252 / 252 | 104 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-e03a3b2c50feed85 | Mistral Medium 3.5 | None | Rated | 24.9 | 1114 | — | 35 / 0 / 195 | 230 / 230 | 102 | 0 | 0 / 1 | First try · 2026-09-08 |
| E-f051ff5a67f3b7f1 | Mistral Medium 3.5 | High | Rated | 54.3 | 1579 | — | 150 / 0 / 114 | 264 / 264 | 109 | 0 | 0 / 1 | First try · 2026-09-08 |
| E-952fba19b28982d5 | Kimi K2.7 Code | Reasoning enabled | Rated | 52.1 | 1548 | — | 106 / 0 / 98 | 204 / 204 | 83 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-4419230379dcd41e | Kimi K3 | Low | Rated | 56.2 | 1604 | — | 295 / 0 / 202 | 497 / 497 | 159 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-895556dde47644ae | Kimi K3 | High | Rated | 53.7 | 1564 | — | 266 / 0 / 214 | 480 / 480 | 148 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-5f76f577111bee8d | Nex N2 Pro | Reasoning enabled | Rated | 20.3 | 1042 | — | 50 / 0 / 166 | 216 / 216 | 89 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-962a9da8812a74d4 | Nex N2 Pro | Reasoning disabled | Rated | 36.0 | 1293 | — | 79 / 0 / 127 | 206 / 206 | 87 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-4477e0de2e04aad4 | Nemotron 3 Ultra 550B A55B | Reasoning disabled | Rated | 52.1 | 1550 | — | 109 / 0 / 73 | 182 / 182 | 78 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-48ed5c5e00ef38fb | Nemotron 3 Ultra 550B A55B | High | Rated | 30.4 | 1204 | — | 76 / 0 / 120 | 196 / 196 | 83 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-da3b98638ff53ea9 | Nemotron 3 Ultra 550B A55B | High | Rated | 42.1 | 1390 | — | 81 / 0 / 105 | 186 / 186 | 82 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-343b92f3dda3dcb5 | O3 | Medium | Rated | 49.5 | 1505 | — | 114 / 0 / 112 | 226 / 226 | 96 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-4724b57e861c4ecf | O3 | High | Rated | 61.7 | 1693 | — | 245 / 0 / 153 | 398 / 398 | 127 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-61d05a26a332d2e5 | O3 | High | Rated | 48.7 | 1485 | — | 227 / 0 / 201 | 428 / 428 | 131 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-9bfe5e29476019eb | O3 | High | Rated | 41.5 | 1373 | — | 183 / 0 / 212 | 395 / 395 | 130 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-ffb183b7ecfe85e0 | O3 | High | Rated | 55.4 | 1592 | — | 205 / 0 / 183 | 388 / 388 | 127 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-a8ac25b34b5fc6d2 | GPT-OSS 120B | Low | Rated | 20.9 | 1051 | — | 49 / 0 / 181 | 230 / 230 | 96 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-dfafb3e22cd39cb7 | GPT-OSS 120B | High | Rated | 52.3 | 1549 | — | 126 / 0 / 126 | 252 / 252 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e75e581de7240a15 | GPT-OSS 120B | Medium | Rated | 22.7 | 1078 | — | 48 / 0 / 204 | 252 / 252 | 112 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-1ca53619662c7f6f | Laguna S 2.1 | None | Rated | 72.4 | 1871 | — | 162 / 0 / 44 | 206 / 206 | 80 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-21623e96b2b104e9 | Laguna S 2.1 | None | Rated | 25.3 | 1120 | — | 71 / 0 / 151 | 222 / 222 | 85 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-53ce0020411c86d4 | Laguna S 2.1 | Enabled | Rated | 24.5 | 1102 | — | 81 / 0 / 325 | 406 / 406 | 131 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-62e15a037ee860c1 | Laguna S 2.1 | Enabled | Rated | 47.0 | 1459 | — | 202 / 0 / 229 | 431 / 431 | 132 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-435ec29661cdc285 | Qwen3.7 Max | Reasoning enabled | Rated | 43.0 | 1399 | — | 131 / 0 / 145 | 276 / 276 | 104 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-c577c41440c17864 | Qwen3.7 Max | Reasoning disabled | Rated | 40.1 | 1355 | — | 105 / 0 / 129 | 234 / 234 | 90 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-6cc7454f585005c4 | Qwen3.7 Plus | Reasoning enabled | Rated | 52.8 | 1558 | — | 121 / 0 / 105 | 226 / 226 | 93 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-94daaf1196d89c6c | Qwen3.7 Plus | Reasoning disabled | Rated | 41.2 | 1374 | — | 90 / 0 / 112 | 202 / 202 | 80 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-0e32757b59e7dbfc | Qwen3.8 2.4t A95B | Medium | Rated | 58.2 | 1639 | — | 174 / 0 / 156 | 330 / 330 | 142 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-95c4d5c731a8ad70 | Qwen3.8 2.4t A95B | Low | Rated | 36.8 | 1304 | — | 94 / 0 / 134 | 228 / 228 | 102 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-f23d1d1601012419 | Qwen3.8 2.4t A95B | XHigh | Rated | 66.9 | 1782 | — | 147 / 0 / 95 | 242 / 242 | 106 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-600aaf6a0031475a | Qwen3.8 27B | XHigh | Rated | 58.8 | 1648 | — | 198 / 0 / 132 | 330 / 330 | 138 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-ac133a87999d534c | Qwen3.8 27B | Medium | Rated | 46.6 | 1455 | — | 159 / 0 / 135 | 294 / 294 | 125 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-5ad1274529cb86bf | Qwen3.8 Flash | Reasoning enabled | Rated | 64.3 | 1740 | — | 164 / 0 / 84 | 248 / 248 | 105 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-cc77b6d993d3e295 | Qwen3.8 Flash | Reasoning disabled | Rated | 26.8 | 1143 | — | 58 / 0 / 202 | 260 / 260 | 109 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-2dec08c905be48b9 | Qwen3.8 Max | Medium | Rated | 63.1 | 1721 | — | 143 / 0 / 99 | 242 / 242 | 102 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-776235fa35035a89 | Qwen3.8 Max | Minimal | Rated | 90.9 | 2162 | — | 231 / 0 / 18 | 249 / 249 | 107 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-7cc7204834cbed5f | Qwen3.8 Max | XHigh | Rated | 43.5 | 1405 | — | 143 / 0 / 183 | 326 / 326 | 136 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-2c155c9c7b1a2662 | Qwen3.8 Max 0902 | Xhigh | Rated | 78.0 | 1976 | — | 73 / 0 / 5 | 78 / 78 | 39 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-3eab40a1e0b11b9e | Qwen3.8 Max 0902 | Low | Rated | 56.1 | 1627 | — | 56 / 0 / 30 | 86 / 86 | 43 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-f01a7932bc96e1c4 | Qwen3.8 Max 0902 | Medium | Rated | 41.8 | 1398 | — | 37 / 0 / 55 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-070bbd8b3ce0460a | Ox Alpha | Low | Rated | 48.4 | 1487 | — | 141 / 0 / 111 | 252 / 252 | 112 | 0 | 0 / 1 | Repaired · 2026-08-22 |
| E-149dc099de9a50cd | Ox Alpha | High | Rated | 45.8 | 1442 | — | 151 / 0 / 163 | 314 / 314 | 131 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-45b32dc2eea8fd55 | Ox Alpha | Max | Rated | 57.7 | 1635 | — | 118 / 0 / 124 | 242 / 242 | 104 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-575e460fdd8ace42 | Ox Alpha | Low | Rated | 52.3 | 1545 | — | 178 / 0 / 158 | 336 / 336 | 140 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-6f88d9900795b3a1 | Ox Alpha | High | Rated | 42.7 | 1397 | — | 113 / 0 / 121 | 234 / 234 | 103 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-71c7a6b241c3e968 | Ox Alpha | High | Rated | 54.3 | 1580 | — | 118 / 0 / 136 | 254 / 254 | 105 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-b2ff4a9d0e899fba | Ox Alpha | Max | Rated | 54.1 | 1574 | — | 180 / 0 / 130 | 310 / 310 | 137 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-b6ae2b718b132aa0 | Ox Alpha | Max | Rated | 65.7 | 1761 | — | 159 / 0 / 95 | 254 / 254 | 108 | 0 | 0 / 1 | Repaired · 2026-08-22 |
| E-c69bc9b31ddf984b | Ox Alpha | Low | Rated | 59.1 | 1657 | — | 129 / 0 / 125 | 254 / 254 | 108 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-358338a9fbdbcb6a | Step 3.7 Flash | High | Rated | 43.0 | 1403 | — | 105 / 0 / 93 | 198 / 198 | 79 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-50f22f1c15a8fd4a | Step 3.7 Flash | Low | Rated | 37.8 | 1314 | — | 152 / 0 / 238 | 390 / 394 | 125 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-7b9b33921ba865f5 | Step 3.7 Flash | Medium | Rated | 48.8 | 1495 | — | 108 / 0 / 118 | 226 / 226 | 89 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1bb81f8a4ae78954 | Hy3 Preview | None | Rated | 24.1 | 1100 | — | 73 / 0 / 183 | 256 / 256 | 98 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-92dc0ac61d798488 | Hy3 Preview | High | Rated | 61.5 | 1700 | — | 113 / 0 / 63 | 176 / 176 | 75 | 0 | 0 / 1 | Repaired · 2026-07-03 |
| E-28e51309037f1394 | Hy4 Preview | High | Rated | 58.9 | 1653 | — | 142 / 0 / 100 | 242 / 242 | 105 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-2ba15d545d2d730f | Hy4 Preview | Low | Rated | 52.2 | 1544 | — | 168 / 0 / 150 | 318 / 318 | 138 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-fe70cfbc80530de6 | Hy4 Preview | None | Rated | 53.9 | 1570 | — | 167 / 0 / 167 | 334 / 334 | 142 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-0f05573125dedc2b | Inkling | None | Rated | 26.9 | 1147 | — | 60 / 0 / 134 | 194 / 194 | 75 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-2c483dc32fc18ba8 | Inkling | Max | Rated | 20.4 | 1037 | — | 70 / 0 / 310 | 380 / 380 | 115 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-ae60ed096a69eeff | Inkling | Medium | Rated | 23.2 | 1086 | — | 71 / 0 / 171 | 242 / 242 | 93 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-e9202aa1565d1c4e | Inkling | Max | Rated | 22.8 | 1075 | — | 85 / 0 / 303 | 388 / 388 | 120 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-f7a1d86c7e241f8d | Inkling | None | Rated | 34.3 | 1265 | — | 78 / 0 / 132 | 210 / 210 | 85 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-7c80d62319ac1a53 | Inkling Small | None | Rated | 6.9 | 828 | — | 10 / 0 / 224 | 234 / 234 | 96 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-cb36e2fcb99cfafd | Inkling Small | Medium | Rated | 17.5 | 996 | — | 25 / 0 / 211 | 236 / 236 | 100 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-e8805bb60afd625c | Inkling Small | Max | Rated | 40.3 | 1356 | — | 129 / 0 / 158 | 287 / 287 | 116 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-3c5879def34f7d38 | Grok 4.5 | Low | Rated | 51.7 | 1533 | — | 199 / 0 / 206 | 405 / 405 | 131 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-824ec3caceabd338 | Grok 4.5 | Medium | Rated | 63.6 | 1731 | — | 135 / 0 / 69 | 204 / 204 | 84 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8e6cb252293b2af9 | Grok 4.5 | High | Rated | 70.1 | 1827 | — | 269 / 0 / 93 | 362 / 362 | 121 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c731f71cc6f04dfd | Grok 4.6 | Low | Rated | 54.5 | 1582 | — | 149 / 0 / 149 | 298 / 298 | 127 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-ca4c8257d795c7ea | Grok 4.6 | XHigh | Rated | 81.7 | 2017 | — | 208 / 0 / 32 | 240 / 240 | 100 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e020f22ecf0cad85 | Grok 4.6 | Medium | Rated | 78.7 | 1970 | — | 193 / 0 / 45 | 238 / 238 | 102 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-47df18b71d370011 | Grok 4.7 | Medium | Rated | 79.8 | 2004 | — | 82 / 0 / 6 | 88 / 88 | 44 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-543cc78c94cd37a5 | Grok 4.7 | Low | Rated | 39.0 | 1357 | — | 22 / 0 / 54 | 76 / 76 | 38 | 0 | 0 / 1 | First try · 2026-09-23 |
| E-4aac1b6621aeae38 | Grok Build 0.1 | Reasoning enabled | Rated | 52.6 | 1555 | — | 137 / 0 / 97 | 234 / 234 | 86 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-09d406abc15f7c9a | MiMo-V2.5 | Reasoning disabled | Rated | 46.1 | 1455 | — | 83 / 0 / 91 | 174 / 174 | 74 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-9490f08c56c27d13 | MiMo-V2.5 | Reasoning disabled | Rated | 24.5 | 1110 | — | 59 / 0 / 139 | 198 / 198 | 79 | 0 | 0 / 1 | Repaired · 2026-07-01 |
| E-ad48cf51fe7da3cc | MiMo-V2.5 | Reasoning enabled | Rated | 38.5 | 1331 | — | 105 / 0 / 133 | 238 / 238 | 87 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-be8fc9653466bbe1 | MiMo-V2.5 | Reasoning disabled | Rated | 24.0 | 1103 | — | 58 / 0 / 132 | 190 / 190 | 78 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-faaa866ee28d6401 | MiMo-V2.5 | Reasoning enabled | Rated | 29.0 | 1179 | — | 82 / 0 / 138 | 220 / 220 | 80 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-9c228ad72a159b33 | MiMo-V2.5-Pro | Reasoning enabled | Rated | 35.8 | 1288 | — | 75 / 0 / 145 | 220 / 220 | 90 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-af55f57b03605914 | MiMo-V2.5-Pro | Reasoning disabled | Rated | 26.4 | 1138 | — | 73 / 0 / 143 | 216 / 216 | 93 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-b737bc63196d8e76 | MiMo-V2.6-Flash | Reasoning disabled | Rated | 51.2 | 1548 | — | 43 / 0 / 49 | 92 / 92 | 46 | 0 | 0 / 1 | Repaired · 2026-09-22 |
| E-bbcfd177d98651a0 | MiMo-V2.6-Flash | Reasoning enabled | Rated | 56.7 | 1634 | — | 54 / 0 / 40 | 94 / 94 | 47 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-dfd17cd5be2ab88f | MiMo-V2.6-Pro | Reasoning disabled | Rated | 37.3 | 1327 | — | 27 / 0 / 65 | 92 / 92 | 46 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-38e323f4ce233fa1 | GLM-5.2 | Reasoning disabled | Rated | 32.8 | 1240 | — | 89 / 0 / 133 | 222 / 222 | 91 | 0 | 0 / 1 | First try · 2026-07-11 |
| E-3916ba303b2ff700 | GLM-5.2 | High | Rated | 50.0 | 1518 | — | 95 / 0 / 81 | 176 / 176 | 67 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-5c6f8f7e32842948 | GLM-5.2 | Reasoning disabled | Rated | 25.5 | 1124 | — | 49 / 0 / 187 | 236 / 236 | 107 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-d8655d29a4806df8 | GLM-5.2 | Reasoning disabled | Rated | 60.1 | 1679 | — | 94 / 0 / 74 | 168 / 168 | 73 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-f4a19ead73436568 | GLM-5.2 | High | Rated | 56.0 | 1604 | — | 169 / 0 / 153 | 322 / 322 | 136 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-fdb681550bd62053 | GLM-5.2 | XHigh | Rated | 54.7 | 1587 | — | 112 / 0 / 132 | 244 / 244 | 105 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-494310abbf3a3a19 | GLM 5.3 | High | Rated | 70.6 | 1840 | — | 148 / 0 / 98 | 246 / 246 | 106 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-88d0e66d313499a5 | GLM 5.3 | Low | Rated | 52.6 | 1551 | — | 164 / 0 / 128 | 292 / 292 | 124 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-de6a83486a9dc17a | GLM 5.3 | Max | Rated | 93.2 | 2200 | — | 222 / 0 / 16 | 238 / 238 | 104 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-36eba342522785a7 | GLM 5.3 Flash | Max | Rated | 74.2 | 1896 | — | 177 / 0 / 73 | 250 / 250 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-ad7e582cc15b3ed0 | GLM 5.3 Flash | Low | Rated | 41.0 | 1370 | — | 115 / 0 / 127 | 242 / 242 | 107 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-b09b4ec517167033 | GLM 5.3 Flash | High | Rated | 54.2 | 1576 | — | 151 / 0 / 175 | 326 / 326 | 136 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-24b02e97ddc9f3d2 | GLM-5.3 FlashX | Low | Rated | 51.3 | 1547 | — | 46 / 0 / 54 | 100 / 100 | 50 | 0 | 0 / 1 | Repaired · 2026-09-22 |
| E-5b9bfa886306453c | GLM-5.3 FlashX | High | Rated | 36.6 | 1314 | — | 28 / 0 / 66 | 94 / 94 | 47 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-d480b55560494198 | GLM-5.3 FlashX | Max | Rated | 57.7 | 1652 | — | 53 / 0 / 33 | 86 / 86 | 43 | 0 | 0 / 1 | First try · 2026-09-22 |