Game profile
Tumbleweed
Tumbleweed is a hex-grid territory game where players grow visible stacks and final control is determined by line-of-sight strength.
Scores here compare player programs using DuelLab's encoded rules for Tumbleweed; they are not a broad measure of human play strength.
By model and setting
GB2-08: Tumbleweed by model and setting
Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and the rating-evidence index combine those contributing programs. A zero index is a clipped endpoint, not zero uncertainty about future generations.
| Rank | Model | Reasoning | Score | Raw Elo | W / D / L | Rating-evidence index |
|---|---|---|---|---|---|---|
| 1 | XHigh | 100.0 | 2317.1 | 258 / 0 / 4 | 0.0 | |
| 2 | Low | 88.2 | 2159.3 | 398 / 0 / 24 | 0.0 | |
| 3 | Medium | 87.6 | 2157.0 | 245 / 0 / 21 | 0.0 | |
| 4 | XHigh | 82.7 | 2092.7 | 265 / 2 / 27 | 0.0 | |
| 5 | Medium | 82.0 | 2083.7 | 265 / 0 / 23 | 0.0 | |
| 6 | Low | 81.4 | 2076.9 | 234 / 0 / 28 | 0.0 | |
| 7 | Medium | 80.7 | 2067.8 | 251 / 0 / 31 | 0.0 | |
| 8 | XHigh | 79.6 | 2054.0 | 232 / 0 / 36 | 0.0 | |
| 9 | High | 79.3 | 2045.5 | 360 / 4 / 46 | 0.0 | |
| 10 | XHigh | 78.6 | 2052.5 | 109 / 0 / 11 | 1.7 | |
| 11 | Medium | 77.6 | 2041.5 | 212 / 0 / 8 | 3.7 | |
| 12 | Enabled | 77.5 | 2040.1 | 106 / 0 / 6 | 3.3 | |
| 13 | Max | 77.1 | 2021.7 | 223 / 0 / 43 | 0.0 | |
| 14 | Medium | 76.9 | 2019.7 | 462 / 0 / 60 | 0.0 | |
| 15 | Medium | 74.7 | 1991.5 | 219 / 1 / 44 | 0.0 | |
| 16 | Low | 72.2 | 1958.2 | 235 / 1 / 34 | 0.0 | |
| 17 | Medium | 71.6 | 1965.2 | 90 / 0 / 12 | 5.5 | |
| 18 | Medium | 71.0 | 1943.3 | 235 / 4 / 27 | 0.0 | |
| 19 | XHigh | 70.6 | 1938.9 | 390 / 0 / 88 | 0.0 | |
| 20 | XHigh | 70.6 | 1938.5 | 188 / 0 / 56 | 0.0 | |
| 21 | Medium | 70.1 | 1931.8 | 209 / 0 / 53 | 0.0 | |
| 22 | Low | 68.9 | 1916.3 | 210 / 1 / 53 | 0.0 | |
| 23 | XHigh | 66.8 | 1901.6 | 95 / 1 / 16 | 3.3 | |
| 24 | High | 66.7 | 1887.2 | 221 / 1 / 44 | 0.0 | |
| 25 | None | 66.0 | 1879.4 | 164 / 15 / 61 | 0.0 | |
| 26 | None | 65.9 | 1873.2 | 276 / 30 / 70 | 0.0 | |
| 27 | Low | 65.6 | 1872.8 | 211 / 4 / 55 | 0.0 | |
| 28 | None | 65.5 | 1873.6 | 193 / 1 / 52 | 0.0 | |
| 29 | XHigh | 65.2 | 1882.6 | 94 / 2 / 10 | 4.6 | |
| 30 | Medium | 65.0 | 1878.7 | 87 / 2 / 21 | 3.7 | |
| 31 | XHigh | 64.3 | 1854.1 | 263 / 2 / 79 | 0.0 | |
| 32 | Medium | 63.8 | 1845.1 | 325 / 5 / 96 | 0.0 | |
| 33 | Medium | 63.6 | 1846.8 | 200 / 15 / 71 | 0.0 | |
| 34 | XHigh | 63.5 | 1847.1 | 205 / 1 / 58 | 0.0 | |
| 35 | Low | 63.2 | 1838.0 | 331 / 0 / 87 | 0.0 | |
| 36 | XHigh | 63.1 | 1837.7 | 276 / 0 / 80 | 0.0 | |
| 37 | Low | 62.3 | 1831.6 | 194 / 0 / 68 | 0.0 | |
| 38 | None | 61.8 | 1824.5 | 175 / 11 / 76 | 0.0 | |
| 39 | None | 61.7 | 1836.0 | 90 / 1 / 23 | 2.9 | |
| 40 | None | 60.5 | 1821.3 | 88 / 0 / 24 | 3.3 | |
| 41 | Low | 58.4 | 1780.4 | 180 / 19 / 75 | 0.0 | |
| 42 | Medium | 57.2 | 1760.9 | 219 / 67 / 112 | 0.0 | |
| 43 | Max | 57.1 | 1763.8 | 464 / 127 / 257 | 0.0 | |
| 44 | Low | 54.5 | 1745.5 | 74 / 0 / 28 | 5.5 | |
| 45 | None | 54.0 | 1721.6 | 481 / 53 / 162 | 0.0 | |
| 46 | XHigh | 53.1 | 1725.9 | 71 / 4 / 33 | 4.1 | |
| 47 | High | 51.3 | 1687.4 | 158 / 85 / 83 | 0.0 | |
| 48 | XHigh | 50.4 | 1673.6 | 197 / 42 / 129 | 0.0 | |
| 49 | Medium | 49.6 | 1663.2 | 226 / 65 / 109 | 0.0 | |
| 50 | XHigh | 49.2 | 1662.3 | 161 / 70 / 29 | 0.0 | |
| 51 | Historical | 49.1 | 1662.3 | 228 / 84 / 144 | 0.0 | |
| 52 | Medium | 47.8 | 1642.9 | 138 / 55 / 91 | 0.0 | |
| 53 | Enabled | 47.5 | 1640.7 | 151 / 25 / 72 | 0.0 | |
| 54 | Medium | 47.4 | 1635.6 | 183 / 68 / 113 | 0.0 | |
| 55 | Minimal | 46.2 | 1619.8 | 198 / 9 / 179 | 0.0 | |
| 56 | Low | 43.3 | 1598.5 | 142 / 4 / 88 | 2.3 | |
| 57 | High | 42.9 | 1579.4 | 115 / 103 / 88 | 0.0 | |
| 58 | Reasoning | 42.6 | 1577.8 | 196 / 146 / 136 | 0.0 | |
| 59 | None | 40.4 | 1548.8 | 120 / 17 / 115 | 0.0 | |
| 60 | None | 40.2 | 1547.3 | 168 / 199 / 131 | 0.0 | |
| 61 | High | 39.9 | 1540.4 | 94 / 153 / 69 | 0.0 | |
| 62 | High | 39.8 | 1539.7 | 325 / 291 / 310 | 0.0 | |
| 63 | Medium | 39.0 | 1531.8 | 198 / 133 / 169 | 0.0 | |
| 64 | Max | 38.9 | 1542.8 | 36 / 50 / 26 | 3.3 | |
| 65 | High | 37.8 | 1514.7 | 70 / 114 / 86 | 0.0 | |
| 66 | Minimal | 37.6 | 1509.6 | 110 / 156 / 94 | 0.0 | |
| 67 | XHigh | 37.2 | 1520.8 | 41 / 46 / 21 | 4.1 | |
| 68 | High | 36.5 | 1493.3 | 264 / 321 / 241 | 0.0 | |
| 69 | Medium | 36.1 | 1493.0 | 91 / 121 / 54 | 0.0 | |
| 70 | None | 34.7 | 1470.7 | 124 / 160 / 126 | 0.0 | |
| 71 | High | 34.6 | 1470.9 | 109 / 144 / 87 | 0.0 | |
| 72 | High | 34.0 | 1461.7 | 317 / 584 / 371 | 0.0 | |
| 73 | Reasoning | 33.5 | 1459.7 | 55 / 143 / 64 | 0.0 | |
| 74 | None | 33.2 | 1453.6 | 59 / 192 / 83 | 0.0 | |
| 75 | High | 31.7 | 1436.5 | 89 / 80 / 95 | 0.0 | |
| 76 | High | 31.6 | 1433.1 | 97 / 121 / 114 | 0.0 | |
| 77 | XHigh | 31.4 | 1432.1 | 71 / 124 / 77 | 0.0 | |
| 78 | Medium | 31.4 | 1426.4 | 70 / 261 / 120 | 0.0 | |
| 79 | XHigh | 30.6 | 1417.9 | 62 / 211 / 101 | 0.0 | |
| 80 | XHigh | 30.3 | 1417.1 | 72 / 125 / 101 | 0.0 | |
| 81 | XHigh | 29.9 | 1410.1 | 97 / 118 / 125 | 0.0 | |
| 82 | Medium | 29.5 | 1406.1 | 90 / 92 / 130 | 0.0 | |
| 83 | Enabled | 28.9 | 1396.9 | 38 / 224 / 92 | 0.0 | |
| 84 | Medium | 28.6 | 1390.5 | 52 / 256 / 134 | 0.0 | |
| 85 | Low | 28.5 | 1391.5 | 47 / 214 / 111 | 0.0 | |
| 86 | Medium | 27.7 | 1384.4 | 59 / 148 / 83 | 0.0 | |
| 87 | Low | 27.3 | 1384.5 | 17 / 127 / 44 | 0.0 | |
| 88 | XHigh | 27.0 | 1373.5 | 77 / 114 / 145 | 0.0 | |
| 89 | None | 26.5 | 1367.7 | 14 / 206 / 74 | 0.0 | |
| 90 | Medium | 26.3 | 1381.0 | 20 / 46 / 38 | 5.0 | |
| 91 | Reasoning | 26.1 | 1362.4 | 21 / 205 / 76 | 0.0 | |
| 92 | High | 25.8 | 1354.0 | 49 / 256 / 197 | 0.0 | |
| 93 | High | 25.7 | 1359.1 | 4 / 199 / 57 | 0.0 | |
| 94 | None | 25.2 | 1352.3 | 33 / 172 / 67 | 0.0 | |
| 95 | Medium | 25.2 | 1352.2 | 67 / 96 / 107 | 0.0 | |
| 96 | None | 25.1 | 1351.0 | 12 / 218 / 48 | 0.0 | |
| 97 | High | 25.0 | 1343.0 | 28 / 376 / 144 | 0.0 | |
| 98 | Enabled | 24.7 | 1341.9 | 155 / 300 / 386 | 0.0 | |
| 99 | Medium | 24.5 | 1340.4 | 32 / 202 / 114 | 0.0 | |
| 100 | Medium | 24.3 | 1340.5 | 16 / 191 / 77 | 0.0 | |
| 101 | High | 24.2 | 1338.4 | 16 / 202 / 96 | 0.0 | |
| 102 | None | 24.2 | 1339.6 | 15 / 196 / 53 | 0.0 | |
| 103 | XHigh | 24.1 | 1338.7 | 19 / 191 / 58 | 0.0 | |
| 104 | High | 24.0 | 1353.4 | 3 / 186 / 49 | 10.7 | |
| 105 | None | 24.0 | 1334.4 | 26 / 221 / 81 | 0.0 | |
| 106 | Low | 23.8 | 1329.7 | 21 / 282 / 127 | 0.0 | |
| 107 | Medium | 23.7 | 1332.6 | 12 / 212 / 54 | 0.0 | |
| 108 | Medium | 23.6 | 1328.9 | 21 / 192 / 129 | 0.0 | |
| 109 | Medium | 23.6 | 1333.6 | 27 / 334 / 99 | 0.0 | |
| 110 | Medium | 23.5 | 1326.8 | 20 / 235 / 114 | 0.0 | |
| 111 | Low | 23.3 | 1343.1 | 5 / 65 / 34 | 5.0 | |
| 112 | Medium | 23.3 | 1328.2 | 17 / 183 / 62 | 0.0 | |
| 113 | Minimal | 23.2 | 1320.4 | 59 / 576 / 297 | 0.0 | |
| 114 | Low | 23.1 | 1325.9 | 9 / 422 / 103 | 0.0 | |
| 115 | None | 23.1 | 1326.6 | 10 / 171 / 67 | 0.0 | |
| 116 | None | 23.1 | 1325.5 | 13 / 207 / 44 | 0.0 | |
| 117 | Enabled | 23.0 | 1323.9 | 16 / 204 / 62 | 0.0 | |
| 118 | Minimal | 22.9 | 1322.2 | 19 / 206 / 75 | 0.0 | |
| 119 | High | 22.9 | 1320.0 | 15 / 216 / 115 | 0.0 | |
| 120 | Enabled | 22.9 | 1317.2 | 37 / 619 / 232 | 0.0 | |
| 121 | Medium | 22.8 | 1321.9 | 11 / 201 / 56 | 0.0 | |
| 122 | High | 22.8 | 1321.5 | 33 / 147 / 88 | 0.0 | |
| 123 | Enabled | 22.6 | 1318.4 | 18 / 162 / 102 | 0.0 | |
| 124 | None | 22.5 | 1319.8 | 6 / 175 / 59 | 0.0 | |
| 125 | None | 22.5 | 1313.7 | 15 / 252 / 140 | 0.0 | |
| 126 | None | 22.5 | 1318.1 | 26 / 397 / 113 | 0.0 | |
| 127 | Enabled | 22.5 | 1316.9 | 0 / 231 / 53 | 0.0 | |
| 128 | None | 22.4 | 1315.0 | 28 / 446 / 142 | 0.0 | |
| 129 | None | 22.3 | 1314.4 | 18 / 196 / 80 | 0.0 | |
| 130 | Medium | 22.3 | 1310.6 | 38 / 588 / 214 | 0.0 | |
| 131 | None | 22.3 | 1316.8 | 10 / 170 / 60 | 0.0 | |
| 132 | None | 22.3 | 1312.9 | 11 / 207 / 92 | 0.0 | |
| 133 | Max | 22.2 | 1326.1 | 13 / 63 / 42 | 2.1 | |
| 134 | Minimal | 22.1 | 1307.9 | 33 / 603 / 248 | 0.0 | |
| 135 | Medium | 22.1 | 1313.9 | 14 / 162 / 76 | 0.0 | |
| 136 | XHigh | 22.1 | 1312.3 | 18 / 182 / 84 | 0.0 | |
| 137 | None | 22.1 | 1313.2 | 0 / 201 / 59 | 0.0 | |
| 138 | Medium | 22.1 | 1306.3 | 36 / 268 / 179 | 0.0 | |
| 139 | Enabled | 22.1 | 1312.3 | 11 / 192 / 69 | 0.0 | |
| 140 | XHigh | 22.0 | 1309.8 | 14 / 204 / 80 | 0.0 | |
| 141 | Max | 21.9 | 1308.1 | 12 / 204 / 117 | 0.0 | |
| 142 | Low | 21.8 | 1309.2 | 12 / 195 / 57 | 0.0 | |
| 143 | Low | 21.8 | 1308.6 | 8 / 195 / 71 | 0.0 | |
| 144 | None | 21.8 | 1308.4 | 19 / 387 / 142 | 0.0 | |
| 145 | Low | 21.7 | 1313.1 | 6 / 129 / 45 | 0.0 | |
| 146 | High | 21.6 | 1307.0 | 22 / 313 / 149 | 0.0 | |
| 147 | High | 21.5 | 1300.8 | 17 / 270 / 123 | 0.0 | |
| 148 | Medium | 21.5 | 1306.1 | 7 / 158 / 69 | 0.0 | |
| 149 | None | 21.4 | 1303.8 | 14 / 176 / 78 | 0.0 | |
| 150 | Minimal | 21.4 | 1303.6 | 10 / 182 / 72 | 0.0 | |
| 151 | None | 21.4 | 1302.6 | 9 / 206 / 73 | 0.0 | |
| 152 | None | 21.3 | 1314.9 | 10 / 63 / 47 | 1.7 | |
| 153 | Medium | 21.3 | 1299.4 | 18 / 239 / 97 | 0.0 | |
| 154 | None | 21.1 | 1312.8 | 5 / 70 / 37 | 3.3 | |
| 155 | None | 21.1 | 1302.4 | 6 / 146 / 60 | 0.0 | |
| 156 | Enabled | 21.0 | 1316.0 | 0 / 184 / 68 | 12.5 | |
| 157 | High | 20.9 | 1295.0 | 16 / 200 / 118 | 0.0 | |
| 158 | Low | 20.7 | 1294.1 | 0 / 199 / 77 | 0.0 | |
| 159 | Medium | 20.6 | 1293.3 | 13 / 160 / 87 | 0.0 | |
| 160 | None | 20.2 | 1288.2 | 8 / 187 / 71 | 0.0 | |
| 161 | Reasoning | 20.2 | 1289.5 | 1 / 167 / 68 | 0.0 | |
| 162 | XHigh | 20.0 | 1283.1 | 6 / 257 / 81 | 0.0 | |
| 163 | Low | 20.0 | 1299.9 | 7 / 39 / 60 | 4.6 | |
| 164 | High | 19.9 | 1284.8 | 12 / 161 / 87 | 0.0 | |
| 165 | None | 19.8 | 1282.9 | 7 / 166 / 103 | 0.0 | |
| 166 | XHigh | 19.8 | 1281.9 | 2 / 211 / 77 | 0.0 | |
| 167 | Low | 19.7 | 1276.6 | 0 / 289 / 125 | 0.0 | |
| 168 | Medium | 19.2 | 1274.8 | 67 / 83 / 138 | 0.0 | |
| 169 | Max | 18.5 | 1265.1 | 2 / 201 / 85 | 0.0 | |
| 170 | Low | 18.4 | 1264.7 | 2 / 196 / 70 | 0.0 | |
| 171 | Enabled | 18.2 | 1276.3 | 2 / 65 / 43 | 3.7 | |
| 172 | High | 18.0 | 1259.7 | 7 / 186 / 87 | 0.0 | |
| 173 | Enabled | 17.9 | 1258.8 | 2 / 159 / 95 | 0.0 | |
| 174 | Max | 17.8 | 1253.1 | 4 / 257 / 153 | 0.0 | |
| 175 | High | 17.8 | 1255.9 | 4 / 192 / 96 | 0.0 | |
| 176 | Medium | 17.4 | 1266.7 | 0 / 43 / 61 | 5.0 | |
| 177 | Max | 16.4 | 1237.8 | 2 / 185 / 107 | 0.0 | |
| 178 | High | 16.2 | 1236.1 | 0 / 166 / 100 | 0.0 | |
| 179 | None | 15.9 | 1245.0 | 0 / 60 / 56 | 2.5 | |
| 180 | Low | 15.2 | 1223.5 | 2 / 157 / 105 | 0.0 | |
| 181 | Reasoning | 14.2 | 1211.8 | 2 / 139 / 103 | 0.0 | |
| 182 | Medium | 14.0 | 1208.8 | 3 / 112 / 129 | 0.0 | |
| 183 | High | 13.6 | 1217.8 | 4 / 41 / 61 | 4.6 | |
| 184 | Medium | 13.4 | 1201.2 | 1 / 135 / 126 | 0.0 | |
| 185 | None | 13.0 | 1195.7 | 27 / 133 / 108 | 0.0 | |
| 186 | Low | 9.4 | 1148.0 | 6 / 144 / 138 | 0.0 | |
| 187 | High | 6.3 | 1125.3 | 2 / 35 / 59 | 7.0 | |
| 188 | None | 4.2 | 1079.2 | 17 / 65 / 270 | 0.0 | |
| 189 | Enabled | 0.0 | 1028.6 | 21 / 32 / 199 | 0.0 |
Underlying results
Individual player programs
Each row is one accepted player program for GB2-08: Tumbleweed. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.
| Player ID | Model | Reasoning | Status | Score | Elo | Confidence | W / D / L | Rated / attempted | Opponents | Capped draws | Faults / players | Generation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| E-431dafe8272e01a0 | Claude Fable 5.1 | Medium | Rated | 80.7 | 2068 | — | 251 / 0 / 31 | 282 / 282 | 115 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-7c76315be309fffb | Claude Fable 5.1 | Low | Rated | 72.2 | 1958 | — | 235 / 1 / 34 | 270 / 270 | 119 | 1 | 0 / 1 | First try · 2026-09-03 |
| E-17e93ae8fb09e82b | Seed 2.0 Code | Medium | Rated | 74.7 | 1991 | — | 219 / 1 / 44 | 264 / 264 | 116 | 1 | 0 / 1 | First try · 2026-09-03 |
| E-92701c342489867e | Seed 2.0 Code | Low | Rated | 21.8 | 1309 | — | 8 / 195 / 71 | 274 / 274 | 115 | 195 | 0 / 1 | First try · 2026-09-03 |
| E-fa0bb19e2ae86400 | Seed 2.0 Code | High | Rated | 39.9 | 1540 | — | 94 / 153 / 69 | 316 / 316 | 133 | 153 | 0 / 1 | First try · 2026-09-03 |
| E-6f759a260a58e8b0 | Claude Fable 5 | Medium | Rated | 82.0 | 2084 | — | 265 / 0 / 23 | 288 / 288 | 110 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-788a8512e768b8d6 | Claude Fable 5 | Low | Rated | 68.9 | 1916 | — | 210 / 1 / 53 | 264 / 264 | 114 | 1 | 0 / 1 | First try · 2026-09-03 |
| E-cc65768072457cfb | Claude Fable 5 | XHigh | Rated | 31.4 | 1432 | — | 71 / 124 / 77 | 272 / 272 | 118 | 124 | 0 / 1 | First try · 2026-09-03 |
| E-3b200c9d604918bf | Claude Fable 5.1 | XHigh | Rated | 100.0 | 2317 | — | 258 / 0 / 4 | 262 / 262 | 113 | 0 | 0 / 1 | Repaired · 2026-09-08 |
| E-01b57d5e6655f927 | Claude Opus 4.5 | Thinking field omitted | Rated | 66.0 | 1879 | — | 164 / 15 / 61 | 240 / 240 | 84 | 15 | 0 / 1 | First try · 2026-07-02 |
| E-355427eb0d526f34 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 35.9 | 1493 | — | 75 / 84 / 73 | 232 / 232 | 83 | 84 | 0 / 1 | First try · 2026-07-02 |
| E-6a0c04b4335bfea0 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 62.2 | 1832 | — | 153 / 0 / 71 | 224 / 224 | 79 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-72233463ddce5549 | Claude Opus 4.5 | Medium effort + 16,000 thinking tokens | Rated | 63.8 | 1845 | — | 325 / 5 / 96 | 426 / 426 | 140 | 5 | 0 / 1 | First try · 2026-07-21 |
| E-877eec51affacb3a | Claude Opus 4.5 | High effort + 32,000 thinking tokens | Rated | 25.8 | 1354 | — | 49 / 256 / 197 | 502 / 502 | 156 | 256 | 0 / 1 | First try · 2026-07-21 |
| E-22dc6fe5ae5fb8b1 | Claude Opus 4.8 | XHigh | Rated | 70.6 | 1938 | — | 188 / 0 / 56 | 244 / 244 | 88 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-c2dade0b97891d8a | Claude Opus 4.8 | Medium | Rated | 20.6 | 1293 | — | 13 / 160 / 87 | 260 / 260 | 96 | 160 | 0 / 1 | First try · 2026-07-02 |
| E-c9d7578e8375d994 | Claude Opus 4.8 | Thinking field omitted | Rated | 65.5 | 1874 | — | 193 / 1 / 52 | 246 / 246 | 84 | 1 | 0 / 1 | First try · 2026-07-02 |
| E-35a5bf9b35d5e1e8 | Claude Opus 5 | Medium | Rated | 70.4 | 1936 | — | 211 / 0 / 43 | 254 / 254 | 87 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-43cc1c89fa5720b3 | Claude Opus 5 | Thinking disabled | Rated | 55.0 | 1732 | — | 288 / 53 / 81 | 422 / 422 | 137 | 53 | 0 / 1 | First try · 2026-07-25 |
| E-5a7942274854aaa6 | Claude Opus 5 | Thinking disabled | Rated | 53.0 | 1711 | — | 193 / 0 / 81 | 274 / 274 | 102 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-a40851c4f03704e5 | Claude Opus 5 | XHigh | Rated | 86.1 | 2139 | — | 218 / 0 / 24 | 242 / 242 | 86 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-e73b6fb78880341d | Claude Opus 5 | Medium | Rated | 83.5 | 2104 | — | 251 / 0 / 17 | 268 / 268 | 97 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-f5914ca845403384 | Claude Opus 5 | XHigh | Rated | 55.0 | 1739 | — | 172 / 0 / 64 | 236 / 236 | 86 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-1591dc61bb110d10 | Claude Opus 5.5 | Low | Rated | 43.4 | 1601 | — | 67 / 4 / 39 | 110 / 110 | 55 | 4 | 0 / 1 | First try · 2026-09-22 |
| E-57a4de42441fcf4f | Claude Opus 5.5 | Medium | Rated | 81.9 | 2098 | — | 106 / 0 / 2 | 108 / 108 | 54 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-7bc967a8698a261b | Claude Opus 5.5 | Medium | Rated | 73.2 | 1985 | — | 106 / 0 / 6 | 112 / 112 | 56 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-96d7941179f2fd25 | Claude Opus 5.5 | XHigh | Rated | 78.6 | 2052 | — | 109 / 0 / 11 | 120 / 120 | 60 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-d5608447286f8afa | Claude Opus 5.5 | Low | Rated | 43.2 | 1596 | — | 75 / 0 / 49 | 124 / 124 | 62 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-01c56a1fc7407264 | Claude Sonnet 5 | Medium | Rated | 28.6 | 1390 | — | 52 / 256 / 134 | 442 / 442 | 152 | 256 | 0 / 1 | First try · 2026-08-09 |
| E-c2e7d7e507756f84 | Claude Sonnet 5 | Thinking disabled | Rated | 34.7 | 1471 | — | 124 / 160 / 126 | 410 / 410 | 139 | 160 | 0 / 1 | First try · 2026-08-09 |
| E-df0550ce48a0b895 | Claude Sonnet 5 | XHigh | Rated | 64.3 | 1854 | — | 263 / 2 / 79 | 344 / 344 | 117 | 2 | 0 / 1 | First try · 2026-08-09 |
| E-c36a98e057c264eb | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 21.4 | 1303 | — | 9 / 206 / 73 | 288 / 288 | 97 | 206 | 0 / 1 | First try · 2026-07-11 |
| E-efd7b75d5cd3b538 | North Mini Code | Enabled | Rated | 25.1 | 1382 | — | 0 / 39 / 13 | 52 / 52 | 26 | 39 | 0 / 1 | First try · 2026-07-02 |
| E-12c0277656309eac | DeepSeek V4 Flash | High | Rated | 37.8 | 1515 | — | 70 / 114 / 86 | 270 / 270 | 111 | 114 | 0 / 1 | First try · 2026-09-03 |
| E-43aba68125a9abc5 | DeepSeek V4 Flash | High | Rated | 24.7 | 1348 | — | 16 / 162 / 44 | 222 / 222 | 85 | 162 | 0 / 1 | First try · 2026-07-02 |
| E-86334efb2f150e36 | DeepSeek V4 Flash | Reasoning disabled | Rated | 13.0 | 1196 | — | 27 / 133 / 108 | 268 / 268 | 111 | 133 | 0 / 1 | First try · 2026-09-03 |
| E-d28ef17ff6995c62 | DeepSeek V4 Flash | High | Rated | 22.5 | 1319 | — | 11 / 172 / 55 | 238 / 238 | 80 | 172 | 0 / 1 | Repaired · 2026-07-01 |
| E-dfb4143d89ab6bff | DeepSeek V4 Flash | XHigh | Rated | 22.1 | 1312 | — | 18 / 182 / 84 | 284 / 284 | 115 | 182 | 0 / 1 | Repaired · 2026-09-03 |
| E-a1af43ba06ab00d8 | DeepSeek V4 Pro | High | Rated | 66.7 | 1887 | — | 221 / 1 / 44 | 266 / 266 | 113 | 1 | 0 / 1 | First try · 2026-09-03 |
| E-a985f6d48a19a9c2 | DeepSeek V4 Pro | XHigh | Rated | 22.0 | 1310 | — | 14 / 204 / 80 | 298 / 298 | 115 | 204 | 0 / 1 | First try · 2026-09-03 |
| E-ee3348c274d4249e | DeepSeek V4 Pro | Reasoning disabled | Rated | 20.2 | 1288 | — | 8 / 187 / 71 | 266 / 266 | 113 | 187 | 0 / 1 | First try · 2026-09-03 |
| E-25d7d2fe0a5b0fc1 | DeepSeek V4 Pro 0813 | Reasoning disabled | Rated | 23.1 | 1325 | — | 13 / 207 / 44 | 264 / 264 | 105 | 207 | 0 / 1 | First try · 2026-09-03 |
| E-373eef73bdf8a3a4 | DeepSeek V4 Pro 0813 | High | Rated | 31.6 | 1433 | — | 97 / 121 / 114 | 332 / 332 | 143 | 121 | 0 / 1 | First try · 2026-09-03 |
| E-780810fdd45c68ee | DeepSeek V4 Pro 0813 | Max | Rated | 16.4 | 1238 | — | 2 / 185 / 107 | 294 / 294 | 111 | 185 | 0 / 1 | Repaired · 2026-09-03 |
| E-a121c7043bd04669 | DeepSeek V4.1 Flash | Max | Rated | 38.9 | 1543 | — | 36 / 50 / 26 | 112 / 112 | 56 | 50 | 0 / 1 | First try · 2026-09-18 |
| E-c63f675d2bc7794f | DeepSeek V4.1 Flash | High | Rated | 13.6 | 1218 | — | 4 / 41 / 61 | 106 / 106 | 53 | 41 | 0 / 1 | First try · 2026-09-18 |
| E-c969feb85ef91ea8 | DeepSeek V4.1 Flash | None | Rated | 21.1 | 1313 | — | 5 / 70 / 37 | 112 / 112 | 56 | 70 | 0 / 1 | First try · 2026-09-18 |
| E-b335c9f92035f80b | Gemini 3.1 Flash Lite | High | Rated | 19.9 | 1285 | — | 12 / 161 / 87 | 260 / 260 | 100 | 161 | 0 / 1 | Repaired · 2026-07-02 |
| E-cc6fb78c96472032 | Gemini 3.1 Flash Lite | Medium | Rated | 19.2 | 1275 | — | 67 / 83 / 138 | 288 / 288 | 105 | 83 | 0 / 1 | First try · 2026-07-02 |
| E-01745958bcb89213 | Gemini 3.5 Flash | High | Rated | 42.9 | 1579 | — | 115 / 103 / 88 | 306 / 306 | 117 | 103 | 0 / 1 | First try · 2026-09-03 |
| E-0fa7a2cede372154 | Gemini 3.5 Flash | Medium | Rated | 13.4 | 1201 | — | 1 / 135 / 126 | 262 / 262 | 104 | 135 | 0 / 1 | First try · 2026-09-03 |
| E-5aa593158b0d8b3a | Gemini 3.5 Flash | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-83154d89d5d7c05b | Gemini 3.5 Flash | Minimal | Rated | 21.4 | 1304 | — | 10 / 182 / 72 | 264 / 264 | 112 | 182 | 0 / 1 | First try · 2026-09-03 |
| E-284d554eca16e6f6 | Gemini 3.5 Flash Lite | Minimal | Rated | 23.3 | 1323 | — | 16 / 316 / 130 | 462 / 462 | 135 | 316 | 0 / 1 | First try · 2026-07-24 |
| E-2a14d2f80ade1bda | Gemini 3.5 Flash Lite | High | Rated | 21.5 | 1301 | — | 17 / 270 / 123 | 410 / 410 | 138 | 270 | 0 / 2 | First try · 2026-07-24 |
| E-2f2aa5b1beafd6e6 | Gemini 3.5 Flash Lite | Medium | Rated | 23.1 | 1320 | — | 17 / 302 / 113 | 432 / 432 | 128 | 302 | 0 / 1 | First try · 2026-07-24 |
| E-9b50de854a87d3c6 | Gemini 3.5 Flash Lite | Medium | Rated | 21.6 | 1301 | — | 21 / 286 / 101 | 408 / 408 | 130 | 286 | 0 / 1 | First try · 2026-07-24 |
| E-af119b49b8f1d63d | Gemini 3.5 Flash Lite | Minimal | Rated | 21.0 | 1293 | — | 17 / 287 / 118 | 422 / 422 | 135 | 287 | 0 / 1 | First try · 2026-07-24 |
| E-620b5ca2bcd82419 | Gemini 3.6 Flash | High | Rated | 55.0 | 1732 | — | 246 / 66 / 98 | 410 / 410 | 141 | 66 | 0 / 1 | First try · 2026-07-24 |
| E-657c523bc9e9f80c | Gemini 3.6 Flash | Minimal | Rated | 25.2 | 1346 | — | 38 / 295 / 175 | 508 / 508 | 167 | 295 | 0 / 1 | Repaired · 2026-07-24 |
| E-ab7ee826f8050f04 | Gemini 3.6 Flash | Medium | Rated | 57.2 | 1761 | — | 219 / 67 / 112 | 398 / 398 | 138 | 67 | 0 / 1 | First try · 2026-07-24 |
| E-c694a36a5e4e3f09 | Gemini 3.6 Flash | Minimal | Rated | 21.1 | 1295 | — | 21 / 281 / 122 | 424 / 424 | 143 | 281 | 0 / 1 | First try · 2026-07-24 |
| E-efad9f3f4e9183a0 | Gemini 3.6 Flash | High | Rated | 18.0 | 1254 | — | 18 / 255 / 143 | 416 / 416 | 128 | 255 | 0 / 1 | First try · 2026-07-24 |
| E-50da0ec927ab0c88 | Gemini 3.8 Flash | High | Rated | 34.6 | 1471 | — | 109 / 144 / 87 | 340 / 340 | 130 | 144 | 0 / 1 | First try · 2026-09-03 |
| E-d79adbac179007cf | Gemini 3.8 Flash | Low | Rated | 58.4 | 1780 | — | 180 / 19 / 75 | 274 / 274 | 116 | 19 | 0 / 1 | First try · 2026-09-03 |
| E-ef690b3b73fd1d5a | Gemini 3.8 Flash | Medium | Rated | 23.6 | 1329 | — | 21 / 192 / 129 | 342 / 342 | 142 | 192 | 0 / 1 | First try · 2026-09-03 |
| E-8546650b7690a81a | Gemma 4 31B | Reasoning disabled | Rated | 21.4 | 1304 | — | 14 / 176 / 78 | 268 / 268 | 100 | 176 | 0 / 1 | First try · 2026-07-02 |
| E-eabc996d553eebe0 | GPT 4.1 | None | Rated | 25.2 | 1352 | — | 33 / 172 / 67 | 272 / 272 | 102 | 172 | 0 / 1 | First try · 2026-07-02 |
| E-04ae9f2b42e0e036 | GPT 5 | Medium | Rated | 22.1 | 1314 | — | 14 / 162 / 76 | 252 / 252 | 91 | 162 | 0 / 1 | First try · 2026-07-02 |
| E-ae3a897b3420bcfb | GPT 5 | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ebca8ea756b4a4ad | GPT 5 | High | Rated | 22.8 | 1322 | — | 33 / 147 / 88 | 268 / 268 | 104 | 147 | 0 / 1 | First try · 2026-07-02 |
| E-07ad6c481bf678a2 | GPT-5.4 | None | Rated | 22.5 | 1314 | — | 15 / 252 / 140 | 407 / 407 | 134 | 252 | 0 / 1 | Repaired · 2026-08-09 |
| E-431ff31b9cd599e1 | GPT-5.4 | XHigh | Rated | 50.4 | 1674 | — | 197 / 42 / 129 | 368 / 368 | 130 | 42 | 0 / 1 | First try · 2026-08-09 |
| E-6b601c15cf117b79 | GPT-5.4 | Medium | Rated | 31.4 | 1426 | — | 70 / 261 / 120 | 451 / 451 | 141 | 261 | 0 / 1 | First try · 2026-08-09 |
| E-b5171a15f0048555 | GPT-5.4 Mini | Medium | Rated | 25.2 | 1352 | — | 67 / 96 / 107 | 270 / 270 | 97 | 96 | 0 / 1 | First try · 2026-07-02 |
| E-bb8ac98c284a38ce | GPT-5.4 Mini | None | Rated | 22.5 | 1320 | — | 6 / 175 / 59 | 240 / 242 | 79 | 175 | 2 / 1 | First try · 2026-07-02 |
| E-024aff0a983df40d | GPT-5.4 Nano | None | Rated | 21.0 | 1298 | — | 0 / 195 / 69 | 264 / 264 | 90 | 195 | 0 / 1 | First try · 2026-07-09 |
| E-26fa12e871bd8f3a | GPT-5.4 Nano | Medium | Rated | 16.5 | 1241 | — | 9 / 133 / 110 | 252 / 252 | 84 | 133 | 0 / 1 | Repaired · 2026-07-02 |
| E-e361d8cbba2abd67 | GPT-5.4 Nano | Medium | Rated | 61.6 | 1823 | — | 189 / 0 / 59 | 248 / 248 | 87 | 0 | 0 / 1 | Repaired · 2026-07-09 |
| E-fd5a36e5fd795426 | GPT-5.4 Nano | None | Rated | 59.5 | 1797 | — | 168 / 4 / 62 | 234 / 234 | 80 | 4 | 0 / 1 | Repaired · 2026-07-02 |
| E-0d83a3c5c5e66085 | GPT-5.5 | Medium | Rated | 36.1 | 1493 | — | 91 / 121 / 54 | 266 / 266 | 93 | 121 | 0 / 1 | First try · 2026-07-02 |
| E-3e859a6b27767128 | GPT-5.5 | XHigh | Rated | 49.2 | 1662 | — | 161 / 70 / 29 | 260 / 260 | 95 | 70 | 0 / 1 | First try · 2026-07-02 |
| E-c42fbee03a029c83 | GPT-5.5 | None | Rated | 23.1 | 1327 | — | 10 / 171 / 67 | 248 / 248 | 96 | 171 | 0 / 1 | First try · 2026-07-02 |
| E-283f17e4d25ffd65 | GPT-5.6 Luna | Medium | Rated | 21.3 | 1299 | — | 18 / 239 / 97 | 354 / 354 | 121 | 239 | 0 / 1 | First try · 2026-08-09 |
| E-b761803f2b99649c | GPT-5.6 Luna | None | Rated | 4.2 | 1079 | — | 17 / 65 / 270 | 352 / 352 | 126 | 65 | 0 / 1 | First try · 2026-08-09 |
| E-ca2978e1aca13fec | GPT-5.6 Luna | XHigh | Rated | 20.0 | 1283 | — | 6 / 257 / 81 | 344 / 344 | 122 | 257 | 0 / 1 | First try · 2026-08-09 |
| E-55079a10c13f4211 | GPT-5.6 Sol | Medium | Rated | 47.4 | 1636 | — | 183 / 68 / 113 | 364 / 364 | 127 | 68 | 0 / 1 | First try · 2026-08-09 |
| E-58adff67f80afed1 | GPT-5.6 Sol | XHigh | Rated | 63.1 | 1838 | — | 276 / 0 / 80 | 356 / 356 | 124 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-9c0688f3432e6295 | GPT-5.6 Sol | None | Rated | 65.9 | 1873 | — | 276 / 30 / 70 | 376 / 376 | 122 | 30 | 0 / 1 | First try · 2026-08-09 |
| E-03b36b60ca1b86b6 | GPT-5.6 Terra | None | Rated | 33.2 | 1454 | — | 59 / 192 / 83 | 334 / 334 | 142 | 192 | 0 / 1 | First try · 2026-09-03 |
| E-235f333de39ec575 | GPT-5.6 Terra | XHigh | Rated | 27.0 | 1373 | — | 77 / 114 / 145 | 336 / 336 | 139 | 114 | 0 / 1 | First try · 2026-09-03 |
| E-6dd1bd7607347e24 | GPT-5.6 Terra | Medium | Rated | 29.5 | 1406 | — | 90 / 92 / 130 | 312 / 312 | 133 | 92 | 0 / 1 | First try · 2026-09-03 |
| E-02789044133a041d | GPT-6 Astra | XHigh | Rated | 79.6 | 2054 | — | 232 / 0 / 36 | 268 / 268 | 115 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-57bd25d1868a06af | GPT-6 Astra | Medium | Rated | 87.6 | 2157 | — | 245 / 0 / 21 | 266 / 266 | 115 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-e86bc4b82641ac08 | GPT-6 Astra | Low | Rated | 62.3 | 1832 | — | 194 / 0 / 68 | 262 / 262 | 111 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-0d3b2fcd5bc6510f | GPT-6 Luna | Medium | Rated | 17.4 | 1267 | — | 0 / 43 / 61 | 104 / 104 | 52 | 43 | 0 / 1 | First try · 2026-09-22 |
| E-218872d1038031c8 | GPT-6 Luna | XHigh | Rated | 53.1 | 1726 | — | 71 / 4 / 33 | 108 / 108 | 54 | 4 | 0 / 1 | First try · 2026-09-22 |
| E-c7bd12f2711c94d5 | GPT-6 Luna | None | Rated | 21.3 | 1315 | — | 10 / 63 / 47 | 120 / 120 | 60 | 63 | 0 / 1 | First try · 2026-09-22 |
| E-36cf9981ba97c185 | GPT-6 Sol | Medium | Rated | 65.0 | 1879 | — | 87 / 2 / 21 | 110 / 110 | 55 | 2 | 0 / 1 | First try · 2026-09-22 |
| E-af0655de8f084e84 | GPT-6 Sol | None | Rated | 61.7 | 1836 | — | 90 / 1 / 23 | 114 / 114 | 57 | 1 | 0 / 1 | First try · 2026-09-22 |
| E-d91bdf3143c30eda | GPT-6 Sol | XHigh | Rated | 66.8 | 1902 | — | 95 / 1 / 16 | 112 / 112 | 56 | 1 | 0 / 1 | First try · 2026-09-22 |
| E-6ab707a4d42c7697 | Granite 4.2 8B | Low | Rated | 20.7 | 1294 | — | 0 / 199 / 77 | 276 / 276 | 114 | 199 | 0 / 1 | Repaired · 2026-09-03 |
| E-556bff7f21f0d16d | Mercury 2.5 Preview | Medium | Rated | 23.7 | 1333 | — | 12 / 212 / 54 | 278 / 278 | 117 | 212 | 0 / 1 | First try · 2026-09-03 |
| E-f9287d1670b751fc | Mercury 2.5 Preview | High | Rated | 18.0 | 1260 | — | 7 / 186 / 87 | 280 / 280 | 120 | 186 | 0 / 1 | First try · 2026-09-03 |
| E-11d1ae7d9526f835 | Ling 3.0 Flash | Baseline track (legacy evidence incomplete) | Rated | 20.7 | 1293 | — | 9 / 225 / 74 | 308 / 310 | 96 | 225 | 0 / 1 | First try · 2026-07-24 |
| E-28bcc8394e411616 | Ling 3.0 Flash | Baseline track (legacy evidence incomplete) | Rated | 24.1 | 1337 | — | 19 / 221 / 68 | 308 / 308 | 100 | 221 | 0 / 1 | Repaired · 2026-07-24 |
| E-87d69837bf65e78b | LongCat 2.0 | None | Rated | 24.0 | 1337 | — | 10 / 217 / 49 | 276 / 276 | 96 | 217 | 0 / 1 | First try · 2026-07-24 |
| E-d724da56cbc06da7 | LongCat 2.0 | Enabled | Rated | 10.6 | 1160 | — | 7 / 141 / 266 | 414 / 414 | 131 | 141 | 0 / 1 | First try · 2026-07-24 |
| E-df8e0fab4bf8bb33 | LongCat 2.0 | None | Rated | 21.0 | 1299 | — | 16 / 180 / 64 | 260 / 260 | 97 | 180 | 0 / 1 | First try · 2026-07-24 |
| E-ef389910f6cc07cc | LongCat 2.0 | Enabled | Rated | 38.9 | 1524 | — | 148 / 159 / 120 | 427 / 427 | 131 | 159 | 0 / 1 | First try · 2026-07-24 |
| E-14418036e04f70ed | Muse Glimmer 30B | Medium | Rated | 22.8 | 1322 | — | 11 / 201 / 56 | 268 / 268 | 116 | 201 | 0 / 1 | First try · 2026-09-03 |
| E-9196faff01fcf355 | Muse Glimmer 30B | Low | Rated | 21.8 | 1309 | — | 12 / 195 / 57 | 264 / 264 | 112 | 195 | 0 / 1 | First try · 2026-09-03 |
| E-977b83745c0f8865 | Muse Glimmer 30B | XHigh | Rated | 24.1 | 1339 | — | 19 / 191 / 58 | 268 / 268 | 120 | 191 | 0 / 1 | Repaired · 2026-09-03 |
| E-20b4e41aba8e4f47 | Muse Spark 1.2 | Minimal | Rated | 46.2 | 1620 | — | 198 / 9 / 179 | 386 / 386 | 141 | 9 | 0 / 1 | First try · 2026-08-13 |
| E-502a038b3a2d63ef | Muse Spark 1.2 | Medium | Rated | 49.6 | 1663 | — | 226 / 65 / 109 | 400 / 400 | 133 | 65 | 0 / 1 | First try · 2026-08-13 |
| E-024b481d6bae5a28 | Muse Spark 1.3 | XHigh | Rated | 63.5 | 1847 | — | 205 / 1 / 58 | 264 / 264 | 114 | 1 | 0 / 1 | First try · 2026-09-03 |
| E-4d07fb424bfff952 | Muse Spark 1.3 | Minimal | Rated | 22.9 | 1322 | — | 19 / 206 / 75 | 300 / 300 | 129 | 206 | 0 / 1 | First try · 2026-09-03 |
| E-de62e3353f433cf7 | Muse Spark 1.3 | Medium | Rated | 63.6 | 1847 | — | 200 / 15 / 71 | 286 / 286 | 108 | 15 | 0 / 1 | First try · 2026-09-03 |
| E-d169e7b29be70652 | Minimax M3 | Reasoning enabled | Rated | 23.0 | 1324 | — | 16 / 204 / 62 | 282 / 282 | 97 | 204 | 0 / 1 | Repaired · 2026-07-02 |
| E-e67e41d4491d7ad3 | Minimax M3 | Reasoning disabled | Rated | 40.4 | 1549 | — | 120 / 17 / 115 | 252 / 252 | 91 | 17 | 0 / 1 | First try · 2026-07-02 |
| E-65f43ae2f7bdda23 | Mistral Medium 3.5 | None | Rated | 24.2 | 1340 | — | 15 / 196 / 53 | 264 / 264 | 112 | 196 | 0 / 1 | Repaired · 2026-09-08 |
| E-dcb0a5ecba87ab85 | Mistral Medium 3.5 | High | Rated | 20.9 | 1295 | — | 16 / 200 / 118 | 334 / 334 | 136 | 200 | 0 / 1 | Repaired · 2026-09-08 |
| E-251b5d53a5f89562 | Kimi K2.7 Code | Reasoning enabled | Rated | 47.5 | 1641 | — | 151 / 25 / 72 | 248 / 248 | 89 | 25 | 0 / 1 | Repaired · 2026-07-02 |
| E-151c4ee6a2d1838e | Kimi K3 | High | Rated | 25.0 | 1343 | — | 28 / 376 / 144 | 548 / 548 | 164 | 376 | 0 / 1 | First try · 2026-07-24 |
| E-3e1be56b9d966ded | Kimi K3 | Low | Rated | 88.2 | 2159 | — | 398 / 0 / 24 | 422 / 422 | 137 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-506d972b5c69a00d | Nex N2 Pro | Reasoning disabled | Rated | 22.1 | 1313 | — | 0 / 201 / 59 | 260 / 260 | 83 | 201 | 0 / 1 | Repaired · 2026-07-11 |
| E-92332f4d765b2297 | Nex N2 Pro | Reasoning enabled | Rated | 0.0 | 1029 | — | 21 / 32 / 199 | 252 / 252 | 95 | 32 | 0 / 1 | Repaired · 2026-07-02 |
| E-15cf0dede27b7e1b | Nemotron 3 Ultra 550B A55B | Medium | Rated | 23.3 | 1328 | — | 17 / 183 / 62 | 262 / 262 | 94 | 183 | 0 / 1 | Repaired · 2026-07-02 |
| E-2e3c01d0103fc439 | Nemotron 3 Ultra 550B A55B | High | Rated | 20.2 | 1289 | — | 10 / 158 / 84 | 252 / 252 | 85 | 158 | 0 / 1 | Repaired · 2026-07-11 |
| E-8c24e8bcbe9b1228 | Nemotron 3 Ultra 550B A55B | High | Rated | 22.9 | 1325 | — | 12 / 155 / 65 | 232 / 232 | 93 | 155 | 0 / 1 | First try · 2026-07-02 |
| E-ada32b27ea6ffedd | Nemotron 3 Ultra 550B A55B | Reasoning disabled | Rated | 22.3 | 1317 | — | 10 / 170 / 60 | 240 / 240 | 83 | 170 | 0 / 1 | First try · 2026-07-02 |
| E-2270b9df7d2b32cc | O3 | High | Rated | 53.4 | 1712 | — | 267 / 13 / 124 | 404 / 404 | 134 | 13 | 0 / 1 | First try · 2026-07-03 |
| E-335ae90fdc702bd6 | O3 | Low | Rated | 23.8 | 1330 | — | 21 / 282 / 127 | 430 / 430 | 136 | 282 | 0 / 1 | First try · 2026-07-21 |
| E-35de956c8305ff90 | O3 | Medium | Rated | 27.7 | 1384 | — | 59 / 148 / 83 | 290 / 290 | 100 | 148 | 0 / 1 | First try · 2026-07-02 |
| E-9fbb8e6c69f575f4 | O3 | High | Rated | 24.1 | 1335 | — | 15 / 273 / 98 | 386 / 386 | 124 | 273 | 0 / 1 | First try · 2026-07-03 |
| E-afa6c09eebc859c4 | O3 | High | Rated | 24.6 | 1339 | — | 35 / 298 / 149 | 482 / 482 | 150 | 298 | 0 / 1 | First try · 2026-07-02 |
| E-160a45dc9c3b0f7b | GPT-OSS 120B | High | Rated | 17.8 | 1256 | — | 4 / 192 / 96 | 292 / 292 | 113 | 192 | 0 / 1 | First try · 2026-09-03 |
| E-8209ba1f8b66a20a | GPT-OSS 120B | Medium | Rated | 24.3 | 1341 | — | 16 / 191 / 77 | 284 / 284 | 116 | 191 | 0 / 1 | First try · 2026-09-03 |
| E-83df183c847c63b2 | GPT-OSS 120B | Low | Rated | 18.4 | 1265 | — | 2 / 196 / 70 | 268 / 268 | 118 | 196 | 0 / 1 | First try · 2026-09-03 |
| E-0fab95afbec0dd98 | Laguna S 2.1 | Enabled | Rated | 23.7 | 1328 | — | 20 / 312 / 120 | 452 / 452 | 139 | 312 | 0 / 1 | First try · 2026-07-24 |
| E-4030acdbccf3ca03 | Laguna S 2.1 | None | Rated | 21.8 | 1309 | — | 9 / 207 / 58 | 274 / 274 | 92 | 207 | 0 / 1 | Repaired · 2026-07-24 |
| E-e90a3ce84847ba43 | Laguna S 2.1 | None | Rated | 21.8 | 1308 | — | 10 / 180 / 84 | 274 / 274 | 96 | 180 | 0 / 1 | First try · 2026-07-24 |
| E-f72c72b8f264c57a | Laguna S 2.1 | Enabled | Rated | 22.0 | 1306 | — | 17 / 307 / 112 | 436 / 436 | 143 | 307 | 0 / 1 | First try · 2026-07-24 |
| E-64624689e7cbd439 | Qwen3.7 Max | Reasoning enabled | Rated | 22.6 | 1318 | — | 18 / 162 / 102 | 282 / 282 | 102 | 162 | 0 / 1 | Repaired · 2026-07-02 |
| E-a667eb7d15f7f43e | Qwen3.7 Max | Reasoning disabled | Rated | 19.8 | 1283 | — | 7 / 166 / 103 | 276 / 276 | 90 | 166 | 0 / 1 | First try · 2026-07-02 |
| E-6c2a9942e92223c8 | Qwen3.7 Plus | Reasoning enabled | Rated | 22.5 | 1317 | — | 0 / 231 / 53 | 284 / 284 | 101 | 231 | 0 / 1 | First try · 2026-07-02 |
| E-1e6f62de0c6a682d | Qwen3.8 2.4t A95B | Low | Rated | 65.6 | 1873 | — | 211 / 4 / 55 | 270 / 270 | 111 | 4 | 0 / 1 | First try · 2026-09-03 |
| E-6e16ca6d013d5403 | Qwen3.8 2.4t A95B | XHigh | Rated | 82.7 | 2093 | — | 265 / 2 / 27 | 294 / 294 | 121 | 2 | 0 / 1 | Repaired · 2026-09-03 |
| E-cee402d3ba359e98 | Qwen3.8 2.4t A95B | Medium | Rated | 24.5 | 1340 | — | 32 / 202 / 114 | 348 / 348 | 142 | 202 | 0 / 1 | First try · 2026-09-03 |
| E-7aeaa99c1ec41a6e | Qwen3.8 27B | XHigh | Rated | 29.9 | 1410 | — | 97 / 118 / 125 | 340 / 340 | 140 | 118 | 0 / 1 | First try · 2026-09-03 |
| E-e7475d702d0a59b2 | Qwen3.8 27B | Reasoning disabled | Rated | 24.0 | 1334 | — | 26 / 221 / 81 | 328 / 328 | 131 | 221 | 0 / 1 | Repaired · 2026-09-03 |
| E-2cc9864688ec6d0a | Qwen3.8 Flash | Reasoning enabled | Rated | 28.9 | 1397 | — | 38 / 224 / 92 | 354 / 354 | 143 | 224 | 0 / 1 | Repaired · 2026-09-03 |
| E-9bfeb7f42796747d | Qwen3.8 Flash | Reasoning disabled | Rated | 22.3 | 1313 | — | 11 / 207 / 92 | 310 / 310 | 135 | 207 | 0 / 1 | First try · 2026-09-03 |
| E-58e68aa5bf529b8a | Qwen3.8 Max | Medium | Rated | 47.8 | 1643 | — | 138 / 55 / 91 | 284 / 284 | 115 | 55 | 0 / 1 | First try · 2026-08-08 |
| E-e77a22943f077d4d | Qwen3.8 Max | Minimal | Rated | 37.6 | 1510 | — | 110 / 156 / 94 | 360 / 360 | 143 | 156 | 0 / 1 | First try · 2026-08-08 |
| E-eef649e110a96b98 | Qwen3.8 Max | XHigh | Rated | 30.6 | 1418 | — | 62 / 211 / 101 | 374 / 374 | 146 | 211 | 0 / 1 | First try · 2026-08-18 |
| E-85580f29f1109557 | Qwen3.8 Max 0902 | Xhigh | Rated | 37.2 | 1521 | — | 41 / 46 / 21 | 108 / 108 | 54 | 46 | 0 / 1 | First try · 2026-09-18 |
| E-c31df2c0d1682379 | Qwen3.8 Max 0902 | Medium | Rated | 26.3 | 1381 | — | 20 / 46 / 38 | 104 / 104 | 52 | 46 | 0 / 1 | First try · 2026-09-18 |
| E-e8fa1e3881f8a5aa | Qwen3.8 Max 0902 | Low | Rated | 23.3 | 1343 | — | 5 / 65 / 34 | 104 / 104 | 52 | 65 | 0 / 1 | First try · 2026-09-18 |
| E-273045858e4a7f82 | Ox Alpha | High | Rated | 39.4 | 1535 | — | 92 / 91 / 107 | 290 / 290 | 118 | 91 | 0 / 1 | First try · 2026-08-22 |
| E-27b1ec2d9d5762a4 | Ox Alpha | Max | Rated | 78.8 | 2043 | — | 212 / 1 / 49 | 262 / 262 | 112 | 1 | 0 / 1 | First try · 2026-08-22 |
| E-4e4d3135cae0253d | Ox Alpha | Low | Rated | 22.6 | 1319 | — | 9 / 205 / 58 | 272 / 272 | 109 | 205 | 0 / 1 | First try · 2026-08-22 |
| E-6b99e270ec28f9cf | Ox Alpha | Low | Rated | 23.6 | 1333 | — | 0 / 217 / 45 | 262 / 262 | 114 | 217 | 0 / 1 | First try · 2026-08-22 |
| E-8094ab91b5be5ad0 | Ox Alpha | High | Rated | 48.4 | 1652 | — | 149 / 56 / 77 | 282 / 282 | 126 | 56 | 0 / 1 | First try · 2026-08-22 |
| E-a87ab54ca8c5ca34 | Ox Alpha | High | Rated | 31.6 | 1432 | — | 84 / 144 / 126 | 354 / 354 | 143 | 144 | 0 / 1 | Repaired · 2026-08-22 |
| E-ec8f506d56ff547e | Ox Alpha | Max | Rated | 41.1 | 1556 | — | 103 / 106 / 105 | 314 / 314 | 128 | 106 | 0 / 1 | First try · 2026-08-22 |
| E-f84aa60bad19339a | Ox Alpha | Max | Rated | 51.6 | 1692 | — | 149 / 20 / 103 | 272 / 272 | 114 | 20 | 0 / 1 | First try · 2026-08-22 |
| E-8b265019ada47f24 | Step 3.7 Flash | High | Rated | 25.7 | 1359 | — | 4 / 199 / 57 | 260 / 260 | 89 | 199 | 0 / 1 | Repaired · 2026-07-02 |
| E-c38fe2712e69333b | Step 3.7 Flash | Low | Rated | 19.7 | 1277 | — | 0 / 289 / 125 | 414 / 414 | 135 | 289 | 0 / 1 | First try · 2026-07-21 |
| E-56487337fad4192f | Hy3 Preview | None | Rated | 26.5 | 1368 | — | 14 / 206 / 74 | 294 / 294 | 100 | 206 | 0 / 1 | First try · 2026-07-02 |
| E-81a5e5ef15f371dc | Hy3 Preview | High | Rated | 31.7 | 1436 | — | 89 / 80 / 95 | 264 / 264 | 111 | 80 | 0 / 1 | First try · 2026-07-02 |
| E-67fef818be4f03bb | Hy4 Preview | Low | Rated | 81.4 | 2077 | — | 234 / 0 / 28 | 262 / 262 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-b209c0c123e5bd0d | Hy4 Preview | None | Rated | 22.3 | 1314 | — | 18 / 196 / 80 | 294 / 294 | 132 | 196 | 0 / 1 | First try · 2026-09-03 |
| E-da025fc403d4e41a | Hy4 Preview | High | Rated | 22.9 | 1320 | — | 15 / 216 / 115 | 346 / 346 | 142 | 216 | 0 / 1 | First try · 2026-09-03 |
| E-68669040dc891a7d | Inkling | None | Rated | 61.8 | 1825 | — | 175 / 11 / 76 | 262 / 262 | 92 | 11 | 0 / 1 | Repaired · 2026-07-24 |
| E-9f74dab09049a473 | Inkling | Medium | Rated | 22.1 | 1306 | — | 36 / 268 / 179 | 483 / 483 | 150 | 268 | 0 / 1 | First try · 2026-07-24 |
| E-d21921560d198b28 | Inkling | Max | Rated | 17.8 | 1253 | — | 4 / 257 / 153 | 414 / 414 | 142 | 257 | 0 / 1 | Repaired · 2026-07-24 |
| E-888363fef76ee16a | Inkling Small | Max | Rated | 21.9 | 1308 | — | 12 / 204 / 117 | 333 / 333 | 132 | 204 | 0 / 1 | Repaired · 2026-08-09 |
| E-99211d414b6fcc51 | Inkling Small | None | Rated | 25.1 | 1351 | — | 12 / 218 / 48 | 278 / 278 | 110 | 218 | 0 / 1 | Repaired · 2026-08-09 |
| E-9cd2fd1302bb65bd | Inkling Small | Medium | Rated | 23.5 | 1327 | — | 20 / 235 / 114 | 369 / 369 | 152 | 235 | 0 / 1 | First try · 2026-08-09 |
| E-707dd709e358a173 | Grok 4.5 | High | Rated | 79.3 | 2045 | — | 360 / 4 / 46 | 410 / 410 | 136 | 4 | 0 / 1 | First try · 2026-07-24 |
| E-73422318071a105c | Grok 4.5 | Medium | Rated | 71.0 | 1943 | — | 235 / 4 / 27 | 266 / 266 | 95 | 4 | 0 / 1 | First try · 2026-07-24 |
| E-b914d026c7631fcb | Grok 4.5 | Low | Rated | 63.2 | 1838 | — | 331 / 0 / 87 | 418 / 418 | 149 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-755fbe9bb04dabcb | Grok 4.6 | XHigh | Rated | 30.3 | 1417 | — | 72 / 125 / 101 | 298 / 298 | 128 | 125 | 0 / 1 | First try · 2026-09-03 |
| E-c18e6d589d217daa | Grok 4.6 | Medium | Rated | 70.1 | 1932 | — | 209 / 0 / 53 | 262 / 262 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d6237e4179511384 | Grok 4.6 | Low | Rated | 28.5 | 1391 | — | 47 / 214 / 111 | 372 / 372 | 162 | 214 | 0 / 1 | First try · 2026-09-03 |
| E-21d18ac4b85ba46c | Grok 4.7 | XHigh | Rated | 65.2 | 1883 | — | 94 / 2 / 10 | 106 / 106 | 53 | 2 | 0 / 1 | First try · 2026-09-22 |
| E-885b17da755607f8 | Grok 4.7 | Medium | Rated | 71.6 | 1965 | — | 90 / 0 / 12 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-b969ee774f59cb28 | Grok 4.7 | Low | Rated | 54.5 | 1745 | — | 74 / 0 / 28 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-23 |
| E-3e2fe948d2bcebb0 | Grok Build 0.1 | Reasoning enabled | Rated | 22.1 | 1312 | — | 11 / 192 / 69 | 272 / 272 | 96 | 192 | 0 / 1 | Repaired · 2026-07-02 |
| E-5f664f9580459829 | MiMo-V2.5 | High | Rated | 27.3 | 1407 | — | 2 / 53 / 3 | 58 / 58 | 29 | 53 | 0 / 1 | Repaired · 2026-07-02 |
| E-650d06103e7fa176 | MiMo-V2.5 | Reasoning enabled | Rated | 33.5 | 1460 | — | 55 / 143 / 64 | 262 / 262 | 91 | 143 | 0 / 1 | Repaired · 2026-07-03 |
| E-b5eb7da0f5021b69 | MiMo-V2.5 | Reasoning enabled | Rated | 14.0 | 1209 | — | 3 / 112 / 129 | 244 / 244 | 91 | 112 | 0 / 1 | Repaired · 2026-07-02 |
| E-cabbf604f15eb575 | MiMo-V2.5 | Reasoning disabled | Rated | 14.2 | 1212 | — | 2 / 139 / 103 | 244 / 244 | 94 | 139 | 0 / 1 | First try · 2026-07-02 |
| E-d51fce0298267f96 | MiMo-V2.5 | Reasoning disabled | Rated | 20.2 | 1289 | — | 1 / 167 / 68 | 236 / 236 | 90 | 167 | 0 / 1 | First try · 2026-07-01 |
| E-bd1bb7ac29877b8f | MiMo-V2.5-Pro | Reasoning enabled | Rated | 17.9 | 1259 | — | 2 / 159 / 95 | 256 / 256 | 95 | 159 | 0 / 1 | Repaired · 2026-07-02 |
| E-fd909b083f6f9591 | MiMo-V2.5-Pro | Reasoning disabled | Rated | 21.1 | 1302 | — | 6 / 146 / 60 | 212 / 212 | 89 | 146 | 0 / 1 | Repaired · 2026-07-02 |
| E-4081de435904aa26 | MiMo-V2.6-Flash | Reasoning disabled | Rated | 15.9 | 1245 | — | 0 / 60 / 56 | 116 / 116 | 58 | 60 | 0 / 1 | First try · 2026-09-22 |
| E-d1a4c3c0a3dd4ad0 | MiMo-V2.6-Flash | Reasoning enabled | Rated | 18.2 | 1276 | — | 2 / 65 / 43 | 110 / 110 | 55 | 65 | 0 / 1 | First try · 2026-09-22 |
| E-0a2a5d6c5b2937c9 | MiMo-V2.6-Pro | Reasoning disabled | Rated | 60.5 | 1821 | — | 88 / 0 / 24 | 112 / 112 | 56 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-ee0cf0fac9e1d5ab | MiMo-V2.6-Pro | Reasoning enabled | Rated | 77.5 | 2040 | — | 106 / 0 / 6 | 112 / 112 | 56 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-36f56a09540b1d5d | GLM-5.2 | Reasoning disabled | Rated | 26.1 | 1362 | — | 21 / 205 / 76 | 302 / 302 | 128 | 205 | 0 / 1 | First try · 2026-09-03 |
| E-4f6f71a5d33a522d | GLM-5.2 | High | Rated | 16.2 | 1236 | — | 0 / 166 / 100 | 266 / 266 | 117 | 166 | 0 / 1 | First try · 2026-09-03 |
| E-6a361d88d8c1fb48 | GLM-5.2 | Reasoning disabled | Rated | 20.5 | 1293 | — | 10 / 146 / 90 | 246 / 246 | 88 | 146 | 0 / 1 | First try · 2026-07-11 |
| E-97efd9455394f6d7 | GLM-5.2 | Reasoning disabled | Rated | 64.6 | 1863 | — | 186 / 0 / 46 | 232 / 232 | 80 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-da1e9a6be31e371f | GLM-5.2 | High | Rated | 21.5 | 1306 | — | 7 / 158 / 69 | 234 / 234 | 87 | 158 | 0 / 1 | Repaired · 2026-07-11 |
| E-f5d6306a7bc8cc32 | GLM-5.2 | XHigh | Rated | 19.8 | 1282 | — | 2 / 211 / 77 | 290 / 290 | 121 | 211 | 0 / 1 | First try · 2026-09-03 |
| E-39795008f245fd5b | GLM 5.3 | Max | Rated | 77.1 | 2022 | — | 223 / 0 / 43 | 266 / 266 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-bb5ba5001306bce6 | GLM 5.3 | Low | Rated | 15.2 | 1223 | — | 2 / 157 / 105 | 264 / 264 | 111 | 157 | 0 / 1 | First try · 2026-09-03 |
| E-da0657798b4da166 | GLM 5.3 | High | Rated | 51.3 | 1687 | — | 158 / 85 / 83 | 326 / 326 | 132 | 85 | 0 / 1 | Repaired · 2026-09-03 |
| E-20ffb1405d378103 | GLM 5.3 Flash | Low | Rated | 9.4 | 1148 | — | 6 / 144 / 138 | 288 / 288 | 106 | 144 | 0 / 1 | First try · 2026-09-03 |
| E-3a28c9225f2ca3eb | GLM 5.3 Flash | High | Rated | 24.2 | 1338 | — | 16 / 202 / 96 | 314 / 314 | 133 | 202 | 0 / 1 | First try · 2026-09-03 |
| E-5b1106e8ef2f7a1c | GLM 5.3 Flash | Max | Rated | 18.5 | 1265 | — | 2 / 201 / 85 | 288 / 288 | 111 | 201 | 0 / 1 | Repaired · 2026-09-03 |
| E-0d02ccc92304e957 | GLM-5.3 FlashX | High | Rated | 6.3 | 1125 | — | 2 / 35 / 59 | 96 / 96 | 48 | 35 | 0 / 1 | Repaired · 2026-09-22 |
| E-98d023c8499ecd07 | GLM-5.3 FlashX | Low | Rated | 20.0 | 1300 | — | 7 / 39 / 60 | 106 / 106 | 53 | 39 | 0 / 1 | First try · 2026-09-22 |
| E-a6979e1c9bfd808a | GLM-5.3 FlashX | Max | Rated | 22.2 | 1326 | — | 13 / 63 / 42 | 118 / 118 | 59 | 63 | 0 / 1 | First try · 2026-09-22 |