Game profile
Game of the Amazons
Game of the Amazons is a 10x10 mobility and territory game where each move relocates an amazon and then fires a permanent blocking arrow.
Scores here compare player programs using DuelLab's encoded rules for Game of the Amazons; they are not a broad measure of human play strength.
By model and setting
GB2-07: Game of the Amazons by model and setting
Each model and reasoning setting appears once. If a model produced more than one accepted player program, DuelLab averages them before ranking. Raw rating, W / D / L, and the rating-evidence index combine those contributing programs. A zero index is a clipped endpoint, not zero uncertainty about future generations.
| Rank | Model | Reasoning | Score | Raw Elo | W / D / L | Rating-evidence index |
|---|---|---|---|---|---|---|
| 1 | XHigh | 100.0 | 2296.8 | 254 / 0 / 4 | 0.0 | |
| 2 | Max | 97.7 | 2261.6 | 253 / 0 / 11 | 0.0 | |
| 3 | Low | 97.3 | 2255.7 | 249 / 0 / 9 | 0.0 | |
| 4 | Medium | 94.6 | 2214.0 | 275 / 0 / 9 | 0.0 | |
| 5 | XHigh | 94.2 | 2209.1 | 488 / 0 / 30 | 0.0 | |
| 6 | Medium | 91.8 | 2173.3 | 246 / 0 / 16 | 0.0 | |
| 7 | XHigh | 89.0 | 2127.7 | 318 / 0 / 30 | 0.0 | |
| 8 | XHigh | 89.0 | 2133.0 | 203 / 0 / 9 | 0.0 | |
| 9 | XHigh | 88.1 | 2130.1 | 107 / 0 / 1 | 4.1 | |
| 10 | XHigh | 83.9 | 2053.9 | 215 / 0 / 27 | 0.0 | |
| 11 | Medium | 82.8 | 2037.4 | 417 / 0 / 67 | 0.0 | |
| 12 | Medium | 82.7 | 2049.2 | 95 / 0 / 9 | 5.0 | |
| 13 | XHigh | 82.4 | 2044.4 | 101 / 0 / 9 | 3.7 | |
| 14 | Low | 79.8 | 2006.2 | 97 / 0 / 9 | 4.6 | |
| 15 | Low | 79.0 | 1980.1 | 218 / 0 / 36 | 0.0 | |
| 16 | Medium | 78.9 | 1992.5 | 94 / 0 / 8 | 5.5 | |
| 17 | XHigh | 76.8 | 1942.8 | 286 / 0 / 64 | 0.0 | |
| 18 | None | 75.7 | 1931.3 | 204 / 0 / 40 | 0.0 | |
| 19 | XHigh | 74.8 | 1913.7 | 233 / 0 / 79 | 0.0 | |
| 20 | Enabled | 74.8 | 1932.2 | 81 / 0 / 11 | 8.1 | |
| 21 | XHigh | 72.9 | 1887.4 | 184 / 0 / 82 | 0.0 | |
| 22 | Enabled | 72.6 | 1884.0 | 201 / 0 / 37 | 0.0 | |
| 23 | Max | 72.3 | 1878.6 | 207 / 0 / 59 | 0.0 | |
| 24 | XHigh | 72.1 | 1875.3 | 189 / 0 / 77 | 0.0 | |
| 25 | Low | 71.8 | 1869.9 | 199 / 0 / 67 | 0.0 | |
| 26 | High | 70.2 | 1846.3 | 203 / 0 / 81 | 0.0 | |
| 27 | Medium | 70.1 | 1844.5 | 183 / 0 / 81 | 0.0 | |
| 28 | Enabled | 69.7 | 1838.5 | 202 / 0 / 78 | 0.0 | |
| 29 | Max | 69.7 | 1854.4 | 73 / 0 / 25 | 6.5 | |
| 30 | High | 68.8 | 1825.8 | 179 / 0 / 77 | 0.0 | |
| 31 | XHigh | 68.2 | 1817.9 | 177 / 0 / 57 | 0.0 | |
| 32 | XHigh | 68.1 | 1813.9 | 202 / 0 / 70 | 0.0 | |
| 33 | Medium | 67.6 | 1802.9 | 276 / 0 / 100 | 0.0 | |
| 34 | Medium | 66.9 | 1796.0 | 177 / 0 / 89 | 0.0 | |
| 35 | Low | 66.5 | 1785.5 | 267 / 0 / 133 | 0.0 | |
| 36 | Low | 66.2 | 1785.6 | 169 / 0 / 97 | 0.0 | |
| 37 | High | 65.9 | 1781.9 | 170 / 0 / 84 | 0.0 | |
| 38 | Medium | 65.9 | 1781.3 | 190 / 0 / 70 | 0.0 | |
| 39 | High | 65.7 | 1777.8 | 187 / 0 / 81 | 0.0 | |
| 40 | Max | 65.3 | 1771.5 | 189 / 0 / 95 | 0.0 | |
| 41 | High | 65.2 | 1770.3 | 177 / 0 / 115 | 0.0 | |
| 42 | High | 64.6 | 1761.6 | 180 / 0 / 108 | 0.0 | |
| 43 | None | 64.4 | 1758.8 | 188 / 0 / 82 | 0.0 | |
| 44 | Max | 64.2 | 1772.3 | 80 / 0 / 16 | 7.0 | |
| 45 | Medium | 63.7 | 1760.9 | 81 / 0 / 37 | 2.1 | |
| 46 | Low | 63.5 | 1745.1 | 169 / 0 / 95 | 0.0 | |
| 47 | XHigh | 62.9 | 1733.8 | 238 / 0 / 110 | 0.0 | |
| 48 | Minimal | 61.9 | 1721.1 | 181 / 0 / 98 | 0.0 | |
| 49 | High | 61.5 | 1715.5 | 169 / 0 / 101 | 0.0 | |
| 50 | Medium | 60.9 | 1706.8 | 171 / 0 / 69 | 0.0 | |
| 51 | XHigh | 60.3 | 1696.7 | 164 / 0 / 102 | 0.0 | |
| 52 | XHigh | 60.2 | 1709.1 | 75 / 0 / 31 | 4.6 | |
| 53 | Medium | 60.1 | 1695.0 | 173 / 0 / 77 | 0.0 | |
| 54 | Max | 59.5 | 1682.8 | 557 / 0 / 351 | 0.0 | |
| 55 | High | 58.9 | 1690.8 | 77 / 0 / 25 | 5.5 | |
| 56 | XHigh | 58.8 | 1675.1 | 151 / 0 / 111 | 0.0 | |
| 57 | None | 58.8 | 1688.3 | 67 / 0 / 41 | 4.1 | |
| 58 | High | 58.8 | 1675.3 | 145 / 0 / 93 | 0.0 | |
| 59 | Medium | 58.7 | 1668.6 | 230 / 0 / 148 | 0.0 | |
| 60 | XHigh | 58.6 | 1668.0 | 213 / 0 / 133 | 0.0 | |
| 61 | Low | 57.8 | 1655.1 | 226 / 0 / 158 | 0.0 | |
| 62 | Medium | 57.1 | 1644.7 | 214 / 0 / 163 | 0.0 | |
| 63 | Low | 56.5 | 1653.4 | 69 / 0 / 39 | 4.1 | |
| 64 | Max | 56.4 | 1631.6 | 269 / 0 / 199 | 0.0 | |
| 65 | Medium | 55.6 | 1625.4 | 151 / 0 / 123 | 0.0 | |
| 66 | Minimal | 54.8 | 1608.7 | 538 / 0 / 348 | 0.0 | |
| 67 | XHigh | 54.7 | 1612.6 | 134 / 0 / 138 | 0.0 | |
| 68 | None | 54.5 | 1611.4 | 139 / 0 / 89 | 0.0 | |
| 69 | Medium | 54.5 | 1608.8 | 159 / 0 / 111 | 0.0 | |
| 70 | Medium | 54.4 | 1604.8 | 203 / 0 / 167 | 0.0 | |
| 71 | High | 53.8 | 1594.7 | 189 / 0 / 187 | 0.0 | |
| 72 | Medium | 53.5 | 1596.0 | 134 / 0 / 106 | 0.0 | |
| 73 | Medium | 53.5 | 1590.4 | 210 / 0 / 156 | 0.0 | |
| 74 | Medium | 53.0 | 1587.4 | 155 / 0 / 95 | 0.0 | |
| 75 | High | 51.6 | 1559.8 | 281 / 0 / 201 | 0.0 | |
| 76 | Historical | 51.5 | 1566.4 | 278 / 0 / 182 | 0.0 | |
| 77 | High | 51.4 | 1559.1 | 173 / 0 / 185 | 0.0 | |
| 78 | High | 51.3 | 1576.7 | 60 / 0 / 40 | 6.0 | |
| 79 | High | 51.3 | 1554.2 | 251 / 0 / 243 | 0.0 | |
| 80 | Medium | 50.9 | 1553.1 | 176 / 0 / 156 | 0.0 | |
| 81 | Low | 50.2 | 1540.9 | 201 / 0 / 155 | 0.0 | |
| 82 | None | 50.1 | 1543.4 | 147 / 0 / 111 | 0.0 | |
| 83 | Medium | 49.9 | 1539.7 | 139 / 0 / 123 | 0.0 | |
| 84 | Low | 49.1 | 1526.8 | 144 / 0 / 152 | 0.0 | |
| 85 | Minimal | 49.1 | 1522.0 | 466 / 0 / 421 | 0.0 | |
| 86 | Medium | 49.0 | 1521.3 | 226 / 0 / 212 | 0.0 | |
| 87 | Reasoning | 48.9 | 1526.3 | 235 / 0 / 211 | 0.0 | |
| 88 | Medium | 48.8 | 1516.1 | 227 / 0 / 295 | 0.0 | |
| 89 | None | 48.7 | 1521.8 | 135 / 0 / 121 | 0.0 | |
| 90 | None | 47.2 | 1500.3 | 133 / 0 / 101 | 0.0 | |
| 91 | Low | 46.3 | 1499.6 | 52 / 0 / 54 | 4.6 | |
| 92 | Low | 45.9 | 1485.9 | 94 / 0 / 80 | 0.0 | |
| 93 | None | 44.2 | 1454.5 | 227 / 0 / 285 | 0.0 | |
| 94 | XHigh | 44.2 | 1451.4 | 170 / 0 / 154 | 0.0 | |
| 95 | None | 43.9 | 1448.2 | 134 / 0 / 146 | 0.0 | |
| 96 | Reasoning | 43.7 | 1442.5 | 161 / 0 / 193 | 0.0 | |
| 97 | Medium | 43.4 | 1457.9 | 47 / 0 / 49 | 7.0 | |
| 98 | High | 43.2 | 1433.0 | 435 / 0 / 480 | 0.0 | |
| 99 | None | 42.9 | 1434.5 | 127 / 0 / 137 | 0.0 | |
| 100 | Enabled | 42.7 | 1429.8 | 131 / 0 / 175 | 0.0 | |
| 101 | Low | 42.6 | 1434.6 | 89 / 0 / 89 | 0.0 | |
| 102 | High | 42.5 | 1426.6 | 396 / 0 / 476 | 0.0 | |
| 103 | None | 42.4 | 1423.0 | 193 / 0 / 155 | 0.0 | |
| 104 | High | 42.0 | 1413.7 | 253 / 0 / 249 | 0.0 | |
| 105 | Medium | 41.9 | 1434.0 | 43 / 0 / 59 | 5.5 | |
| 106 | High | 41.8 | 1411.1 | 857 / 0 / 1031 | 0.0 | |
| 107 | Enabled | 41.7 | 1416.1 | 133 / 0 / 125 | 0.0 | |
| 108 | Enabled | 41.7 | 1416.4 | 134 / 0 / 112 | 0.0 | |
| 109 | Medium | 41.5 | 1409.6 | 406 / 0 / 370 | 0.0 | |
| 110 | High | 41.5 | 1413.3 | 125 / 0 / 133 | 0.0 | |
| 111 | XHigh | 40.5 | 1395.7 | 134 / 0 / 208 | 0.0 | |
| 112 | XHigh | 40.2 | 1389.5 | 154 / 0 / 220 | 0.0 | |
| 113 | Low | 40.1 | 1387.5 | 206 / 0 / 212 | 0.0 | |
| 114 | Enabled | 38.8 | 1388.5 | 391 / 0 / 569 | 16.7 | |
| 115 | None | 38.6 | 1382.2 | 39 / 0 / 71 | 3.7 | |
| 116 | Low | 38.0 | 1375.8 | 36 / 0 / 64 | 6.0 | |
| 117 | None | 37.7 | 1350.3 | 214 / 0 / 229 | 0.0 | |
| 118 | Medium | 37.7 | 1353.2 | 139 / 0 / 169 | 0.0 | |
| 119 | Low | 37.6 | 1353.7 | 128 / 0 / 156 | 0.0 | |
| 120 | Enabled | 37.5 | 1346.9 | 327 / 0 / 531 | 0.0 | |
| 121 | Minimal | 37.4 | 1351.7 | 127 / 0 / 139 | 0.0 | |
| 122 | Low | 37.1 | 1344.4 | 396 / 0 / 574 | 0.0 | |
| 123 | None | 36.2 | 1348.3 | 33 / 0 / 69 | 5.5 | |
| 124 | Medium | 36.1 | 1327.1 | 156 / 0 / 232 | 0.0 | |
| 125 | Max | 35.6 | 1319.4 | 134 / 0 / 270 | 0.0 | |
| 126 | Medium | 35.4 | 1319.7 | 126 / 0 / 160 | 0.0 | |
| 127 | Medium | 35.3 | 1322.2 | 110 / 0 / 114 | 0.0 | |
| 128 | High | 35.3 | 1319.9 | 105 / 0 / 153 | 0.0 | |
| 129 | Minimal | 35.2 | 1314.1 | 146 / 0 / 240 | 0.0 | |
| 130 | None | 35.2 | 1317.6 | 101 / 0 / 169 | 0.0 | |
| 131 | None | 35.1 | 1311.5 | 162 / 0 / 238 | 0.0 | |
| 132 | None | 34.9 | 1308.4 | 145 / 0 / 283 | 0.0 | |
| 133 | XHigh | 34.8 | 1327.5 | 36 / 0 / 66 | 5.5 | |
| 134 | Enabled | 34.7 | 1324.1 | 113 / 0 / 185 | 9.6 | |
| 135 | Low | 34.1 | 1296.7 | 159 / 0 / 267 | 0.0 | |
| 136 | None | 34.1 | 1301.7 | 218 / 0 / 306 | 0.0 | |
| 137 | None | 33.7 | 1296.2 | 112 / 0 / 148 | 0.0 | |
| 138 | Low | 33.7 | 1295.5 | 92 / 0 / 172 | 0.0 | |
| 139 | Medium | 33.5 | 1292.2 | 116 / 0 / 142 | 0.0 | |
| 140 | Medium | 32.8 | 1281.9 | 190 / 0 / 312 | 0.0 | |
| 141 | None | 32.7 | 1277.2 | 105 / 0 / 225 | 0.0 | |
| 142 | Minimal | 32.0 | 1269.7 | 113 / 0 / 159 | 0.0 | |
| 143 | High | 31.7 | 1260.6 | 128 / 0 / 290 | 0.0 | |
| 144 | Low | 30.3 | 1239.3 | 146 / 0 / 276 | 0.0 | |
| 145 | High | 30.3 | 1244.7 | 91 / 0 / 165 | 0.0 | |
| 146 | Enabled | 30.3 | 1243.4 | 100 / 0 / 164 | 0.0 | |
| 147 | Medium | 30.1 | 1238.0 | 118 / 0 / 234 | 0.0 | |
| 148 | Low | 30.0 | 1239.3 | 91 / 0 / 177 | 0.0 | |
| 149 | Enabled | 29.8 | 1235.8 | 97 / 0 / 169 | 0.0 | |
| 150 | High | 28.7 | 1221.0 | 77 / 0 / 173 | 0.0 | |
| 151 | Reasoning | 28.7 | 1221.0 | 93 / 0 / 149 | 0.0 | |
| 152 | None | 28.6 | 1219.2 | 83 / 0 / 167 | 0.0 | |
| 153 | Low | 27.9 | 1206.5 | 106 / 0 / 170 | 0.0 | |
| 154 | Medium | 27.6 | 1198.5 | 109 / 0 / 303 | 0.0 | |
| 155 | Medium | 27.0 | 1194.5 | 71 / 0 / 197 | 0.0 | |
| 156 | None | 26.5 | 1187.5 | 81 / 0 / 171 | 0.0 | |
| 157 | Medium | 26.3 | 1181.0 | 71 / 0 / 237 | 0.0 | |
| 158 | High | 25.8 | 1177.1 | 83 / 0 / 164 | 0.0 | |
| 159 | None | 25.6 | 1188.5 | 26 / 0 / 74 | 6.0 | |
| 160 | Medium | 25.4 | 1173.7 | 138 / 0 / 280 | 0.0 | |
| 161 | Enabled | 24.1 | 1149.8 | 91 / 0 / 189 | 0.0 | |
| 162 | None | 23.8 | 1146.3 | 76 / 0 / 190 | 0.0 | |
| 163 | Reasoning | 23.6 | 1142.2 | 79 / 0 / 183 | 0.0 | |
| 164 | Max | 22.5 | 1124.9 | 64 / 0 / 216 | 0.0 | |
| 165 | None | 21.4 | 1110.7 | 116 / 0 / 356 | 0.0 | |
| 166 | None | 20.9 | 1102.1 | 69 / 0 / 195 | 0.0 | |
| 167 | None | 20.4 | 1091.2 | 62 / 0 / 284 | 0.0 | |
| 168 | None | 20.4 | 1094.3 | 55 / 0 / 209 | 0.0 | |
| 169 | Reasoning | 20.1 | 1091.7 | 51 / 0 / 187 | 0.0 | |
| 170 | None | 16.8 | 1038.9 | 29 / 0 / 247 | 0.0 | |
| 171 | High | 16.0 | 1026.2 | 42 / 0 / 252 | 0.0 | |
| 172 | High | 15.2 | 1014.9 | 42 / 0 / 254 | 0.0 | |
| 173 | None | 13.6 | 993.5 | 44 / 0 / 192 | 0.0 | |
| 174 | Medium | 12.9 | 976.0 | 57 / 0 / 349 | 0.0 | |
| 175 | Enabled | 12.8 | 980.3 | 57 / 0 / 209 | 0.0 | |
| 176 | None | 12.3 | 973.2 | 38 / 0 / 208 | 0.0 | |
| 177 | Medium | 11.0 | 951.4 | 33 / 0 / 243 | 0.0 | |
| 178 | XHigh | 8.1 | 908.6 | 26 / 0 / 240 | 0.0 | |
| 179 | Medium | 7.0 | 893.1 | 25 / 0 / 215 | 0.0 | |
| 180 | Medium | 5.8 | 875.4 | 32 / 0 / 218 | 0.0 | |
| 181 | None | 4.9 | 863.4 | 21 / 0 / 197 | 0.0 | |
| 182 | Low | 1.1 | 802.8 | 12 / 0 / 268 | 0.0 | |
| 183 | None | 0.8 | 801.8 | 12 / 0 / 194 | 0.0 | |
| 184 | None | 0.0 | 787.1 | 20 / 0 / 230 | 0.0 |
Underlying results
Individual player programs
Each row is one accepted player program for GB2-07: Game of the Amazons. A model can appear more than once when it produced more than one program. Score is the normalized 0–100 result; Elo and W / D / L show the underlying play record. Confidence and evidence can be blank when too few compatible matches are available. Draws at the move limit count; one-sided model faults are listed separately.
| Player ID | Model | Reasoning | Status | Score | Elo | Confidence | W / D / L | Rated / attempted | Opponents | Capped draws | Faults / players | Generation |
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| E-11d32603b1221b2e | Claude Fable 5.1 | XHigh | Rated | 99.8 | 2294 | — | 247 / 0 / 13 | 260 / 260 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-8669b1c5c68118e1 | Claude Fable 5.1 | Medium | Rated | 91.8 | 2173 | — | 246 / 0 / 16 | 262 / 262 | 112 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-8d5af37f6619d723 | Claude Fable 5.1 | Low | Rated | 79.0 | 1980 | — | 218 / 0 / 36 | 254 / 254 | 114 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-4c2ae5ccbb904e11 | Seed 2.0 Code | High | Rated | 51.4 | 1559 | — | 173 / 0 / 185 | 358 / 358 | 146 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-93d06833ca286bb9 | Seed 2.0 Code | Low | Rated | 27.9 | 1206 | — | 106 / 0 / 170 | 276 / 276 | 117 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-496d6a0aaec65c82 | Claude Fable 5 | Low | Rated | 57.8 | 1655 | — | 226 / 0 / 158 | 384 / 384 | 147 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-502ccbb5f48f49b0 | Claude Fable 5 | Medium | Rated | 66.9 | 1796 | — | 177 / 0 / 89 | 266 / 266 | 119 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-9215dd5729f297ba | Claude Fable 5 | XHigh | Rated | 60.3 | 1697 | — | 164 / 0 / 102 | 266 / 266 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-c7cbdce0356163dd | Claude Fable 5.1 | XHigh | Rated | 88.6 | 2124 | — | 241 / 0 / 17 | 258 / 258 | 107 | 0 | 0 / 1 | First try · 2026-09-08 |
| E-ca22621c58b6f244 | Claude Opus 4.5 | Thinking field omitted | Rated | 33.7 | 1296 | — | 112 / 0 / 148 | 260 / 260 | 97 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-e7848fdc8b4ffd95 | Claude Opus 4.5 | Medium effort + 16,000 thinking tokens | Rated | 48.8 | 1516 | — | 227 / 0 / 295 | 522 / 522 | 158 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-e8719bed57f17312 | Claude Opus 4.5 | High effort + 32,000 thinking tokens | Rated | 42.0 | 1414 | — | 253 / 0 / 249 | 502 / 502 | 152 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-ed9657bcd9dfeda4 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 50.8 | 1555 | — | 145 / 0 / 93 | 238 / 238 | 82 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-f2d7a3f3bae22998 | Claude Opus 4.5 | Legacy_shared_thinking_budget | Rated | 52.2 | 1577 | — | 133 / 0 / 89 | 222 / 222 | 83 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-0bf7b9ed307db853 | Claude Opus 4.8 | Medium | Rated | 65.9 | 1781 | — | 190 / 0 / 70 | 260 / 260 | 83 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-5e09cecd1172d99b | Claude Opus 4.8 | XHigh | Rated | 68.2 | 1818 | — | 177 / 0 / 57 | 234 / 234 | 80 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-76804598cce96e62 | Claude Opus 4.8 | Thinking field omitted | Rated | 47.2 | 1500 | — | 133 / 0 / 101 | 234 / 234 | 87 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-1e882072d8d97548 | Claude Opus 5 | XHigh | Rated | 89.0 | 2133 | — | 203 / 0 / 9 | 212 / 212 | 78 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-54bca3ce32fa85ae | Claude Opus 5 | Medium | Rated | 90.7 | 2158 | — | 219 / 0 / 13 | 232 / 232 | 89 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-914b104a64ab3110 | Claude Opus 5 | Thinking disabled | Rated | 75.7 | 1931 | — | 204 / 0 / 40 | 244 / 244 | 85 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-de5e72176c4f0dc9 | Claude Opus 5 | Medium | Rated | 74.8 | 1917 | — | 198 / 0 / 54 | 252 / 252 | 92 | 0 | 0 / 1 | First try · 2026-07-25 |
| E-2771a403cc3d9cab | Claude Opus 5.5 | Low | Rated | 79.8 | 2006 | — | 97 / 0 / 9 | 106 / 106 | 53 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-393b10028aaa43a6 | Claude Opus 5.5 | Medium | Rated | 82.7 | 2049 | — | 95 / 0 / 9 | 104 / 104 | 52 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-a2c3e4f63d5e1edb | Claude Opus 5.5 | XHigh | Rated | 88.1 | 2130 | — | 107 / 0 / 1 | 108 / 108 | 54 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-754e53d1d8048114 | Claude Sonnet 5 | Thinking disabled | Rated | 35.1 | 1312 | — | 162 / 0 / 238 | 400 / 400 | 136 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-a0f9e38d7d75c542 | Claude Sonnet 5 | Medium | Rated | 49.0 | 1521 | — | 226 / 0 / 212 | 438 / 438 | 144 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-d751b3c423ad89f1 | Claude Sonnet 5 | XHigh | Rated | 58.6 | 1668 | — | 213 / 0 / 133 | 346 / 346 | 122 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-1c961fde1b53f0eb | North Mini Code | Enabled | Rated | 37.8 | 1383 | — | 26 / 0 / 36 | 62 / 62 | 31 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3b908f26a42804a4 | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 37.6 | 1354 | — | 98 / 0 / 162 | 260 / 260 | 84 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-c7f5dc6d5d3c2a8d | North Mini Code | Baseline track (legacy evidence incomplete) | Rated | 5.2 | 867 | — | 18 / 0 / 194 | 212 / 216 | 80 | 0 | 4 / 1 | Repaired · 2026-07-11 |
| E-04544fca137f7093 | DeepSeek V4 Flash | Reasoning disabled | Rated | 20.4 | 1094 | — | 55 / 0 / 209 | 264 / 264 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-62b84cb4140eae65 | DeepSeek V4 Flash | High | Rated | 41.5 | 1413 | — | 125 / 0 / 133 | 258 / 258 | 109 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-6379be2b3031c2cd | DeepSeek V4 Flash | XHigh | Rated | 40.5 | 1396 | — | 134 / 0 / 208 | 342 / 342 | 139 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-8f2f6c973751f183 | DeepSeek V4 Flash | High | Rated | 16.7 | 1042 | — | 50 / 0 / 160 | 210 / 210 | 79 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-edc2d085c4253ed3 | DeepSeek V4 Flash | High | Rated | 34.2 | 1306 | — | 88 / 0 / 120 | 208 / 208 | 76 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-20c7d14a5b30f693 | DeepSeek V4 Pro | High | Rated | 65.9 | 1782 | — | 170 / 0 / 84 | 254 / 254 | 109 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-881ee27d82346bfc | DeepSeek V4 Pro | XHigh | Rated | 72.9 | 1887 | — | 184 / 0 / 82 | 266 / 266 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-923022eaa3622371 | DeepSeek V4 Pro | Reasoning disabled | Rated | 42.4 | 1423 | — | 193 / 0 / 155 | 348 / 348 | 144 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-67b1550fc290d1a2 | DeepSeek V4 Pro 0813 | Max | Rated | 72.3 | 1879 | — | 207 / 0 / 59 | 266 / 266 | 114 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-8d9e60f19ef4ff22 | DeepSeek V4 Pro 0813 | Reasoning disabled | Rated | 23.8 | 1146 | — | 76 / 0 / 190 | 266 / 266 | 115 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d8693a3fc2173c3c | DeepSeek V4 Pro 0813 | High | Rated | 70.2 | 1846 | — | 203 / 0 / 81 | 284 / 284 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-84a4cd45ef73114f | DeepSeek V4.1 Flash | High | Rated | 58.9 | 1691 | — | 77 / 0 / 25 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-92e363ffbdbbb5a3 | DeepSeek V4.1 Flash | Max | Rated | 64.2 | 1772 | — | 80 / 0 / 16 | 96 / 96 | 48 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-9925375ed601afc8 | DeepSeek V4.1 Flash | None | Rated | 25.6 | 1189 | — | 26 / 0 / 74 | 100 / 100 | 50 | 0 | 0 / 1 | Repaired · 2026-09-18 |
| E-0d43f308cfa4da52 | Gemini 3.1 Flash Lite | High | Rated | 28.7 | 1221 | — | 77 / 0 / 173 | 250 / 250 | 94 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1b3c52da51dfbdd4 | Gemini 3.1 Flash Lite | Medium | Rated | 7.0 | 893 | — | 25 / 0 / 215 | 240 / 240 | 86 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3d6a15fe821fe6ad | Gemini 3.1 Flash Lite | Reasoning disabled | Rated | 0.8 | 802 | — | 12 / 0 / 194 | 206 / 206 | 80 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-21f7f4b363ba3adb | Gemini 3.5 Flash | Medium | Rated | 53.5 | 1590 | — | 210 / 0 / 156 | 366 / 366 | 144 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-c9fe3c158f1169e0 | Gemini 3.5 Flash | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-cda361b23deb081e | Gemini 3.5 Flash | High | Rated | 53.8 | 1595 | — | 189 / 0 / 187 | 376 / 376 | 147 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d8dbfdaa7e4f9928 | Gemini 3.5 Flash | Minimal | Rated | 32.0 | 1270 | — | 113 / 0 / 159 | 272 / 272 | 112 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-455ee67905f5f955 | Gemini 3.5 Flash Lite | Minimal | Rated | 51.5 | 1558 | — | 265 / 0 / 229 | 494 / 494 | 152 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c4d27e5c752afb39 | Gemini 3.5 Flash Lite | High | Rated | 40.2 | 1387 | — | 209 / 0 / 281 | 490 / 490 | 150 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e2e240babaf0b862 | Gemini 3.5 Flash Lite | Minimal | Rated | 58.1 | 1659 | — | 273 / 0 / 119 | 392 / 392 | 135 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f74134262b66367b | Gemini 3.5 Flash Lite | Medium | Rated | 27.6 | 1198 | — | 109 / 0 / 303 | 412 / 412 | 129 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f746ec3aee7874b2 | Gemini 3.5 Flash Lite | High | Rated | 46.2 | 1479 | — | 226 / 0 / 199 | 425 / 425 | 134 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-1f7519ff2c4a840c | Gemini 3.6 Flash | Medium | Rated | 47.9 | 1503 | — | 281 / 0 / 217 | 498 / 498 | 151 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-65c6c8e09fe2c210 | Gemini 3.6 Flash | Medium | Rated | 35.1 | 1316 | — | 125 / 0 / 153 | 278 / 278 | 102 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-8e9b51be911dad38 | Gemini 3.6 Flash | Minimal | Rated | 39.1 | 1372 | — | 178 / 0 / 235 | 413 / 417 | 129 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-a2d90fcdc2f4ef9d | Gemini 3.6 Flash | Minimal | Rated | 59.0 | 1672 | — | 288 / 0 / 186 | 474 / 474 | 160 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-f6ecc1626f38fa34 | Gemini 3.6 Flash | High | Rated | 51.3 | 1554 | — | 251 / 0 / 243 | 494 / 494 | 152 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-9e9800f8ff5f268a | Gemini 3.8 Flash | Low | Rated | 37.6 | 1354 | — | 128 / 0 / 156 | 284 / 284 | 110 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-c7c380c645d84feb | Gemini 3.8 Flash | High | Rated | 61.5 | 1716 | — | 169 / 0 / 101 | 270 / 270 | 118 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e66473ecb3a5bf58 | Gemini 3.8 Flash | Medium | Rated | 54.4 | 1605 | — | 203 / 0 / 167 | 370 / 370 | 149 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-3f820f7e8ff15839 | Gemma 4 31B | Reasoning disabled | Rated | 13.6 | 994 | — | 44 / 0 / 192 | 236 / 238 | 83 | 0 | 2 / 1 | Repaired · 2026-07-02 |
| E-f417d302c870dfa6 | Gemma 4 31B | Reasoning enabled | Rated | 29.8 | 1236 | — | 97 / 0 / 169 | 266 / 266 | 95 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-fcfa606d3cbb0ba0 | GPT 4.1 | None | Rated | 48.7 | 1522 | — | 135 / 0 / 121 | 256 / 256 | 96 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-15dad0db253c0497 | GPT 5 | High | Rated | 58.8 | 1675 | — | 145 / 0 / 93 | 238 / 238 | 89 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-4d8b4cfcff519db6 | GPT 5 | Medium | Rated | 60.1 | 1695 | — | 173 / 0 / 77 | 250 / 250 | 90 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-a67f59519ca31035 | GPT 5 | Low | Waiting | — | — | — | 0 / 0 / 0 | 0 / 0 | 0 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-1d11cba509a3ee65 | GPT-5.4 | Medium | Rated | 36.1 | 1327 | — | 156 / 0 / 232 | 388 / 388 | 132 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-323834608cbfa7f4 | GPT-5.4 | None | Rated | 34.9 | 1308 | — | 145 / 0 / 283 | 428 / 428 | 146 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-9bc57dfe55b73887 | GPT-5.4 | XHigh | Rated | 76.8 | 1943 | — | 286 / 0 / 64 | 350 / 350 | 119 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-c2ab31787514c10c | GPT-5.4 Mini | None | Rated | 0.0 | 787 | — | 20 / 0 / 230 | 250 / 252 | 89 | 0 | 2 / 1 | First try · 2026-07-02 |
| E-f4d7ac8a0f5d2974 | GPT-5.4 Mini | Medium | Rated | 49.9 | 1540 | — | 139 / 0 / 123 | 262 / 262 | 93 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-4e14ae758717169e | GPT-5.4 Nano | None | Rated | 20.9 | 1102 | — | 69 / 0 / 195 | 264 / 264 | 89 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-bea6d7d9558897f9 | GPT-5.4 Nano | Medium | Rated | 10.7 | 949 | — | 28 / 0 / 222 | 250 / 250 | 93 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ce04fd14b6f43868 | GPT-5.4 Nano | Medium | Rated | 54.8 | 1614 | — | 162 / 0 / 90 | 252 / 252 | 90 | 0 | 0 / 1 | Repaired · 2026-07-09 |
| E-4edfe4117ad3e936 | GPT-5.5 | None | Rated | 42.9 | 1435 | — | 127 / 0 / 137 | 264 / 264 | 92 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-6201278165db862a | GPT-5.5 | XHigh | Rated | 83.9 | 2054 | — | 215 / 0 / 27 | 242 / 242 | 84 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-640b3078b8bce40e | GPT-5.5 | Medium | Rated | 60.9 | 1707 | — | 171 / 0 / 69 | 240 / 240 | 88 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-8fd5624103eac132 | GPT-5.6 Luna | None | Rated | 20.4 | 1091 | — | 62 / 0 / 284 | 346 / 346 | 112 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-af6cc32d5ba04b84 | GPT-5.6 Luna | Medium | Rated | 30.1 | 1238 | — | 118 / 0 / 234 | 352 / 352 | 118 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-d86d2f05318f688d | GPT-5.6 Luna | XHigh | Rated | 62.9 | 1734 | — | 238 / 0 / 110 | 348 / 348 | 120 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-475950cead6d8909 | GPT-5.6 Sol | XHigh | Rated | 89.0 | 2128 | — | 318 / 0 / 30 | 348 / 348 | 117 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-6e22708296e06d4c | GPT-5.6 Sol | Medium | Rated | 67.6 | 1803 | — | 276 / 0 / 100 | 376 / 376 | 121 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-e65ec062f67d1b0b | GPT-5.6 Sol | None | Rated | 37.7 | 1350 | — | 214 / 0 / 229 | 443 / 443 | 142 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-077c22ee9e6723ba | GPT-5.6 Terra | Medium | Rated | 55.6 | 1625 | — | 151 / 0 / 123 | 274 / 274 | 115 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-0ecc49660e523ed2 | GPT-5.6 Terra | None | Rated | 32.7 | 1277 | — | 105 / 0 / 225 | 330 / 330 | 133 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-f491169fb177b486 | GPT-5.6 Terra | XHigh | Rated | 40.2 | 1389 | — | 154 / 0 / 220 | 374 / 374 | 147 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-1c9e1c5642cb9d00 | GPT-6 Astra | Medium | Rated | 94.6 | 2214 | — | 275 / 0 / 9 | 284 / 284 | 111 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-9ffb18636ed1a05f | GPT-6 Astra | XHigh | Rated | 100.0 | 2297 | — | 254 / 0 / 4 | 258 / 258 | 109 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-b0b6ad65edfb8663 | GPT-6 Astra | Low | Rated | 97.3 | 2256 | — | 249 / 0 / 9 | 258 / 258 | 107 | 0 | 0 / 1 | First try · 2026-09-05 |
| E-dfa07d7cdab5a625 | GPT-6 Luna | Medium | Rated | 41.9 | 1434 | — | 43 / 0 / 59 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-eb7f81959575bd3a | GPT-6 Luna | XHigh | Rated | 34.8 | 1328 | — | 36 / 0 / 66 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-048f1ff6d205f4c2 | GPT-6 Sol | XHigh | Rated | 82.4 | 2044 | — | 101 / 0 / 9 | 110 / 110 | 55 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-449cab4d6e898879 | GPT-6 Sol | Medium | Rated | 78.9 | 1993 | — | 94 / 0 / 8 | 102 / 102 | 51 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-f29d6a1e9fd79899 | GPT-6 Sol | None | Rated | 58.8 | 1688 | — | 67 / 0 / 41 | 108 / 108 | 54 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-a43d69932f868335 | Granite 4.2 8B | Low | Rated | 1.1 | 803 | — | 12 / 0 / 268 | 280 / 280 | 117 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-32b0c3a60cdb2d36 | Mercury 2.5 Preview | Medium | Rated | 11.0 | 951 | — | 33 / 0 / 243 | 276 / 276 | 120 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-4cecf0348e9700f9 | Mercury 2.5 Preview | High | Rated | 15.2 | 1015 | — | 42 / 0 / 254 | 296 / 296 | 112 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-57b2b1d3b488c246 | Ling 3.0 Flash | Enabled | Rated | 42.1 | 1460 | — | 18 / 0 / 22 | 40 / 40 | 20 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-5e20a850f6c14680 | Ling 3.0 Flash | Enabled | Rated | 39.2 | 1415 | — | 16 / 0 / 26 | 42 / 42 | 21 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-28ec7bff448d69bb | LongCat 2.0 | Enabled | Rated | 60.8 | 1699 | — | 259 / 0 / 189 | 448 / 448 | 139 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-c1f595f47c71e648 | LongCat 2.0 | None | Rated | 29.5 | 1233 | — | 104 / 0 / 158 | 262 / 262 | 92 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e2db910734ca5315 | LongCat 2.0 | None | Rated | 38.7 | 1371 | — | 114 / 0 / 148 | 262 / 262 | 93 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-fe21773d3155f05f | LongCat 2.0 | Enabled | Rated | 14.1 | 995 | — | 68 / 0 / 342 | 410 / 410 | 128 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-1e5c2765e3922f41 | Muse Glimmer 30B | Low | Rated | 30.0 | 1239 | — | 91 / 0 / 177 | 268 / 268 | 109 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-44f620cd174850cd | Muse Glimmer 30B | Medium | Rated | 33.5 | 1292 | — | 116 / 0 / 142 | 258 / 258 | 114 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-fcdfc824ca826907 | Muse Glimmer 30B | XHigh | Rated | 44.2 | 1451 | — | 170 / 0 / 154 | 324 / 324 | 128 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-5618329845b079c7 | Muse Spark 1.2 | Minimal | Rated | 35.2 | 1314 | — | 146 / 0 / 240 | 386 / 386 | 121 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-ab39e2e398a78370 | Muse Spark 1.2 | Medium | Rated | 58.7 | 1669 | — | 230 / 0 / 148 | 378 / 378 | 126 | 0 | 0 / 1 | First try · 2026-08-13 |
| E-833926f12799d49b | Muse Spark 1.3 | XHigh | Rated | 54.7 | 1613 | — | 134 / 0 / 138 | 272 / 272 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-ace3dab8a493f0f2 | Muse Spark 1.3 | Minimal | Rated | 37.4 | 1352 | — | 127 / 0 / 139 | 266 / 266 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-b9e475125cfdede0 | Muse Spark 1.3 | Medium | Rated | 50.9 | 1553 | — | 176 / 0 / 156 | 332 / 332 | 136 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-24e15c4d7490cdf3 | Minimax M3 | Reasoning disabled | Rated | 28.6 | 1219 | — | 83 / 0 / 167 | 250 / 250 | 88 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-4547f4cedca403f9 | Minimax M3 | Reasoning enabled | Rated | 41.7 | 1416 | — | 133 / 0 / 125 | 258 / 258 | 103 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0ac5b4d4b9c9e739 | Mistral Medium 3.5 | High | Rated | 16.0 | 1026 | — | 42 / 0 / 252 | 294 / 294 | 114 | 0 | 0 / 1 | First try · 2026-09-08 |
| E-d35e87ebfc251f60 | Kimi K2.7 Code | Reasoning enabled | Rated | 41.7 | 1416 | — | 134 / 0 / 112 | 246 / 246 | 94 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-1d1372c78963efdf | Kimi K3 | Max | Rated | 56.4 | 1632 | — | 269 / 0 / 199 | 468 / 468 | 143 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-4d8815930b656774 | Kimi K3 | Low | Rated | 30.3 | 1239 | — | 146 / 0 / 276 | 422 / 422 | 132 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-55ef4536a723bcf7 | Kimi K3 | High | Rated | 31.7 | 1261 | — | 128 / 0 / 290 | 418 / 418 | 134 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-1006c453b0c3a745 | Nex N2 Pro | Reasoning disabled | Rated | 64.4 | 1759 | — | 188 / 0 / 82 | 270 / 270 | 99 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-d1f432cda667f27f | Nex N2 Pro | Reasoning enabled | Rated | 30.3 | 1243 | — | 100 / 0 / 164 | 264 / 264 | 102 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0e1c7f89e1c19b69 | Nemotron 3 Ultra 550B A55B | Reasoning disabled | Rated | 4.9 | 863 | — | 21 / 0 / 197 | 218 / 218 | 80 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-459f395cc0af6d2e | Nemotron 3 Ultra 550B A55B | Medium | Rated | 5.8 | 875 | — | 32 / 0 / 218 | 250 / 250 | 95 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-43c337fb7f5e535e | O3 | High | Rated | 39.8 | 1381 | — | 220 / 0 / 273 | 493 / 493 | 155 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-541cee4461c65fcb | O3 | High | Rated | 45.6 | 1468 | — | 230 / 0 / 289 | 519 / 519 | 153 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-585aa996c86c4b8a | O3 | Low | Rated | 40.1 | 1388 | — | 206 / 0 / 212 | 418 / 418 | 135 | 0 | 0 / 1 | First try · 2026-07-21 |
| E-bc20ac8102f6a0ac | O3 | High | Rated | 48.7 | 1516 | — | 265 / 0 / 221 | 486 / 486 | 145 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ee95d01578313864 | O3 | High | Rated | 32.9 | 1279 | — | 142 / 0 / 248 | 390 / 390 | 124 | 0 | 0 / 1 | First try · 2026-07-03 |
| E-f1e3e54a3d40556f | O3 | Medium | Rated | 53.0 | 1587 | — | 155 / 0 / 95 | 250 / 250 | 93 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-934c8c0b2bc944ae | GPT-OSS 120B | High | Rated | 35.3 | 1320 | — | 105 / 0 / 153 | 258 / 258 | 110 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-d37e968ece440a95 | GPT-OSS 120B | Medium | Rated | 27.0 | 1194 | — | 71 / 0 / 197 | 268 / 268 | 112 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-e2cfc5a5ad142b93 | GPT-OSS 120B | Low | Rated | 33.7 | 1295 | — | 92 / 0 / 172 | 264 / 264 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-069a963abdd14cdf | Laguna S 2.1 | None | Rated | 36.8 | 1342 | — | 95 / 0 / 175 | 270 / 278 | 88 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-d8e68d23876f6d21 | Laguna S 2.1 | None | Rated | 51.6 | 1567 | — | 132 / 0 / 110 | 242 / 242 | 88 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-3142a09c7f192060 | Qwen3.7 Max | Reasoning disabled | Rated | 54.5 | 1611 | — | 139 / 0 / 89 | 228 / 228 | 87 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-59c7745eb1e91d63 | Qwen3.7 Max | Reasoning enabled | Rated | 72.6 | 1884 | — | 201 / 0 / 37 | 238 / 238 | 92 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-737a66790985a5e6 | Qwen3.7 Plus | Reasoning disabled | Rated | 12.3 | 973 | — | 38 / 0 / 208 | 246 / 248 | 91 | 0 | 2 / 1 | First try · 2026-07-02 |
| E-9d091700cb41ece2 | Qwen3.7 Plus | Reasoning enabled | Rated | 24.1 | 1150 | — | 91 / 0 / 189 | 280 / 280 | 97 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0a161c1b04471509 | Qwen3.8 2.4t A95B | XHigh | Rated | 58.8 | 1675 | — | 151 / 0 / 111 | 262 / 262 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-13e63167e0d5d7c1 | Qwen3.8 2.4t A95B | Medium | Rated | 35.4 | 1320 | — | 126 / 0 / 160 | 286 / 286 | 118 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-94737892dd300c16 | Qwen3.8 2.4t A95B | Low | Rated | 49.1 | 1527 | — | 144 / 0 / 152 | 296 / 296 | 115 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-55687a3836f99d66 | Qwen3.8 27B | Medium | Rated | 26.3 | 1181 | — | 71 / 0 / 237 | 308 / 308 | 125 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-faf5ede52429a9f3 | Qwen3.8 27B | XHigh | Rated | 74.8 | 1914 | — | 233 / 0 / 79 | 312 / 312 | 123 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-29343ee320031e4c | Qwen3.8 Flash | Reasoning disabled | Rated | 16.8 | 1039 | — | 29 / 0 / 247 | 276 / 276 | 118 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-ac36222e88488a0c | Qwen3.8 Flash | Reasoning enabled | Rated | 69.7 | 1838 | — | 202 / 0 / 78 | 280 / 280 | 111 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-1c3cd7cd7b39b7ff | Qwen3.8 Max | XHigh | Rated | 68.1 | 1814 | — | 202 / 0 / 70 | 272 / 272 | 112 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-1f83b2062e021657 | Qwen3.8 Max | Medium | Rated | 37.7 | 1353 | — | 139 / 0 / 169 | 308 / 308 | 126 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-9060604c6d76c81b | Qwen3.8 Max | Minimal | Rated | 61.9 | 1721 | — | 181 / 0 / 98 | 279 / 279 | 121 | 0 | 0 / 1 | First try · 2026-08-08 |
| E-d5edcd864876a906 | Qwen3.8 Max 0902 | Low | Rated | 38.0 | 1376 | — | 36 / 0 / 64 | 100 / 100 | 50 | 0 | 0 / 1 | First try · 2026-09-18 |
| E-e35b74a70fc7cfab | Qwen3.8 Max 0902 | Medium | Rated | 43.4 | 1458 | — | 47 / 0 / 49 | 96 / 96 | 48 | 0 | 0 / 1 | Repaired · 2026-09-18 |
| E-27243ca72bb71e47 | Ox Alpha | Max | Rated | 66.5 | 1790 | — | 176 / 0 / 88 | 264 / 264 | 110 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-6160aff1d9ab7bd7 | Ox Alpha | Max | Rated | 60.4 | 1696 | — | 182 / 0 / 120 | 302 / 302 | 119 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-90df0bc1145d0335 | Ox Alpha | High | Rated | 14.1 | 1000 | — | 39 / 0 / 215 | 254 / 254 | 110 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-9cc97e533afb41b3 | Ox Alpha | High | Rated | 45.1 | 1465 | — | 172 / 0 / 180 | 352 / 352 | 143 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-9f68949b5725fa77 | Ox Alpha | Max | Rated | 51.6 | 1562 | — | 199 / 0 / 143 | 342 / 342 | 142 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-ae808d1219edf709 | Ox Alpha | High | Rated | 68.1 | 1815 | — | 185 / 0 / 81 | 266 / 266 | 117 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-b7e03d205460428f | Ox Alpha | Low | Rated | 46.7 | 1489 | — | 192 / 0 / 172 | 364 / 364 | 152 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-c2beebe255c607a1 | Ox Alpha | Low | Rated | 42.8 | 1429 | — | 150 / 0 / 198 | 348 / 348 | 137 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-f9e2fbd96bb7a98d | Ox Alpha | Low | Rated | 21.8 | 1115 | — | 54 / 0 / 204 | 258 / 258 | 114 | 0 | 0 / 1 | First try · 2026-08-22 |
| E-1140a7c92290e8f4 | Step 3.7 Flash | Low | Rated | 34.1 | 1297 | — | 159 / 0 / 267 | 426 / 426 | 135 | 0 | 0 / 1 | Repaired · 2026-07-21 |
| E-6a5e44fe2dde4257 | Step 3.7 Flash | High | Rated | 25.8 | 1177 | — | 83 / 0 / 164 | 247 / 247 | 86 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-dfed1e345a939bcd | Hy3 Preview | High | Rated | 30.3 | 1245 | — | 91 / 0 / 165 | 256 / 256 | 94 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-55bc56c312ae43e5 | Hy4 Preview | Low | Rated | 71.8 | 1870 | — | 199 / 0 / 67 | 266 / 266 | 117 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-f7db79dd98016d9f | Hy4 Preview | High | Rated | 65.2 | 1770 | — | 177 / 0 / 115 | 292 / 292 | 118 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-f87e4646281a40c4 | Hy4 Preview | None | Rated | 43.9 | 1448 | — | 134 / 0 / 146 | 280 / 280 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-062d41f517db2ccb | Inkling | None | Rated | 26.5 | 1187 | — | 81 / 0 / 171 | 252 / 252 | 90 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-38e756fc6f3a2db6 | Inkling | Max | Rated | 35.6 | 1319 | — | 134 / 0 / 270 | 404 / 404 | 123 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-b9ceec0ad4a1b9a4 | Inkling | Medium | Rated | 12.9 | 976 | — | 57 / 0 / 349 | 406 / 406 | 135 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-516d381904063142 | Inkling Small | Max | Rated | 22.5 | 1125 | — | 64 / 0 / 216 | 280 / 280 | 116 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-b205e1d25c695262 | Inkling Small | Medium | Rated | 57.1 | 1645 | — | 214 / 0 / 163 | 377 / 377 | 146 | 0 | 0 / 1 | First try · 2026-08-09 |
| E-f330739aca81e515 | Inkling Small | None | Rated | 35.2 | 1318 | — | 101 / 0 / 169 | 270 / 270 | 111 | 0 | 0 / 1 | Repaired · 2026-08-09 |
| E-1d206565b78f3121 | Grok 4.5 | Low | Rated | 66.5 | 1786 | — | 267 / 0 / 133 | 400 / 400 | 130 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-436a3933a93e10cd | Grok 4.5 | High | Rated | 51.6 | 1560 | — | 281 / 0 / 201 | 482 / 482 | 153 | 0 | 0 / 1 | First try · 2026-07-24 |
| E-e58f3df122cf1d29 | Grok 4.5 | Medium | Rated | 54.5 | 1609 | — | 159 / 0 / 111 | 270 / 270 | 97 | 0 | 0 / 1 | Repaired · 2026-07-24 |
| E-55ef73bd85619fe0 | Grok 4.6 | Low | Rated | 50.2 | 1541 | — | 201 / 0 / 155 | 356 / 356 | 147 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-a765b7f55ef25e5d | Grok 4.6 | Medium | Rated | 70.1 | 1844 | — | 183 / 0 / 81 | 264 / 264 | 105 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-b8f3c0df5873cbbb | Grok 4.6 | XHigh | Rated | 72.1 | 1875 | — | 189 / 0 / 77 | 266 / 266 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-19d4a323b3c240fb | Grok 4.7 | Low | Rated | 46.3 | 1500 | — | 52 / 0 / 54 | 106 / 106 | 53 | 0 | 0 / 1 | First try · 2026-09-23 |
| E-33e26f6dafa2dadf | Grok 4.7 | Medium | Rated | 63.7 | 1761 | — | 81 / 0 / 37 | 118 / 118 | 59 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-bfa606ba6893e488 | Grok 4.7 | XHigh | Rated | 60.2 | 1709 | — | 75 / 0 / 31 | 106 / 106 | 53 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-37ae0129627ee16f | Grok Build 0.1 | Reasoning enabled | Rated | 12.8 | 980 | — | 57 / 0 / 209 | 266 / 266 | 93 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-0984b025e9005f5b | MiMo-V2.5 | Reasoning disabled | Rated | 20.1 | 1092 | — | 51 / 0 / 187 | 238 / 240 | 83 | 0 | 2 / 1 | Repaired · 2026-07-02 |
| E-345a5b25cbac7f3b | MiMo-V2.5 | Reasoning enabled | Rated | 35.3 | 1322 | — | 110 / 0 / 114 | 224 / 224 | 85 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-47d67dcf0077af42 | MiMo-V2.5 | Reasoning disabled | Rated | 28.7 | 1221 | — | 93 / 0 / 149 | 242 / 242 | 92 | 0 | 0 / 1 | First try · 2026-07-01 |
| E-fa1a93f7e4d57000 | MiMo-V2.5 | Reasoning enabled | Rated | 23.6 | 1142 | — | 79 / 0 / 183 | 262 / 262 | 94 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-3b160130ae038271 | MiMo-V2.5-Pro | Reasoning enabled | Rated | 42.7 | 1430 | — | 131 / 0 / 175 | 306 / 306 | 107 | 0 | 0 / 1 | Repaired · 2026-07-02 |
| E-83580d03385c6759 | MiMo-V2.5-Pro | Reasoning disabled | Rated | 50.1 | 1543 | — | 147 / 0 / 111 | 258 / 258 | 94 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-37462673d97ef3c6 | MiMo-V2.6-Flash | Reasoning disabled | Rated | 36.2 | 1348 | — | 33 / 0 / 69 | 102 / 102 | 51 | 0 | 0 / 1 | Repaired · 2026-09-22 |
| E-d9a02e3bb8416b51 | MiMo-V2.6-Flash | Reasoning enabled | Rated | 74.8 | 1932 | — | 81 / 0 / 11 | 92 / 92 | 46 | 0 | 0 / 1 | Repaired · 2026-09-22 |
| E-309b8bc91c65d8bc | MiMo-V2.6-Pro | Reasoning disabled | Rated | 38.6 | 1382 | — | 39 / 0 / 71 | 110 / 110 | 55 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-18e6e39a99f6058d | GLM-5.2 | XHigh | Rated | 8.1 | 909 | — | 26 / 0 / 240 | 266 / 266 | 110 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-4ea6264964c9eeb6 | GLM-5.2 | Reasoning disabled | Rated | 43.7 | 1442 | — | 161 / 0 / 193 | 354 / 354 | 150 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-62e8714f035ebc68 | GLM-5.2 | Reasoning disabled | Rated | 36.1 | 1334 | — | 90 / 0 / 124 | 214 / 214 | 80 | 0 | 0 / 1 | First try · 2026-07-11 |
| E-855647aaa971ea4a | GLM-5.2 | High | Rated | 64.6 | 1762 | — | 180 / 0 / 108 | 288 / 288 | 110 | 0 | 0 / 1 | Repaired · 2026-09-03 |
| E-e31f275ab7ef3741 | GLM-5.2 | Reasoning disabled | Rated | 61.6 | 1719 | — | 145 / 0 / 87 | 232 / 232 | 82 | 0 | 0 / 1 | First try · 2026-07-02 |
| E-ecd98326faa92bf4 | GLM-5.2 | High | Rated | 53.5 | 1596 | — | 134 / 0 / 106 | 240 / 240 | 80 | 0 | 0 / 1 | Repaired · 2026-07-11 |
| E-5d6be4341ce01a85 | GLM 5.3 | Low | Rated | 66.2 | 1786 | — | 169 / 0 / 97 | 266 / 266 | 113 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-c240edae88653415 | GLM 5.3 | High | Rated | 65.7 | 1778 | — | 187 / 0 / 81 | 268 / 268 | 114 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-ef6bbdccb496549e | GLM 5.3 | Max | Rated | 97.7 | 2262 | — | 253 / 0 / 11 | 264 / 264 | 107 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-24b8664a972a5512 | GLM 5.3 Flash | High | Rated | 68.8 | 1826 | — | 179 / 0 / 77 | 256 / 256 | 109 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-25f867d9979801d1 | GLM 5.3 Flash | Low | Rated | 63.5 | 1745 | — | 169 / 0 / 95 | 264 / 264 | 116 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-71da5bd8b2ec7159 | GLM 5.3 Flash | Max | Rated | 65.3 | 1771 | — | 189 / 0 / 95 | 284 / 284 | 108 | 0 | 0 / 1 | First try · 2026-09-03 |
| E-29e2e5977382553b | GLM-5.3 FlashX | Low | Rated | 56.5 | 1653 | — | 69 / 0 / 39 | 108 / 108 | 54 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-cb4bde665ff99fb3 | GLM-5.3 FlashX | Max | Rated | 69.7 | 1854 | — | 73 / 0 / 25 | 98 / 98 | 49 | 0 | 0 / 1 | First try · 2026-09-22 |
| E-f7edc334185c1f35 | GLM-5.3 FlashX | High | Rated | 51.3 | 1577 | — | 60 / 0 / 40 | 100 / 100 | 50 | 0 | 0 / 1 | Repaired · 2026-09-22 |