difficulty
expert
runs
84
evaluated
73
success rate
77.4%
mean time
6 m 45 s
input tokens
25,893,159
generated tokens
832,299
tokens
26,725,458
tool calls
1,391
Experiments this subject took part in
| experiment | title | type | runs | evaluated | passed | success rate | mean time | input tokens | generated tokens | total tokens | tool calls |
|---|---|---|---|---|---|---|---|---|---|---|---|
| router-config-comparison@1.0.0 | Router models versus Auto Codex, with and without knowledge | configuration | 84 | 73 | 65 | 77.4% | 6 m 45 s | 25,893,159 | 832,299 | 26,725,458 | 1,391 |
Tasks this subject worked
| task | category | difficulty | runs | passed | success rate | mean time | input tokens | generated tokens | total tokens | tool calls |
|---|---|---|---|---|---|---|---|---|---|---|
| bookshop-stock-002@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 4 m 5 s | 1,966,139 | 52,114 | 2,018,253 | 160 |
| cadence-catchup-001@1.0.0 | new_feature | expert | 12 | 1 | 8.3% | 14 m 26 s | 9,168,585 | 308,855 | 9,477,440 | 335 |
| cadence-takeover-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 3 m 60 s | 2,182,492 | 53,408 | 2,235,900 | 169 |
| freight-shop-001@1.0.0 | new_feature | expert | 12 | 4 | 33.3% | 11 m 12 s | 6,169,405 | 237,688 | 6,407,093 | 262 |
| ledgerlite-rates-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 4 m 1 s | 2,088,806 | 58,729 | 2,147,535 | 157 |
| notes-sync-001@1.0.0 | new_feature | expert | 12 | 12 | 100.0% | 5 m 50 s | 1,971,921 | 74,178 | 2,046,099 | 152 |
| stockpile-writeoff-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 3 m 40 s | 2,345,811 | 47,327 | 2,393,138 | 156 |
Runs
in the order they started; the parameters column is the configuration each run was executed under
| run | parameters | started | task | agent | repetition | status | verdict | score | time | input tokens | generated tokens | total tokens | tool calls | failure class | error |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| run-20261102-015302-e1907b59 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 01:53:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 59 s | 139,513 | 3,865 | 143,378 | 13 | ||
| run-20261102-015702-033aab98 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 01:57:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 59 s | 110,185 | 2,205 | 112,390 | 10 | ||
| run-20261102-020002-c8680ac1 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 02:00:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 1 s | 118,277 | 2,192 | 120,469 | 9 | ||
| run-20261102-020305-819a6a56 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:03:05 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 6 m 16 s | 254,599 | 10,261 | 264,860 | 20 | ||
| run-20261102-020922-c802a0ee | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:09:22 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 56 s | 164,309 | 4,902 | 169,211 | 14 | ||
| run-20261102-021319-f8645ceb | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:13:19 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 8 s | 223,668 | 7,523 | 231,191 | 17 | ||
| run-20261102-021828-a3b13607 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:18:28 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 4 m 46 s | 241,297 | 4,789 | 246,086 | 17 | ||
| run-20261102-022315-259a16a5 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:23:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 59 s | 128,251 | 3,787 | 132,038 | 11 | ||
| run-20261102-022715-0f5b5375 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:27:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 27 s | 173,650 | 3,854 | 177,504 | 15 | ||
| run-20261102-023143-af17689a | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:31:43 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 31 s | 124,678 | 3,136 | 127,814 | 10 | ||
| run-20261102-023515-f1dff616 | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:35:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 57 s | 107,513 | 2,363 | 109,876 | 11 | ||
| run-20261102-023813-b7d6ced3 | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:38:13 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 58 s | 180,199 | 3,237 | 183,436 | 13 | ||
| run-20261102-065152-be03d69a | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 06:51:52 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 32 s | 68,691 | 2,284 | 70,975 | 7 | ||
| run-20261102-065424-0122485b | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 06:54:24 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 58 s | 147,528 | 3,954 | 151,482 | 13 | ||
| run-20261102-065823-56d0518e | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 06:58:23 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 1 s | 144,209 | 3,841 | 148,050 | 12 | ||
| run-20261102-070225-983f28a4 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 07:02:25 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 26 s | 113,987 | 7,555 | 121,542 | 10 | ||
| run-20261102-070752-ee5e374f | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 07:07:52 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 7 m 42 s | 297,815 | 11,995 | 309,810 | 18 | ||
| run-20261102-071535-a34798d9 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 07:15:35 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 6 m 19 s | 194,746 | 9,719 | 204,465 | 13 | ||
| run-20261102-072154-ce0a96c9 | knowledge_enabled=False, model=auto_codex | 2026-11-02 07:21:54 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 9 m 24 s | 292,586 | 6,876 | 299,462 | 21 | ||
| run-20261102-073119-046c63c5 | knowledge_enabled=False, model=auto_codex | 2026-11-02 07:31:19 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 9 m 54 s | 186,195 | 7,893 | 194,088 | 14 | ||
| run-20261102-074114-fb309dd3 | knowledge_enabled=False, model=auto_codex | 2026-11-02 07:41:14 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 22 s | 139,453 | 4,875 | 144,328 | 11 | ||
| run-20261102-074537-1abe2bd8 | knowledge_enabled=True, model=auto_codex | 2026-11-02 07:45:37 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 7 m 49 s | 168,258 | 6,167 | 174,425 | 12 | ||
| run-20261102-075327-d3b09ae5 | knowledge_enabled=True, model=auto_codex | 2026-11-02 07:53:27 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 4 m 8 s | 92,335 | 4,290 | 96,625 | 11 | ||
| run-20261102-075736-7dc8b5fa | knowledge_enabled=True, model=auto_codex | 2026-11-02 07:57:36 | notes-sync-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 27 s | 126,118 | 4,729 | 130,847 | 10 | ||
| run-20261102-102224-77a554a3 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:22:24 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 25 s | 87,441 | 2,062 | 89,503 | 9 | ||
| run-20261102-102450-4c4dafd8 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:24:50 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 56 s | 184,037 | 3,928 | 187,965 | 13 | ||
| run-20261102-102846-f9da52d1 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:28:46 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 53 s | 166,105 | 2,393 | 168,498 | 14 | ||
| run-20261102-103139-c174189b | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:31:39 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 20 s | 142,081 | 4,157 | 146,238 | 13 | ||
| run-20261102-103500-42595b9b | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:35:00 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 6 s | 136,190 | 4,248 | 140,438 | 12 | ||
| run-20261102-103806-ca54befb | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:38:06 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 43 s | 176,874 | 4,786 | 181,660 | 14 | ||
| run-20261102-104150-ee470964 | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:41:50 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 36 s | 184,263 | 2,829 | 187,092 | 15 | ||
| run-20261102-104527-df556abc | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:45:27 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 5 m 33 s | 231,250 | 6,615 | 237,865 | 16 | ||
| run-20261102-105101-7f0ea089 | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:51:01 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 31 s | 81,756 | 1,513 | 83,269 | 9 | ||
| run-20261102-105332-509d420c | knowledge_enabled=True, model=auto_codex | 2026-11-02 10:53:32 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 51 s | 181,892 | 10,799 | 192,691 | 15 | ||
| run-20261102-105924-5844ec5c | knowledge_enabled=True, model=auto_codex | 2026-11-02 10:59:24 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 7 m 45 s | 486,023 | 7,446 | 493,469 | 26 | ||
| run-20261102-110711-12e9e01e | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:07:11 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 18 s | 124,580 | 2,632 | 127,212 | 13 | ||
| run-20261102-111029-a9c04726 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:10:29 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 57 s | 118,837 | 2,616 | 121,453 | 12 | ||
| run-20261102-111326-3c584bd3 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:13:26 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 10 s | 81,280 | 1,903 | 83,183 | 7 | ||
| run-20261102-111537-b9ab2fef | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:15:37 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 1 s | 130,324 | 2,843 | 133,167 | 12 | ||
| run-20261102-111839-c5f2e4c1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:18:39 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 4 m 26 s | 197,743 | 6,744 | 204,487 | 15 | ||
| run-20261102-112306-6bc27784 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:23:06 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 6 m 46 s | 359,678 | 11,459 | 371,137 | 20 | ||
| run-20261102-112953-68b1af75 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:29:53 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 12 s | 266,657 | 7,835 | 274,492 | 19 | ||
| run-20261102-113507-5543ffe1 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:35:07 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 6 m 49 s | 273,433 | 8,650 | 282,083 | 17 | ||
| run-20261102-114156-1ff0ba59 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:41:56 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 49 s | 97,473 | 2,294 | 99,767 | 9 | ||
| run-20261102-114446-b3513377 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:44:46 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 5 s | 137,674 | 3,039 | 140,713 | 10 | ||
| run-20261102-114752-9f3f4f92 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:47:52 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 59 s | 109,708 | 3,384 | 113,092 | 10 | ||
| run-20261102-115051-39be5247 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:50:51 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 5 m 19 s | 233,226 | 5,848 | 239,074 | 16 | ||
| run-20261102-115611-ee478152 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:56:11 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 39 s | 82,773 | 2,114 | 84,887 | 10 | ||
| run-20261102-115850-e5f2348f | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:58:50 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 30 s | 174,833 | 3,032 | 177,865 | 12 | ||
| run-20261102-120221-58de15af | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:02:21 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 13 s | 131,934 | 1,632 | 133,566 | 10 | ||
| run-20261102-120435-e4b44447 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:04:35 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 1 m 40 s | 86,407 | 948 | 87,355 | 7 | ||
| run-20261102-120616-d577d4b1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:06:16 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 15 s | 256,446 | 8,216 | 264,662 | 16 | ||
| run-20261102-121131-13e4a8b5 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:11:31 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 55 s | 216,253 | 5,255 | 221,508 | 12 | ||
| run-20261102-121528-03d9f220 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:15:28 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 26 s | 293,346 | 8,697 | 302,043 | 17 | ||
| run-20261102-122054-f8985461 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:20:54 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 3 s | 130,716 | 3,022 | 133,738 | 10 | ||
| run-20261102-122358-fec2acfe | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:23:58 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 4 m 57 s | 284,384 | 4,090 | 288,474 | 16 | ||
| run-20261102-122856-43bd96e6 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:28:56 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 56 s | 290,116 | 5,054 | 295,170 | 18 | ||
| run-20261102-123353-08bae5f2 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:33:53 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 28 s | 174,055 | 3,204 | 177,259 | 12 | ||
| run-20261102-123722-abf5b6a0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:37:22 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 50 s | 159,452 | 1,673 | 161,125 | 12 | ||
| run-20261102-124013-4e335fc0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:40:13 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 48 s | 147,869 | 2,504 | 150,373 | 14 | ||
| run-20261102-124303-45bdfb12 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:43:03 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | timeout | not measured | 15 m 4 s | 1,030,274 | 21,301 | 1,051,575 | 39 | agent | Suite is green. Let me re-verify the full spec behavior with the final implementation, including a few extra edge cases I hadn't covered (staggered schedules, attempts, DST). | |
| run-20261102-125808-280ac90d | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:58:08 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | timeout | not measured | 15 m 5 s | 823,347 | 18,432 | 841,779 | 33 | agent | The implementation is complete and syntactically valid. Let me run the full test suite and my spec-based checks to confirm everything is green. | |
| run-20261102-131314-47751b92 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 13:13:14 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | timeout | not measured | 15 m 5 s | 1,793,968 | 20,171 | 1,814,139 | 53 | agent | Now let me fix my test's history times (they must match the 06:00 occurrence instants, per "at that exact logical time") and re-run. | |
| run-20261102-132819-55ee19e1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 13:28:19 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | timeout | not measured | 15 m 5 s | 949,884 | 33,200 | 983,084 | 30 | agent | The `covers` helper was wrong — history-settled occurrences belong to neither list by spec. Fixing the helper. | |
| run-20261102-134326-1f193cec | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 13:43:26 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | partial | 0.960 | 13 m 32 s | 946,332 | 28,707 | 975,039 | 30 | ||
| run-20261102-135659-dfdbb7ee | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 13:56:59 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | timeout | not measured | 15 m 5 s | 452,414 | 32,517 | 484,931 | 19 | agent | Several more of my expectations were wrong (an always-planned upstream settles its dependents, so real waits need staggered schedules). Rewriting with `(day, hour)` tuples and genuinely blocked upstreams. | |
| run-20261102-141204-1573e7b2 | knowledge_enabled=False, model=auto_codex | 2026-11-02 14:12:04 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | timeout | not measured | 15 m 4 s | 469,387 | 26,193 | 495,580 | 19 | agent | Both were again my own expectation errors — the plan output is correct in each case. Now the critical rules: `depends_on_past`, the cap, ordering, and purity. | |
| run-20261102-142710-0136dc94 | knowledge_enabled=False, model=auto_codex | 2026-11-02 14:27:10 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 11 m 32 s | 409,647 | 23,502 | 433,149 | 16 | ||
| run-20261102-143842-25bc3410 | knowledge_enabled=False, model=auto_codex | 2026-11-02 14:38:42 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | timeout | not measured | 15 m 5 s | 507,660 | 28,184 | 535,844 | 21 | agent | My assertion there forgot that `a`'s missing days are also planned and `b@1` is satisfied by history. Let me make the harness self-reporting so mismatches are diagnosable. | |
| run-20261102-145348-58a7a3f3 | knowledge_enabled=True, model=auto_codex | 2026-11-02 14:53:48 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | partial | 0.920 | 12 m 29 s | 836,667 | 23,155 | 859,822 | 30 | ||
| run-20261102-150618-18c32d85 | knowledge_enabled=True, model=auto_codex | 2026-11-02 15:06:18 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | timeout | not measured | 15 m 4 s | 543,457 | 28,631 | 572,088 | 23 | agent | The scratch script itself is buggy. Let me print actual values to debug quickly. | |
| run-20261102-152123-401b3de4 | knowledge_enabled=True, model=auto_codex | 2026-11-02 15:21:23 | cadence-catchup-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | timeout | not measured | 15 m 5 s | 405,548 | 24,862 | 430,410 | 22 | agent | Most failures are test-harness artifacts, not implementation bugs — let me fix the script (tz-aware string formatting, wrong window for the staggered case, empty `reasons()` on a fully-planned chain) and re-run. | |
| run-20261102-153629-de5ac66d | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 15:36:29 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | partial | 0.941 | 9 m 40 s | 514,930 | 12,666 | 527,596 | 25 | ||
| run-20261102-154610-09481f31 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 15:46:10 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | timeout | not measured | 15 m 3 s | 345,908 | 24,250 | 370,158 | 18 | agent | The code works correctly — my test had the wrong assumption. I forgot the default divisor is 5000, so 130×30×20 gives volumetric 15.6 kg (billed 16.0 kg), not 3.0 kg. The linehaul is 4200, surcharge 500, total 4700 — and the group logic worked perfectly: `oversize` won, `heavy` was suppressed, winner named. | |
| run-20261102-160115-cb48ab31 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 16:01:15 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | partial | 0.941 | 10 m 38 s | 402,646 | 15,902 | 418,548 | 17 | ||
| run-20261102-161153-16c04a4e | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 16:11:53 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | partial | 0.941 | 11 m 36 s | 709,380 | 23,886 | 733,266 | 25 | ||
| run-20261102-162330-279c2d0e | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 16:23:30 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 11 m 50 s | 597,870 | 25,858 | 623,728 | 24 | ||
| run-20261102-163521-b51708f9 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 16:35:21 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 12 m 16 s | 819,721 | 25,306 | 845,027 | 29 | ||
| run-20261102-164738-43ff8923 | knowledge_enabled=False, model=auto_codex | 2026-11-02 16:47:38 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | partial | 0.941 | 6 m 29 s | 254,425 | 9,577 | 264,002 | 14 | ||
| run-20261102-165407-d907f577 | knowledge_enabled=False, model=auto_codex | 2026-11-02 16:54:07 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | partial | 0.941 | 11 m 28 s | 361,986 | 19,008 | 380,994 | 17 | ||
| run-20261102-170536-da2abfe7 | knowledge_enabled=False, model=auto_codex | 2026-11-02 17:05:36 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 8 m 7 s | 389,741 | 14,953 | 404,694 | 20 | ||
| run-20261102-171345-07e43bdb | knowledge_enabled=True, model=auto_codex | 2026-11-02 17:13:45 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | timeout | not measured | 15 m 3 s | 581,220 | 26,757 | 607,977 | 24 | agent | All 19 spec checks pass. Final verification — full suite plus a review of the finished body: | |
| run-20261102-172849-b26fa228 | knowledge_enabled=True, model=auto_codex | 2026-11-02 17:28:49 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | partial | 0.941 | 10 m 30 s | 515,522 | 17,044 | 532,566 | 23 | ||
| run-20261102-173920-82f7a48c | knowledge_enabled=True, model=auto_codex | 2026-11-02 17:39:20 | freight-shop-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 11 m 43 s | 676,056 | 22,481 | 698,537 | 26 |
Not verified
Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
| kind | subject | status | run | note |
|---|---|---|---|---|
| plugin | agentic_knowledge | unsupported | run-20261102-015302-e1907b59 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-015302-e1907b59 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-015702-033aab98 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-015702-033aab98 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020002-c8680ac1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020002-c8680ac1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020305-819a6a56 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020305-819a6a56 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020922-c802a0ee | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020922-c802a0ee | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-021319-f8645ceb | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-021319-f8645ceb | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-021828-a3b13607 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-021828-a3b13607 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-022315-259a16a5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-022315-259a16a5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-022715-0f5b5375 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-022715-0f5b5375 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023143-af17689a | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023143-af17689a | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023515-f1dff616 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023515-f1dff616 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023813-b7d6ced3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023813-b7d6ced3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-065152-be03d69a | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-065152-be03d69a | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-065424-0122485b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-065424-0122485b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-065823-56d0518e | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-065823-56d0518e | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-070225-983f28a4 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-070225-983f28a4 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-070752-ee5e374f | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-070752-ee5e374f | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-071535-a34798d9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-071535-a34798d9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-072154-ce0a96c9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-072154-ce0a96c9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-073119-046c63c5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-073119-046c63c5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-074114-fb309dd3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-074114-fb309dd3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-074537-1abe2bd8 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-074537-1abe2bd8 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-075327-d3b09ae5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-075327-d3b09ae5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-075736-7dc8b5fa | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-075736-7dc8b5fa | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102224-77a554a3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102224-77a554a3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102450-4c4dafd8 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102450-4c4dafd8 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102846-f9da52d1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102846-f9da52d1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103139-c174189b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103139-c174189b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103500-42595b9b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103500-42595b9b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103806-ca54befb | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103806-ca54befb | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-104150-ee470964 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-104150-ee470964 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-104527-df556abc | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-104527-df556abc | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105101-7f0ea089 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105101-7f0ea089 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105332-509d420c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105332-509d420c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105924-5844ec5c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105924-5844ec5c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-110711-12e9e01e | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-110711-12e9e01e | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111029-a9c04726 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111029-a9c04726 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111326-3c584bd3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111326-3c584bd3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111537-b9ab2fef | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111537-b9ab2fef | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111839-c5f2e4c1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111839-c5f2e4c1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-112306-6bc27784 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-112306-6bc27784 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-112953-68b1af75 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-112953-68b1af75 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-113507-5543ffe1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-113507-5543ffe1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114156-1ff0ba59 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114156-1ff0ba59 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114446-b3513377 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114446-b3513377 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114752-9f3f4f92 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114752-9f3f4f92 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115051-39be5247 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115051-39be5247 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115611-ee478152 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115611-ee478152 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115850-e5f2348f | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115850-e5f2348f | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120221-58de15af | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120221-58de15af | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120435-e4b44447 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120435-e4b44447 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120616-d577d4b1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120616-d577d4b1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121131-13e4a8b5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121131-13e4a8b5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121528-03d9f220 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121528-03d9f220 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122054-f8985461 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122054-f8985461 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122358-fec2acfe | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122358-fec2acfe | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122856-43bd96e6 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122856-43bd96e6 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123353-08bae5f2 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123353-08bae5f2 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123722-abf5b6a0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123722-abf5b6a0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-124013-4e335fc0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-124013-4e335fc0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-124303-45bdfb12 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-124303-45bdfb12 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-125808-280ac90d | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-125808-280ac90d | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-131314-47751b92 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-131314-47751b92 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-132819-55ee19e1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-132819-55ee19e1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-134326-1f193cec | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-134326-1f193cec | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-135659-dfdbb7ee | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-135659-dfdbb7ee | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-141204-1573e7b2 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-141204-1573e7b2 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-142710-0136dc94 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-142710-0136dc94 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-143842-25bc3410 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-143842-25bc3410 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-145348-58a7a3f3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-145348-58a7a3f3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-150618-18c32d85 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-150618-18c32d85 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-152123-401b3de4 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-152123-401b3de4 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-153629-de5ac66d | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-153629-de5ac66d | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-154610-09481f31 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-154610-09481f31 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-160115-cb48ab31 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-160115-cb48ab31 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-161153-16c04a4e | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-161153-16c04a4e | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-162330-279c2d0e | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-162330-279c2d0e | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-163521-b51708f9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-163521-b51708f9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-164738-43ff8923 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-164738-43ff8923 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-165407-d907f577 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-165407-d907f577 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-170536-da2abfe7 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-170536-da2abfe7 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-171345-07e43bdb | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-171345-07e43bdb | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-172849-b26fa228 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-172849-b26fa228 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-173920-82f7a48c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-173920-82f7a48c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-015302-e1907b59 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-015702-033aab98 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-020002-c8680ac1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-020305-819a6a56 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-020922-c802a0ee | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-021319-f8645ceb | |
| model | auto_codex | unverified | run-20261102-021828-a3b13607 | |
| model | auto_codex | unverified | run-20261102-022315-259a16a5 | |
| model | auto_codex | unverified | run-20261102-022715-0f5b5375 | |
| model | auto_codex | unverified | run-20261102-023143-af17689a | |
| model | auto_codex | unverified | run-20261102-023515-f1dff616 | |
| model | auto_codex | unverified | run-20261102-023813-b7d6ced3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-065152-be03d69a | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-065424-0122485b | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-065823-56d0518e | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-070225-983f28a4 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-070752-ee5e374f | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-071535-a34798d9 | |
| model | auto_codex | unverified | run-20261102-072154-ce0a96c9 | |
| model | auto_codex | unverified | run-20261102-073119-046c63c5 | |
| model | auto_codex | unverified | run-20261102-074114-fb309dd3 | |
| model | auto_codex | unverified | run-20261102-074537-1abe2bd8 | |
| model | auto_codex | unverified | run-20261102-075327-d3b09ae5 | |
| model | auto_codex | unverified | run-20261102-075736-7dc8b5fa | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102224-77a554a3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102450-4c4dafd8 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102846-f9da52d1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103139-c174189b | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103500-42595b9b | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103806-ca54befb | |
| model | auto_codex | unverified | run-20261102-104150-ee470964 | |
| model | auto_codex | unverified | run-20261102-104527-df556abc | |
| model | auto_codex | unverified | run-20261102-105101-7f0ea089 | |
| model | auto_codex | unverified | run-20261102-105332-509d420c | |
| model | auto_codex | unverified | run-20261102-105924-5844ec5c | |
| model | auto_codex | unverified | run-20261102-110711-12e9e01e | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111029-a9c04726 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111326-3c584bd3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111537-b9ab2fef | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-111839-c5f2e4c1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-112306-6bc27784 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-112953-68b1af75 | |
| model | auto_codex | unverified | run-20261102-113507-5543ffe1 | |
| model | auto_codex | unverified | run-20261102-114156-1ff0ba59 | |
| model | auto_codex | unverified | run-20261102-114446-b3513377 | |
| model | auto_codex | unverified | run-20261102-114752-9f3f4f92 | |
| model | auto_codex | unverified | run-20261102-115051-39be5247 | |
| model | auto_codex | unverified | run-20261102-115611-ee478152 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-115850-e5f2348f | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120221-58de15af | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120435-e4b44447 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-120616-d577d4b1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121131-13e4a8b5 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121528-03d9f220 | |
| model | auto_codex | unverified | run-20261102-122054-f8985461 | |
| model | auto_codex | unverified | run-20261102-122358-fec2acfe | |
| model | auto_codex | unverified | run-20261102-122856-43bd96e6 | |
| model | auto_codex | unverified | run-20261102-123353-08bae5f2 | |
| model | auto_codex | unverified | run-20261102-123722-abf5b6a0 | |
| model | auto_codex | unverified | run-20261102-124013-4e335fc0 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-124303-45bdfb12 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-125808-280ac90d | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-131314-47751b92 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-132819-55ee19e1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-134326-1f193cec | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-135659-dfdbb7ee | |
| model | auto_codex | unverified | run-20261102-141204-1573e7b2 | |
| model | auto_codex | unverified | run-20261102-142710-0136dc94 | |
| model | auto_codex | unverified | run-20261102-143842-25bc3410 | |
| model | auto_codex | unverified | run-20261102-145348-58a7a3f3 | |
| model | auto_codex | unverified | run-20261102-150618-18c32d85 | |
| model | auto_codex | unverified | run-20261102-152123-401b3de4 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-153629-de5ac66d | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-154610-09481f31 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-160115-cb48ab31 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-161153-16c04a4e | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-162330-279c2d0e | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-163521-b51708f9 | |
| model | auto_codex | unverified | run-20261102-164738-43ff8923 | |
| model | auto_codex | unverified | run-20261102-165407-d907f577 | |
| model | auto_codex | unverified | run-20261102-170536-da2abfe7 | |
| model | auto_codex | unverified | run-20261102-171345-07e43bdb | |
| model | auto_codex | unverified | run-20261102-172849-b26fa228 | |
| model | auto_codex | unverified | run-20261102-173920-82f7a48c |