category
bug_fix
runs
72
evaluated
70
success rate
97.2%
mean time
4 m 37 s
input tokens
10,688,906
generated tokens
264,390
tokens
10,953,296
tool calls
855
Experiments this subject took part in
| experiment | title | type | runs | evaluated | passed | success rate | mean time | input tokens | generated tokens | total tokens | tool calls |
|---|---|---|---|---|---|---|---|---|---|---|---|
| router-config-comparison@1.0.0 | Router models versus Auto Codex, with and without knowledge | configuration | 72 | 70 | 70 | 97.2% | 4 m 37 s | 10,688,906 | 264,390 | 10,953,296 | 855 |
Tasks this subject worked
| task | category | difficulty | runs | passed | success rate | mean time | input tokens | generated tokens | total tokens | tool calls |
|---|---|---|---|---|---|---|---|---|---|---|
| bookshop-stock-002@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 4 m 5 s | 1,966,139 | 52,114 | 2,018,253 | 160 |
| bookshop-tiers-001@1.0.0 | bug_fix | hard | 12 | 12 | 100.0% | 4 m 37 s | 1,224,693 | 32,561 | 1,257,254 | 111 |
| cadence-takeover-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 3 m 60 s | 2,182,492 | 53,408 | 2,235,900 | 169 |
| ledgerlite-rates-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 4 m 1 s | 2,088,806 | 58,729 | 2,147,535 | 157 |
| stockpile-writeoff-001@1.0.0 | bug_fix | expert | 12 | 12 | 100.0% | 3 m 40 s | 2,345,811 | 47,327 | 2,393,138 | 156 |
| wordcount-001@1.0.0 | bug_fix | easy | 12 | 10 | 83.3% | 7 m 17 s | 880,965 | 20,251 | 901,216 | 102 |
Runs
in the order they started; the parameters column is the configuration each run was executed under
| run | parameters | started | task | agent | repetition | status | verdict | score | time | input tokens | generated tokens | total tokens | tool calls | failure class | error |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| run-20261102-015302-e1907b59 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 01:53:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 59 s | 139,513 | 3,865 | 143,378 | 13 | ||
| run-20261102-015702-033aab98 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 01:57:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 59 s | 110,185 | 2,205 | 112,390 | 10 | ||
| run-20261102-020002-c8680ac1 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 02:00:02 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 1 s | 118,277 | 2,192 | 120,469 | 9 | ||
| run-20261102-020305-819a6a56 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:03:05 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 6 m 16 s | 254,599 | 10,261 | 264,860 | 20 | ||
| run-20261102-020922-c802a0ee | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:09:22 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 56 s | 164,309 | 4,902 | 169,211 | 14 | ||
| run-20261102-021319-f8645ceb | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:13:19 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 8 s | 223,668 | 7,523 | 231,191 | 17 | ||
| run-20261102-021828-a3b13607 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:18:28 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 4 m 46 s | 241,297 | 4,789 | 246,086 | 17 | ||
| run-20261102-022315-259a16a5 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:23:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 59 s | 128,251 | 3,787 | 132,038 | 11 | ||
| run-20261102-022715-0f5b5375 | knowledge_enabled=False, model=auto_codex | 2026-11-02 02:27:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 27 s | 173,650 | 3,854 | 177,504 | 15 | ||
| run-20261102-023143-af17689a | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:31:43 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 31 s | 124,678 | 3,136 | 127,814 | 10 | ||
| run-20261102-023515-f1dff616 | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:35:15 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 57 s | 107,513 | 2,363 | 109,876 | 11 | ||
| run-20261102-023813-b7d6ced3 | knowledge_enabled=True, model=auto_codex | 2026-11-02 02:38:13 | bookshop-stock-002@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 58 s | 180,199 | 3,237 | 183,436 | 13 | ||
| run-20261102-024213-cd12e80f | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 02:42:13 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 1 m 60 s | 51,447 | 826 | 52,273 | 5 | ||
| run-20261102-024414-b4a4c0f1 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 02:44:14 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 22 s | 73,253 | 1,407 | 74,660 | 7 | ||
| run-20261102-024637-153cbef0 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 02:46:37 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 22 s | 84,790 | 1,310 | 86,100 | 8 | ||
| run-20261102-024900-b4e495b9 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:49:00 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 4 m 48 s | 204,454 | 6,473 | 210,927 | 18 | ||
| run-20261102-025349-a41ee544 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:53:49 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 4 m 48 s | 190,916 | 6,504 | 197,420 | 16 | ||
| run-20261102-025838-8e5d4349 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 02:58:38 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 52 s | 185,126 | 6,992 | 192,118 | 17 | ||
| run-20261102-030330-6e680c03 | knowledge_enabled=False, model=auto_codex | 2026-11-02 03:03:30 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 49 s | 81,249 | 1,664 | 82,913 | 7 | ||
| run-20261102-030620-307d982c | knowledge_enabled=False, model=auto_codex | 2026-11-02 03:06:20 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 43 s | 62,588 | 1,462 | 64,050 | 6 | ||
| run-20261102-031005-8ee792e8 | knowledge_enabled=False, model=auto_codex | 2026-11-02 03:10:05 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 39 s | 52,158 | 1,256 | 53,414 | 5 | ||
| run-20261102-031245-d48061aa | knowledge_enabled=True, model=auto_codex | 2026-11-02 03:12:45 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 7 m 31 s | 65,070 | 1,527 | 66,597 | 6 | ||
| run-20261102-032017-d7e7635d | knowledge_enabled=True, model=auto_codex | 2026-11-02 03:20:17 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 6 m 36 s | 84,442 | 1,529 | 85,971 | 8 | ||
| run-20261102-032654-eef72cc9 | knowledge_enabled=True, model=auto_codex | 2026-11-02 03:26:54 | bookshop-tiers-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 10 m 50 s | 89,200 | 1,611 | 90,811 | 8 | ||
| run-20261102-033745-147a6170 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 03:37:45 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 10 s | 165,875 | 2,586 | 168,461 | 18 | ||
| run-20261102-034056-a469ad46 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 03:40:56 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 1 m 35 s | 53,883 | 1,045 | 54,928 | 6 | ||
| run-20261102-034231-ceec4cf9 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 03:42:31 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 1 m 16 s | 44,338 | 703 | 45,041 | 5 | ||
| run-20261102-034347-4d78071a | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 03:43:47 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 6 m 8 s | 59,593 | 2,202 | 61,795 | 9 | ||
| run-20261102-034956-2f8213a2 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 03:49:56 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | timeout | not measured | 15 m 2 s | 83,828 | 2,874 | 86,702 | 12 | agent | The fix is on disk, but git doesn't report `text.py` as modified — verifying against HEAD. | |
| run-20261102-040500-60833b88 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 04:05:00 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | timeout | not measured | 15 m 2 s | 29,760 | 803 | 30,563 | 4 | agent | Found it — the working tree modified `text.split()` into `text.split(" ")`. Let me confirm which inputs misbehave. | |
| run-20261102-042003-4e77ac85 | knowledge_enabled=False, model=auto_codex | 2026-11-02 04:20:03 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 8 m 12 s | 65,143 | 1,868 | 67,011 | 7 | ||
| run-20261102-042815-65e2ad9b | knowledge_enabled=False, model=auto_codex | 2026-11-02 04:28:15 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 6 m 51 s | 44,291 | 729 | 45,020 | 5 | ||
| run-20261102-043507-07326b31 | knowledge_enabled=False, model=auto_codex | 2026-11-02 04:35:07 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 11 m 9 s | 91,894 | 2,139 | 94,033 | 10 | ||
| run-20261102-044616-5ced7f24 | knowledge_enabled=True, model=auto_codex | 2026-11-02 04:46:16 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 20 s | 72,757 | 1,528 | 74,285 | 8 | ||
| run-20261102-045137-ae782a86 | knowledge_enabled=True, model=auto_codex | 2026-11-02 04:51:37 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 8 m 13 s | 57,880 | 1,598 | 59,478 | 6 | ||
| run-20261102-045951-9062760d | knowledge_enabled=True, model=auto_codex | 2026-11-02 04:59:51 | wordcount-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 25 s | 111,723 | 2,176 | 113,899 | 12 | ||
| run-20261102-102224-77a554a3 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:22:24 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 25 s | 87,441 | 2,062 | 89,503 | 9 | ||
| run-20261102-102450-4c4dafd8 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:24:50 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 56 s | 184,037 | 3,928 | 187,965 | 13 | ||
| run-20261102-102846-f9da52d1 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 10:28:46 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 53 s | 166,105 | 2,393 | 168,498 | 14 | ||
| run-20261102-103139-c174189b | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:31:39 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 20 s | 142,081 | 4,157 | 146,238 | 13 | ||
| run-20261102-103500-42595b9b | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:35:00 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 6 s | 136,190 | 4,248 | 140,438 | 12 | ||
| run-20261102-103806-ca54befb | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 10:38:06 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 43 s | 176,874 | 4,786 | 181,660 | 14 | ||
| run-20261102-104150-ee470964 | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:41:50 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 36 s | 184,263 | 2,829 | 187,092 | 15 | ||
| run-20261102-104527-df556abc | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:45:27 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 5 m 33 s | 231,250 | 6,615 | 237,865 | 16 | ||
| run-20261102-105101-7f0ea089 | knowledge_enabled=False, model=auto_codex | 2026-11-02 10:51:01 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 31 s | 81,756 | 1,513 | 83,269 | 9 | ||
| run-20261102-105332-509d420c | knowledge_enabled=True, model=auto_codex | 2026-11-02 10:53:32 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 51 s | 181,892 | 10,799 | 192,691 | 15 | ||
| run-20261102-105924-5844ec5c | knowledge_enabled=True, model=auto_codex | 2026-11-02 10:59:24 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 7 m 45 s | 486,023 | 7,446 | 493,469 | 26 | ||
| run-20261102-110711-12e9e01e | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:07:11 | cadence-takeover-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 18 s | 124,580 | 2,632 | 127,212 | 13 | ||
| run-20261102-111029-a9c04726 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:10:29 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 57 s | 118,837 | 2,616 | 121,453 | 12 | ||
| run-20261102-111326-3c584bd3 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:13:26 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 10 s | 81,280 | 1,903 | 83,183 | 7 | ||
| run-20261102-111537-b9ab2fef | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:15:37 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 1 s | 130,324 | 2,843 | 133,167 | 12 | ||
| run-20261102-111839-c5f2e4c1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:18:39 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 4 m 26 s | 197,743 | 6,744 | 204,487 | 15 | ||
| run-20261102-112306-6bc27784 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:23:06 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 6 m 46 s | 359,678 | 11,459 | 371,137 | 20 | ||
| run-20261102-112953-68b1af75 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 11:29:53 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 12 s | 266,657 | 7,835 | 274,492 | 19 | ||
| run-20261102-113507-5543ffe1 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:35:07 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 6 m 49 s | 273,433 | 8,650 | 282,083 | 17 | ||
| run-20261102-114156-1ff0ba59 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:41:56 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 49 s | 97,473 | 2,294 | 99,767 | 9 | ||
| run-20261102-114446-b3513377 | knowledge_enabled=False, model=auto_codex | 2026-11-02 11:44:46 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 3 m 5 s | 137,674 | 3,039 | 140,713 | 10 | ||
| run-20261102-114752-9f3f4f92 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:47:52 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 2 m 59 s | 109,708 | 3,384 | 113,092 | 10 | ||
| run-20261102-115051-39be5247 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:50:51 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 5 m 19 s | 233,226 | 5,848 | 239,074 | 16 | ||
| run-20261102-115611-ee478152 | knowledge_enabled=True, model=auto_codex | 2026-11-02 11:56:11 | ledgerlite-rates-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 39 s | 82,773 | 2,114 | 84,887 | 10 | ||
| run-20261102-115850-e5f2348f | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:58:50 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 30 s | 174,833 | 3,032 | 177,865 | 12 | ||
| run-20261102-120221-58de15af | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:02:21 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 13 s | 131,934 | 1,632 | 133,566 | 10 | ||
| run-20261102-120435-e4b44447 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:04:35 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 1 m 40 s | 86,407 | 948 | 87,355 | 7 | ||
| run-20261102-120616-d577d4b1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:06:16 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 15 s | 256,446 | 8,216 | 264,662 | 16 | ||
| run-20261102-121131-13e4a8b5 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:11:31 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 55 s | 216,253 | 5,255 | 221,508 | 12 | ||
| run-20261102-121528-03d9f220 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:15:28 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 26 s | 293,346 | 8,697 | 302,043 | 17 | ||
| run-20261102-122054-f8985461 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:20:54 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 3 s | 130,716 | 3,022 | 133,738 | 10 | ||
| run-20261102-122358-fec2acfe | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:23:58 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 4 m 57 s | 284,384 | 4,090 | 288,474 | 16 | ||
| run-20261102-122856-43bd96e6 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:28:56 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 56 s | 290,116 | 5,054 | 295,170 | 18 | ||
| run-20261102-123353-08bae5f2 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:33:53 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 28 s | 174,055 | 3,204 | 177,259 | 12 | ||
| run-20261102-123722-abf5b6a0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:37:22 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 50 s | 159,452 | 1,673 | 161,125 | 12 | ||
| run-20261102-124013-4e335fc0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:40:13 | stockpile-writeoff-001@1.0.0 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 48 s | 147,869 | 2,504 | 150,373 | 14 |
Not verified
Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
| kind | subject | status | run | note |
|---|---|---|---|---|
| plugin | agentic_knowledge | unsupported | run-20261102-015302-e1907b59 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-015302-e1907b59 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-015702-033aab98 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-015702-033aab98 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020002-c8680ac1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020002-c8680ac1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020305-819a6a56 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020305-819a6a56 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-020922-c802a0ee | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-020922-c802a0ee | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-021319-f8645ceb | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-021319-f8645ceb | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-021828-a3b13607 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-021828-a3b13607 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-022315-259a16a5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-022315-259a16a5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-022715-0f5b5375 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-022715-0f5b5375 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023143-af17689a | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023143-af17689a | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023515-f1dff616 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023515-f1dff616 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-023813-b7d6ced3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-023813-b7d6ced3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-024213-cd12e80f | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-024213-cd12e80f | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-024414-b4a4c0f1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-024414-b4a4c0f1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-024637-153cbef0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-024637-153cbef0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-024900-b4e495b9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-024900-b4e495b9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-025349-a41ee544 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-025349-a41ee544 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-025838-8e5d4349 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-025838-8e5d4349 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-030330-6e680c03 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-030330-6e680c03 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-030620-307d982c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-030620-307d982c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-031005-8ee792e8 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-031005-8ee792e8 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-031245-d48061aa | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-031245-d48061aa | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-032017-d7e7635d | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-032017-d7e7635d | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-032654-eef72cc9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-032654-eef72cc9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-033745-147a6170 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-033745-147a6170 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-034056-a469ad46 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-034056-a469ad46 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-034231-ceec4cf9 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-034231-ceec4cf9 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-034347-4d78071a | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-034347-4d78071a | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-034956-2f8213a2 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-034956-2f8213a2 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-040500-60833b88 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-040500-60833b88 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-042003-4e77ac85 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-042003-4e77ac85 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-042815-65e2ad9b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-042815-65e2ad9b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-043507-07326b31 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-043507-07326b31 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-044616-5ced7f24 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-044616-5ced7f24 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-045137-ae782a86 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-045137-ae782a86 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-045951-9062760d | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-045951-9062760d | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102224-77a554a3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102224-77a554a3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102450-4c4dafd8 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102450-4c4dafd8 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-102846-f9da52d1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-102846-f9da52d1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103139-c174189b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103139-c174189b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103500-42595b9b | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103500-42595b9b | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-103806-ca54befb | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-103806-ca54befb | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-104150-ee470964 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-104150-ee470964 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-104527-df556abc | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-104527-df556abc | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105101-7f0ea089 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105101-7f0ea089 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105332-509d420c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105332-509d420c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-105924-5844ec5c | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-105924-5844ec5c | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-110711-12e9e01e | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-110711-12e9e01e | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111029-a9c04726 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111029-a9c04726 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111326-3c584bd3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111326-3c584bd3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111537-b9ab2fef | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111537-b9ab2fef | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-111839-c5f2e4c1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-111839-c5f2e4c1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-112306-6bc27784 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-112306-6bc27784 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-112953-68b1af75 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-112953-68b1af75 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-113507-5543ffe1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-113507-5543ffe1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114156-1ff0ba59 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114156-1ff0ba59 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114446-b3513377 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114446-b3513377 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-114752-9f3f4f92 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-114752-9f3f4f92 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115051-39be5247 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115051-39be5247 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115611-ee478152 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115611-ee478152 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-115850-e5f2348f | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115850-e5f2348f | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120221-58de15af | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120221-58de15af | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120435-e4b44447 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120435-e4b44447 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120616-d577d4b1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120616-d577d4b1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121131-13e4a8b5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121131-13e4a8b5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121528-03d9f220 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121528-03d9f220 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122054-f8985461 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122054-f8985461 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122358-fec2acfe | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122358-fec2acfe | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122856-43bd96e6 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122856-43bd96e6 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123353-08bae5f2 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123353-08bae5f2 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123722-abf5b6a0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123722-abf5b6a0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-124013-4e335fc0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-124013-4e335fc0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-015302-e1907b59 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-015702-033aab98 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-020002-c8680ac1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-020305-819a6a56 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-020922-c802a0ee | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-021319-f8645ceb | |
| model | auto_codex | unverified | run-20261102-021828-a3b13607 | |
| model | auto_codex | unverified | run-20261102-022315-259a16a5 | |
| model | auto_codex | unverified | run-20261102-022715-0f5b5375 | |
| model | auto_codex | unverified | run-20261102-023143-af17689a | |
| model | auto_codex | unverified | run-20261102-023515-f1dff616 | |
| model | auto_codex | unverified | run-20261102-023813-b7d6ced3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-024213-cd12e80f | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-024414-b4a4c0f1 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-024637-153cbef0 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-024900-b4e495b9 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-025349-a41ee544 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-025838-8e5d4349 | |
| model | auto_codex | unverified | run-20261102-030330-6e680c03 | |
| model | auto_codex | unverified | run-20261102-030620-307d982c | |
| model | auto_codex | unverified | run-20261102-031005-8ee792e8 | |
| model | auto_codex | unverified | run-20261102-031245-d48061aa | |
| model | auto_codex | unverified | run-20261102-032017-d7e7635d | |
| model | auto_codex | unverified | run-20261102-032654-eef72cc9 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-033745-147a6170 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-034056-a469ad46 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-034231-ceec4cf9 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-034347-4d78071a | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-034956-2f8213a2 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-040500-60833b88 | |
| model | auto_codex | unverified | run-20261102-042003-4e77ac85 | |
| model | auto_codex | unverified | run-20261102-042815-65e2ad9b | |
| model | auto_codex | unverified | run-20261102-043507-07326b31 | |
| model | auto_codex | unverified | run-20261102-044616-5ced7f24 | |
| model | auto_codex | unverified | run-20261102-045137-ae782a86 | |
| model | auto_codex | unverified | run-20261102-045951-9062760d | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102224-77a554a3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102450-4c4dafd8 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-102846-f9da52d1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103139-c174189b | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103500-42595b9b | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-103806-ca54befb | |
| model | auto_codex | unverified | run-20261102-104150-ee470964 | |
| model | auto_codex | unverified | run-20261102-104527-df556abc | |
| model | auto_codex | unverified | run-20261102-105101-7f0ea089 | |
| model | auto_codex | unverified | run-20261102-105332-509d420c | |
| model | auto_codex | unverified | run-20261102-105924-5844ec5c | |
| model | auto_codex | unverified | run-20261102-110711-12e9e01e | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111029-a9c04726 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111326-3c584bd3 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-111537-b9ab2fef | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-111839-c5f2e4c1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-112306-6bc27784 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-112953-68b1af75 | |
| model | auto_codex | unverified | run-20261102-113507-5543ffe1 | |
| model | auto_codex | unverified | run-20261102-114156-1ff0ba59 | |
| model | auto_codex | unverified | run-20261102-114446-b3513377 | |
| model | auto_codex | unverified | run-20261102-114752-9f3f4f92 | |
| model | auto_codex | unverified | run-20261102-115051-39be5247 | |
| model | auto_codex | unverified | run-20261102-115611-ee478152 | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-115850-e5f2348f | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120221-58de15af | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120435-e4b44447 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-120616-d577d4b1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121131-13e4a8b5 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121528-03d9f220 | |
| model | auto_codex | unverified | run-20261102-122054-f8985461 | |
| model | auto_codex | unverified | run-20261102-122358-fec2acfe | |
| model | auto_codex | unverified | run-20261102-122856-43bd96e6 | |
| model | auto_codex | unverified | run-20261102-123353-08bae5f2 | |
| model | auto_codex | unverified | run-20261102-123722-abf5b6a0 | |
| model | auto_codex | unverified | run-20261102-124013-4e335fc0 |