AK-Benchbenchmark report

model

auto_codex

runs
78
evaluated
71
success rate
83.3%
mean time
6 m 42 s
input tokens
17,993,151
generated tokens
601,847
tokens
18,594,998
tool calls
1,099

Experiments this subject took part in

experimenttitletyperunsevaluatedpassedsuccess ratemean timeinput tokensgenerated tokenstotal tokenstool calls
router-config-comparison@1.0.0Router models versus Auto Codex, with and without knowledgeconfiguration78716583.3%6 m 42 s17,993,151601,84718,594,9981,099

Tasks this subject worked

taskcategorydifficultyrunspassedsuccess ratemean timeinput tokensgenerated tokenstotal tokenstool calls
bookshop-stock-002@1.0.0bug_fixexpert66100.0%3 m 56 s955,58821,166976,75477
bookshop-tiers-001@1.0.0bug_fixhard66100.0%5 m 41 s434,7079,049443,75640
cadence-catchup-001@1.0.0new_featureexpert6116.7%14 m 3 s3,172,366154,5273,326,893131
cadence-takeover-001@1.0.0bug_fixexpert66100.0%4 m 46 s1,289,76431,8341,321,59894
freight-shop-001@1.0.0new_featureexpert6233.3%10 m 33 s2,778,950109,8202,888,770124
ledgerlite-rates-001@1.0.0bug_fixexpert66100.0%3 m 57 s934,28725,329959,61672
ledgerlite-reconcile-001@1.0.0new_featureexpert6466.7%9 m 39 s2,892,11191,9472,984,058129
notes-search-001@1.0.0new_featurehard6466.7%8 m 8 s983,02238,8711,021,89383
notes-sync-001@1.0.0new_featureexpert66100.0%6 m 41 s1,004,94534,8301,039,77579
slugify-001@1.0.0new_featureeasy66100.0%3 m 6 s501,86512,818514,68350
stockpile-fefo-001@1.0.0new_featureexpert66100.0%5 m 24 s1,415,26642,0711,457,33790
stockpile-writeoff-001@1.0.0bug_fixexpert66100.0%3 m 41 s1,186,59219,5471,206,13982
wordcount-001@1.0.0bug_fixeasy66100.0%7 m 32 s443,68810,038453,72648

model observations

runrequestedobservedsourceverification
run-20261102-021828-a3b13607auto_codexauto_codexagent_reportedunverified
run-20261102-022315-259a16a5auto_codexauto_codexagent_reportedunverified
run-20261102-022715-0f5b5375auto_codexauto_codexagent_reportedunverified
run-20261102-023143-af17689aauto_codexauto_codexagent_reportedunverified
run-20261102-023515-f1dff616auto_codexauto_codexagent_reportedunverified
run-20261102-023813-b7d6ced3auto_codexauto_codexagent_reportedunverified
run-20261102-030330-6e680c03auto_codexauto_codexagent_reportedunverified
run-20261102-030620-307d982cauto_codexauto_codexagent_reportedunverified
run-20261102-031005-8ee792e8auto_codexauto_codexagent_reportedunverified
run-20261102-031245-d48061aaauto_codexauto_codexagent_reportedunverified
run-20261102-032017-d7e7635dauto_codexauto_codexagent_reportedunverified
run-20261102-032654-eef72cc9auto_codexauto_codexagent_reportedunverified
run-20261102-042003-4e77ac85auto_codexauto_codexagent_reportedunverified
run-20261102-042815-65e2ad9bauto_codexauto_codexagent_reportedunverified
run-20261102-043507-07326b31auto_codexauto_codexagent_reportedunverified
run-20261102-044616-5ced7f24auto_codexauto_codexagent_reportedunverified
run-20261102-045137-ae782a86auto_codexauto_codexagent_reportedunverified
run-20261102-045951-9062760dauto_codexauto_codexagent_reportedunverified
run-20261102-060259-4681bb55auto_codexauto_codexagent_reportedunverified
run-20261102-061803-ca793f25auto_codexauto_codexagent_reportedunverified
run-20261102-063306-62006f1cauto_codexauto_codexagent_reportedunverified
run-20261102-063921-31a5efefauto_codexauto_codexagent_reportedunverified
run-20261102-064343-33d90543auto_codexauto_codexagent_reportedunverified
run-20261102-064601-0d71057aauto_codexauto_codexagent_reportedunverified
run-20261102-072154-ce0a96c9auto_codexauto_codexagent_reportedunverified
run-20261102-073119-046c63c5auto_codexauto_codexagent_reportedunverified
run-20261102-074114-fb309dd3auto_codexauto_codexagent_reportedunverified
run-20261102-074537-1abe2bd8auto_codexauto_codexagent_reportedunverified
run-20261102-075327-d3b09ae5auto_codexauto_codexagent_reportedunverified
run-20261102-075736-7dc8b5faauto_codexauto_codexagent_reportedunverified
run-20261102-084427-5c4e6c25auto_codexauto_codexagent_reportedunverified
run-20261102-084722-12cb8519auto_codexauto_codexagent_reportedunverified
run-20261102-084925-db233c9dauto_codexauto_codexagent_reportedunverified
run-20261102-085126-7081e5a7auto_codexauto_codexagent_reportedunverified
run-20261102-085717-2d40efc9auto_codexauto_codexagent_reportedunverified
run-20261102-090053-801966e8auto_codexauto_codexagent_reportedunverified
run-20261102-104150-ee470964auto_codexauto_codexagent_reportedunverified
run-20261102-104527-df556abcauto_codexauto_codexagent_reportedunverified
run-20261102-105101-7f0ea089auto_codexauto_codexagent_reportedunverified
run-20261102-105332-509d420cauto_codexauto_codexagent_reportedunverified
run-20261102-105924-5844ec5cauto_codexauto_codexagent_reportedunverified
run-20261102-110711-12e9e01eauto_codexauto_codexagent_reportedunverified
run-20261102-113507-5543ffe1auto_codexauto_codexagent_reportedunverified
run-20261102-114156-1ff0ba59auto_codexauto_codexagent_reportedunverified
run-20261102-114446-b3513377auto_codexauto_codexagent_reportedunverified
run-20261102-114752-9f3f4f92auto_codexauto_codexagent_reportedunverified
run-20261102-115051-39be5247auto_codexauto_codexagent_reportedunverified
run-20261102-115611-ee478152auto_codexauto_codexagent_reportedunverified
run-20261102-122054-f8985461auto_codexauto_codexagent_reportedunverified
run-20261102-122358-fec2acfeauto_codexauto_codexagent_reportedunverified
run-20261102-122856-43bd96e6auto_codexauto_codexagent_reportedunverified
run-20261102-123353-08bae5f2auto_codexauto_codexagent_reportedunverified
run-20261102-123722-abf5b6a0auto_codexauto_codexagent_reportedunverified
run-20261102-124013-4e335fc0auto_codexauto_codexagent_reportedunverified
run-20261102-141204-1573e7b2auto_codexauto_codexagent_reportedunverified
run-20261102-142710-0136dc94auto_codexauto_codexagent_reportedunverified
run-20261102-143842-25bc3410auto_codexauto_codexagent_reportedunverified
run-20261102-145348-58a7a3f3auto_codexauto_codexagent_reportedunverified
run-20261102-150618-18c32d85auto_codexauto_codexagent_reportedunverified
run-20261102-152123-401b3de4auto_codexauto_codexagent_reportedunverified
run-20261102-164738-43ff8923auto_codexauto_codexagent_reportedunverified
run-20261102-165407-d907f577auto_codexauto_codexagent_reportedunverified
run-20261102-170536-da2abfe7auto_codexauto_codexagent_reportedunverified
run-20261102-171345-07e43bdbauto_codexauto_codexagent_reportedunverified
run-20261102-172849-b26fa228auto_codexauto_codexagent_reportedunverified
run-20261102-173920-82f7a48cauto_codexauto_codexagent_reportedunverified
run-20261102-191101-7b74b38fauto_codexauto_codexagent_reportedunverified
run-20261102-192057-a14677ebauto_codexauto_codexagent_reportedunverified
run-20261102-192932-7bb86699auto_codexauto_codexagent_reportedunverified
run-20261102-193822-f24e2c68auto_codexauto_codexagent_reportedunverified
run-20261102-194904-cb1d7f72auto_codexauto_codexagent_reportedunverified
run-20261102-195713-1edd6fafauto_codexauto_codexagent_reportedunverified
run-20261102-205102-77cec3caauto_codexauto_codexagent_reportedunverified
run-20261102-205547-64ffb964auto_codexauto_codexagent_reportedunverified
run-20261102-210144-40341822auto_codexauto_codexagent_reportedunverified
run-20261102-210547-94d6a5ffauto_codexauto_codexagent_reportedunverified
run-20261102-211003-7474c6a3auto_codexauto_codexagent_reportedunverified
run-20261102-211707-b1b04f82auto_codexauto_codexagent_reportedunverified

Runs

in the order they started; the parameters column is the configuration each run was executed under

runparametersstartedtaskagentrepetitionstatusverdictscoretimeinput tokensgenerated tokenstotal tokenstool callsfailure classerror
run-20261102-021828-a3b13607knowledge_enabled=False, model=auto_codex2026-11-02 02:18:28bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 46 s241,2974,789246,08617none—
run-20261102-022315-259a16a5knowledge_enabled=False, model=auto_codex2026-11-02 02:23:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 59 s128,2513,787132,03811none—
run-20261102-022715-0f5b5375knowledge_enabled=False, model=auto_codex2026-11-02 02:27:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 27 s173,6503,854177,50415none—
run-20261102-023143-af17689aknowledge_enabled=True, model=auto_codex2026-11-02 02:31:43bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 31 s124,6783,136127,81410none—
run-20261102-023515-f1dff616knowledge_enabled=True, model=auto_codex2026-11-02 02:35:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 57 s107,5132,363109,87611none—
run-20261102-023813-b7d6ced3knowledge_enabled=True, model=auto_codex2026-11-02 02:38:13bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 58 s180,1993,237183,43613none—
run-20261102-030330-6e680c03knowledge_enabled=False, model=auto_codex2026-11-02 03:03:30bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 49 s81,2491,66482,9137none—
run-20261102-030620-307d982cknowledge_enabled=False, model=auto_codex2026-11-02 03:06:20bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 43 s62,5881,46264,0506none—
run-20261102-031005-8ee792e8knowledge_enabled=False, model=auto_codex2026-11-02 03:10:05bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 39 s52,1581,25653,4145none—
run-20261102-031245-d48061aaknowledge_enabled=True, model=auto_codex2026-11-02 03:12:45bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0007 m 31 s65,0701,52766,5976none—
run-20261102-032017-d7e7635dknowledge_enabled=True, model=auto_codex2026-11-02 03:20:17bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0006 m 36 s84,4421,52985,9718none—
run-20261102-032654-eef72cc9knowledge_enabled=True, model=auto_codex2026-11-02 03:26:54bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00010 m 50 s89,2001,61190,8118none—
run-20261102-042003-4e77ac85knowledge_enabled=False, model=auto_codex2026-11-02 04:20:03wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0008 m 12 s65,1431,86867,0117none—
run-20261102-042815-65e2ad9bknowledge_enabled=False, model=auto_codex2026-11-02 04:28:15wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0006 m 51 s44,29172945,0205none—
run-20261102-043507-07326b31knowledge_enabled=False, model=auto_codex2026-11-02 04:35:07wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00011 m 9 s91,8942,13994,03310none—
run-20261102-044616-5ced7f24knowledge_enabled=True, model=auto_codex2026-11-02 04:46:16wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 20 s72,7571,52874,2858none—
run-20261102-045137-ae782a86knowledge_enabled=True, model=auto_codex2026-11-02 04:51:37wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0008 m 13 s57,8801,59859,4786none—
run-20261102-045951-9062760dknowledge_enabled=True, model=auto_codex2026-11-02 04:59:51wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 25 s111,7232,176113,89912none—
run-20261102-060259-4681bb55knowledge_enabled=False, model=auto_codex2026-11-02 06:02:59notes-search-001@1.0.0codex@codex-cli 0.166.01timeoutnot measurednot measured15 m 3 s92,6555,28797,94211agentFound a real bug: with `for ... else`, my scoring block sits inside `if terms:`, so a blank query appended nothing and returned `[]`. Restructuring so an empty term list scores 0 and matches.
run-20261102-061803-ca793f25knowledge_enabled=False, model=auto_codex2026-11-02 06:18:03notes-search-001@1.0.0codex@codex-cli 0.166.02timeoutnot measurednot measured15 m 3 s364,79413,619378,41324agentThe implementation is correct — the last "failure" was another typo in my hand-written expected list (I swapped `t2`/`t1`), and the final direct probe confirmed the spec order `['t0','d','tg','t2','t1','c','b','a','e','m2','m1']` and correct scoring. Cleaning up the stale `.pyc` churn so the diff is just the implementation:
run-20261102-063306-62006f1cknowledge_enabled=False, model=auto_codex2026-11-02 06:33:06notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0006 m 14 s127,0934,757131,85012none—
run-20261102-063921-31a5efefknowledge_enabled=True, model=auto_codex2026-11-02 06:39:21notes-search-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 21 s151,0275,654156,68113none—
run-20261102-064343-33d90543knowledge_enabled=True, model=auto_codex2026-11-02 06:43:43notes-search-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 18 s56,6252,03058,6558none—
run-20261102-064601-0d71057aknowledge_enabled=True, model=auto_codex2026-11-02 06:46:01notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 50 s190,8287,524198,35215none—
run-20261102-072154-ce0a96c9knowledge_enabled=False, model=auto_codex2026-11-02 07:21:54notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0009 m 24 s292,5866,876299,46221none—
run-20261102-073119-046c63c5knowledge_enabled=False, model=auto_codex2026-11-02 07:31:19notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0009 m 54 s186,1957,893194,08814none—
run-20261102-074114-fb309dd3knowledge_enabled=False, model=auto_codex2026-11-02 07:41:14notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 22 s139,4534,875144,32811none—
run-20261102-074537-1abe2bd8knowledge_enabled=True, model=auto_codex2026-11-02 07:45:37notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0007 m 49 s168,2586,167174,42512none—
run-20261102-075327-d3b09ae5knowledge_enabled=True, model=auto_codex2026-11-02 07:53:27notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0004 m 8 s92,3354,29096,62511none—
run-20261102-075736-7dc8b5faknowledge_enabled=True, model=auto_codex2026-11-02 07:57:36notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 27 s126,1184,729130,84710none—
run-20261102-084427-5c4e6c25knowledge_enabled=False, model=auto_codex2026-11-02 08:44:27slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 54 s92,9172,28995,2069none—
run-20261102-084722-12cb8519knowledge_enabled=False, model=auto_codex2026-11-02 08:47:22slugify-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 3 s68,4371,56470,0017none—
run-20261102-084925-db233c9dknowledge_enabled=False, model=auto_codex2026-11-02 08:49:25slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 60 s67,0291,57168,6007none—
run-20261102-085126-7081e5a7knowledge_enabled=True, model=auto_codex2026-11-02 08:51:26slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 50 s82,1122,40484,5168none—
run-20261102-085717-2d40efc9knowledge_enabled=True, model=auto_codex2026-11-02 08:57:17slugify-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 35 s112,6422,849115,49111none—
run-20261102-090053-801966e8knowledge_enabled=True, model=auto_codex2026-11-02 09:00:53slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 15 s78,7282,14180,8698none—
run-20261102-104150-ee470964knowledge_enabled=False, model=auto_codex2026-11-02 10:41:50cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 36 s184,2632,829187,09215none—
run-20261102-104527-df556abcknowledge_enabled=False, model=auto_codex2026-11-02 10:45:27cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0005 m 33 s231,2506,615237,86516none—
run-20261102-105101-7f0ea089knowledge_enabled=False, model=auto_codex2026-11-02 10:51:01cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 31 s81,7561,51383,2699none—
run-20261102-105332-509d420cknowledge_enabled=True, model=auto_codex2026-11-02 10:53:32cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 51 s181,89210,799192,69115none—
run-20261102-105924-5844ec5cknowledge_enabled=True, model=auto_codex2026-11-02 10:59:24cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 45 s486,0237,446493,46926none—
run-20261102-110711-12e9e01eknowledge_enabled=True, model=auto_codex2026-11-02 11:07:11cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 18 s124,5802,632127,21213none—
run-20261102-113507-5543ffe1knowledge_enabled=False, model=auto_codex2026-11-02 11:35:07ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 49 s273,4338,650282,08317none—
run-20261102-114156-1ff0ba59knowledge_enabled=False, model=auto_codex2026-11-02 11:41:56ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 49 s97,4732,29499,7679none—
run-20261102-114446-b3513377knowledge_enabled=False, model=auto_codex2026-11-02 11:44:46ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 5 s137,6743,039140,71310none—
run-20261102-114752-9f3f4f92knowledge_enabled=True, model=auto_codex2026-11-02 11:47:52ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 59 s109,7083,384113,09210none—
run-20261102-115051-39be5247knowledge_enabled=True, model=auto_codex2026-11-02 11:50:51ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0005 m 19 s233,2265,848239,07416none—
run-20261102-115611-ee478152knowledge_enabled=True, model=auto_codex2026-11-02 11:56:11ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 39 s82,7732,11484,88710none—
run-20261102-122054-f8985461knowledge_enabled=False, model=auto_codex2026-11-02 12:20:54stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 3 s130,7163,022133,73810none—
run-20261102-122358-fec2acfeknowledge_enabled=False, model=auto_codex2026-11-02 12:23:58stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0004 m 57 s284,3844,090288,47416none—
run-20261102-122856-43bd96e6knowledge_enabled=False, model=auto_codex2026-11-02 12:28:56stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 56 s290,1165,054295,17018none—
run-20261102-123353-08bae5f2knowledge_enabled=True, model=auto_codex2026-11-02 12:33:53stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 28 s174,0553,204177,25912none—
run-20261102-123722-abf5b6a0knowledge_enabled=True, model=auto_codex2026-11-02 12:37:22stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 50 s159,4521,673161,12512none—
run-20261102-124013-4e335fc0knowledge_enabled=True, model=auto_codex2026-11-02 12:40:13stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 48 s147,8692,504150,37314none—
run-20261102-141204-1573e7b2knowledge_enabled=False, model=auto_codex2026-11-02 14:12:04cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measurednot measured15 m 4 s469,38726,193495,58019agentBoth were again my own expectation errors — the plan output is correct in each case. Now the critical rules: `depends_on_past`, the cap, ordering, and purity.
run-20261102-142710-0136dc94knowledge_enabled=False, model=auto_codex2026-11-02 14:27:10cadence-catchup-001@1.0.0codex@codex-cli 0.166.02completedpassed1.00011 m 32 s409,64723,502433,14916none—
run-20261102-143842-25bc3410knowledge_enabled=False, model=auto_codex2026-11-02 14:38:42cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measurednot measured15 m 5 s507,66028,184535,84421agentMy assertion there forgot that `a`'s missing days are also planned and `b@1` is satisfied by history. Let me make the harness self-reporting so mismatches are diagnosable.
run-20261102-145348-58a7a3f3knowledge_enabled=True, model=auto_codex2026-11-02 14:53:48cadence-catchup-001@1.0.0codex@codex-cli 0.166.01completedpartial0.92012 m 29 s836,66723,155859,82230none—
run-20261102-150618-18c32d85knowledge_enabled=True, model=auto_codex2026-11-02 15:06:18cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measurednot measured15 m 4 s543,45728,631572,08823agentThe scratch script itself is buggy. Let me print actual values to debug quickly.
run-20261102-152123-401b3de4knowledge_enabled=True, model=auto_codex2026-11-02 15:21:23cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measurednot measured15 m 5 s405,54824,862430,41022agentMost failures are test-harness artifacts, not implementation bugs — let me fix the script (tz-aware string formatting, wrong window for the staggered case, empty `reasons()` on a fully-planned chain) and re-run.
run-20261102-164738-43ff8923knowledge_enabled=False, model=auto_codex2026-11-02 16:47:38freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9416 m 29 s254,4259,577264,00214none—
run-20261102-165407-d907f577knowledge_enabled=False, model=auto_codex2026-11-02 16:54:07freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94111 m 28 s361,98619,008380,99417none—
run-20261102-170536-da2abfe7knowledge_enabled=False, model=auto_codex2026-11-02 17:05:36freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0008 m 7 s389,74114,953404,69420none—
run-20261102-171345-07e43bdbknowledge_enabled=True, model=auto_codex2026-11-02 17:13:45freight-shop-001@1.0.0codex@codex-cli 0.166.01timeoutnot measurednot measured15 m 3 s581,22026,757607,97724agentAll 19 spec checks pass. Final verification — full suite plus a review of the finished body:
run-20261102-172849-b26fa228knowledge_enabled=True, model=auto_codex2026-11-02 17:28:49freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94110 m 30 s515,52217,044532,56623none—
run-20261102-173920-82f7a48cknowledge_enabled=True, model=auto_codex2026-11-02 17:39:20freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00011 m 43 s676,05622,481698,53726none—
run-20261102-191101-7b74b38fknowledge_enabled=False, model=auto_codex2026-11-02 19:11:01ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9509 m 56 s392,28314,473406,75620none—
run-20261102-192057-a14677ebknowledge_enabled=False, model=auto_codex2026-11-02 19:20:57ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0008 m 34 s439,89515,003454,89819none—
run-20261102-192932-7bb86699knowledge_enabled=False, model=auto_codex2026-11-02 19:29:32ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0008 m 49 s435,34914,597449,94621none—
run-20261102-193822-f24e2c68knowledge_enabled=True, model=auto_codex2026-11-02 19:38:22ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.01completedpassed1.00010 m 41 s452,35117,677470,02821none—
run-20261102-194904-cb1d7f72knowledge_enabled=True, model=auto_codex2026-11-02 19:49:04ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0008 m 9 s439,70212,057451,75921none—
run-20261102-195713-1edd6fafknowledge_enabled=True, model=auto_codex2026-11-02 19:57:13ledgerlite-reconcile-001@1.0.0codex@codex-cli 0.166.03completedpartial0.95011 m 48 s732,53118,140750,67127none—
run-20261102-205102-77cec3caknowledge_enabled=False, model=auto_codex2026-11-02 20:51:02stockpile-fefo-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 44 s165,9345,422171,35611none—
run-20261102-205547-64ffb964knowledge_enabled=False, model=auto_codex2026-11-02 20:55:47stockpile-fefo-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0005 m 56 s195,3258,161203,48613none—
run-20261102-210144-40341822knowledge_enabled=False, model=auto_codex2026-11-02 21:01:44stockpile-fefo-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 2 s137,8594,431142,29011none—
run-20261102-210547-94d6a5ffknowledge_enabled=True, model=auto_codex2026-11-02 21:05:47stockpile-fefo-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 15 s159,1194,648163,76713none—
run-20261102-211003-7474c6a3knowledge_enabled=True, model=auto_codex2026-11-02 21:10:03stockpile-fefo-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 3 s468,1798,967477,14625none—
run-20261102-211707-b1b04f82knowledge_enabled=True, model=auto_codex2026-11-02 21:17:07stockpile-fefo-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0006 m 27 s288,85010,442299,29217none—

Not verified

Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
kindsubjectstatusrunnote
pluginagentic_knowledgeunsupportedrun-20261102-021828-a3b13607LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-021828-a3b13607descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-022315-259a16a5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-022315-259a16a5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-022715-0f5b5375LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-022715-0f5b5375descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023143-af17689aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023143-af17689adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023515-f1dff616LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023515-f1dff616descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023813-b7d6ced3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023813-b7d6ced3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-030330-6e680c03LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-030330-6e680c03descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-030620-307d982cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-030620-307d982cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-031005-8ee792e8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-031005-8ee792e8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-031245-d48061aaLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-031245-d48061aadescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-032017-d7e7635dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-032017-d7e7635ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-032654-eef72cc9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-032654-eef72cc9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-042003-4e77ac85LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-042003-4e77ac85descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-042815-65e2ad9bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-042815-65e2ad9bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-043507-07326b31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-043507-07326b31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-044616-5ced7f24LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-044616-5ced7f24descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-045137-ae782a86LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-045137-ae782a86descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-045951-9062760dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-045951-9062760ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-060259-4681bb55LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-060259-4681bb55descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-061803-ca793f25LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-061803-ca793f25descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-063306-62006f1cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-063306-62006f1cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-063921-31a5efefLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-063921-31a5efefdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-064343-33d90543LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-064343-33d90543descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-064601-0d71057aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-064601-0d71057adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-072154-ce0a96c9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-072154-ce0a96c9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-073119-046c63c5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-073119-046c63c5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-074114-fb309dd3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-074114-fb309dd3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-074537-1abe2bd8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-074537-1abe2bd8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-075327-d3b09ae5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-075327-d3b09ae5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-075736-7dc8b5faLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-075736-7dc8b5fadescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084427-5c4e6c25LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084427-5c4e6c25descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084722-12cb8519LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084722-12cb8519descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084925-db233c9dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084925-db233c9ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-085126-7081e5a7LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-085126-7081e5a7descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-085717-2d40efc9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-085717-2d40efc9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-090053-801966e8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-090053-801966e8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-104150-ee470964LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-104150-ee470964descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-104527-df556abcLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-104527-df556abcdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105101-7f0ea089LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105101-7f0ea089descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105332-509d420cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105332-509d420cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105924-5844ec5cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105924-5844ec5cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-110711-12e9e01eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-110711-12e9e01edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-113507-5543ffe1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-113507-5543ffe1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114156-1ff0ba59LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114156-1ff0ba59descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114446-b3513377LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114446-b3513377descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114752-9f3f4f92LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114752-9f3f4f92descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115051-39be5247LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115051-39be5247descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115611-ee478152LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115611-ee478152descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122054-f8985461LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122054-f8985461descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122358-fec2acfeLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122358-fec2acfedescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122856-43bd96e6LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122856-43bd96e6descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-123353-08bae5f2LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-123353-08bae5f2descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-123722-abf5b6a0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-123722-abf5b6a0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-124013-4e335fc0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-124013-4e335fc0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-141204-1573e7b2LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-141204-1573e7b2descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-142710-0136dc94LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-142710-0136dc94descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-143842-25bc3410LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-143842-25bc3410descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-145348-58a7a3f3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-145348-58a7a3f3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-150618-18c32d85LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-150618-18c32d85descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-152123-401b3de4LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-152123-401b3de4descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-164738-43ff8923LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-164738-43ff8923descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-165407-d907f577LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-165407-d907f577descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-170536-da2abfe7LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-170536-da2abfe7descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-171345-07e43bdbLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-171345-07e43bdbdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-172849-b26fa228LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-172849-b26fa228descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-173920-82f7a48cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-173920-82f7a48cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-191101-7b74b38fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-191101-7b74b38fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-192057-a14677ebLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-192057-a14677ebdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-192932-7bb86699LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-192932-7bb86699descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-193822-f24e2c68LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-193822-f24e2c68descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-194904-cb1d7f72LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-194904-cb1d7f72descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-195713-1edd6fafLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-195713-1edd6fafdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-205102-77cec3caLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-205102-77cec3cadescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-205547-64ffb964LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-205547-64ffb964descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-210144-40341822LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-210144-40341822descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-210547-94d6a5ffLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-210547-94d6a5ffdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-211003-7474c6a3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-211003-7474c6a3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-211707-b1b04f82LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-211707-b1b04f82descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
modelauto_codexunverifiedrun-20261102-021828-a3b13607
modelauto_codexunverifiedrun-20261102-022315-259a16a5
modelauto_codexunverifiedrun-20261102-022715-0f5b5375
modelauto_codexunverifiedrun-20261102-023143-af17689a
modelauto_codexunverifiedrun-20261102-023515-f1dff616
modelauto_codexunverifiedrun-20261102-023813-b7d6ced3
modelauto_codexunverifiedrun-20261102-030330-6e680c03
modelauto_codexunverifiedrun-20261102-030620-307d982c
modelauto_codexunverifiedrun-20261102-031005-8ee792e8
modelauto_codexunverifiedrun-20261102-031245-d48061aa
modelauto_codexunverifiedrun-20261102-032017-d7e7635d
modelauto_codexunverifiedrun-20261102-032654-eef72cc9
modelauto_codexunverifiedrun-20261102-042003-4e77ac85
modelauto_codexunverifiedrun-20261102-042815-65e2ad9b
modelauto_codexunverifiedrun-20261102-043507-07326b31
modelauto_codexunverifiedrun-20261102-044616-5ced7f24
modelauto_codexunverifiedrun-20261102-045137-ae782a86
modelauto_codexunverifiedrun-20261102-045951-9062760d
modelauto_codexunverifiedrun-20261102-060259-4681bb55
modelauto_codexunverifiedrun-20261102-061803-ca793f25
modelauto_codexunverifiedrun-20261102-063306-62006f1c
modelauto_codexunverifiedrun-20261102-063921-31a5efef
modelauto_codexunverifiedrun-20261102-064343-33d90543
modelauto_codexunverifiedrun-20261102-064601-0d71057a
modelauto_codexunverifiedrun-20261102-072154-ce0a96c9
modelauto_codexunverifiedrun-20261102-073119-046c63c5
modelauto_codexunverifiedrun-20261102-074114-fb309dd3
modelauto_codexunverifiedrun-20261102-074537-1abe2bd8
modelauto_codexunverifiedrun-20261102-075327-d3b09ae5
modelauto_codexunverifiedrun-20261102-075736-7dc8b5fa
modelauto_codexunverifiedrun-20261102-084427-5c4e6c25
modelauto_codexunverifiedrun-20261102-084722-12cb8519
modelauto_codexunverifiedrun-20261102-084925-db233c9d
modelauto_codexunverifiedrun-20261102-085126-7081e5a7
modelauto_codexunverifiedrun-20261102-085717-2d40efc9
modelauto_codexunverifiedrun-20261102-090053-801966e8
modelauto_codexunverifiedrun-20261102-104150-ee470964
modelauto_codexunverifiedrun-20261102-104527-df556abc
modelauto_codexunverifiedrun-20261102-105101-7f0ea089
modelauto_codexunverifiedrun-20261102-105332-509d420c
modelauto_codexunverifiedrun-20261102-105924-5844ec5c
modelauto_codexunverifiedrun-20261102-110711-12e9e01e
modelauto_codexunverifiedrun-20261102-113507-5543ffe1
modelauto_codexunverifiedrun-20261102-114156-1ff0ba59
modelauto_codexunverifiedrun-20261102-114446-b3513377
modelauto_codexunverifiedrun-20261102-114752-9f3f4f92
modelauto_codexunverifiedrun-20261102-115051-39be5247
modelauto_codexunverifiedrun-20261102-115611-ee478152
modelauto_codexunverifiedrun-20261102-122054-f8985461
modelauto_codexunverifiedrun-20261102-122358-fec2acfe
modelauto_codexunverifiedrun-20261102-122856-43bd96e6
modelauto_codexunverifiedrun-20261102-123353-08bae5f2
modelauto_codexunverifiedrun-20261102-123722-abf5b6a0
modelauto_codexunverifiedrun-20261102-124013-4e335fc0
modelauto_codexunverifiedrun-20261102-141204-1573e7b2
modelauto_codexunverifiedrun-20261102-142710-0136dc94
modelauto_codexunverifiedrun-20261102-143842-25bc3410
modelauto_codexunverifiedrun-20261102-145348-58a7a3f3
modelauto_codexunverifiedrun-20261102-150618-18c32d85
modelauto_codexunverifiedrun-20261102-152123-401b3de4
modelauto_codexunverifiedrun-20261102-164738-43ff8923
modelauto_codexunverifiedrun-20261102-165407-d907f577
modelauto_codexunverifiedrun-20261102-170536-da2abfe7
modelauto_codexunverifiedrun-20261102-171345-07e43bdb
modelauto_codexunverifiedrun-20261102-172849-b26fa228
modelauto_codexunverifiedrun-20261102-173920-82f7a48c
modelauto_codexunverifiedrun-20261102-191101-7b74b38f
modelauto_codexunverifiedrun-20261102-192057-a14677eb
modelauto_codexunverifiedrun-20261102-192932-7bb86699
modelauto_codexunverifiedrun-20261102-193822-f24e2c68
modelauto_codexunverifiedrun-20261102-194904-cb1d7f72
modelauto_codexunverifiedrun-20261102-195713-1edd6faf
modelauto_codexunverifiedrun-20261102-205102-77cec3ca
modelauto_codexunverifiedrun-20261102-205547-64ffb964
modelauto_codexunverifiedrun-20261102-210144-40341822
modelauto_codexunverifiedrun-20261102-210547-94d6a5ff
modelauto_codexunverifiedrun-20261102-211003-7474c6a3
modelauto_codexunverifiedrun-20261102-211707-b1b04f82