AK-Benchbenchmark report

model

qwen/Qwen3.8-27B

runs
33
evaluated
28
success rate
78.8%
mean time
5 m 28 s
input tokens
9,379,318
generated tokens
211,460
tokens
9,590,778
tool calls
525

Experiments this subject took part in

experimenttitletyperunsevaluatedpassedsuccess ratemean timeinput tokensgenerated tokenstotal tokenstool calls
router-config-comparison@1.0.0Router models versus Auto Codex, with and without knowledgeconfiguration33282678.8%5 m 28 s9,379,318211,4609,590,778525

Tasks this subject worked

taskcategorydifficultyrunspassedsuccess ratemean timeinput tokensgenerated tokenstotal tokenstool calls
bookshop-stock-002@1.0.0bug_fixexpert33100.0%3 m 20 s367,9758,262376,23732
bookshop-tiers-001@1.0.0bug_fixhard33100.0%2 m 15 s209,4903,543213,03320
cadence-catchup-001@1.0.0new_featureexpert30not measured15 m 5 s3,647,58959,9043,707,493125
cadence-takeover-001@1.0.0bug_fixexpert33100.0%3 m 4 s437,5838,383445,96636
freight-shop-001@1.0.0new_featureexpert300.0%11 m 47 s1,263,48452,8181,316,30260
ledgerlite-rates-001@1.0.0bug_fixexpert33100.0%2 m 43 s330,4417,362337,80331
notes-search-001@1.0.0new_featurehard33100.0%7 m 22 s913,49428,854942,34860
notes-sync-001@1.0.0new_featureexpert33100.0%3 m 30 s360,42810,079370,50732
slugify-001@1.0.0new_featureeasy3266.7%6 m 34 s1,191,56422,3091,213,87371
stockpile-writeoff-001@1.0.0bug_fixexpert33100.0%2 m 28 s393,1745,612398,78629
wordcount-001@1.0.0bug_fixeasy33100.0%2 m 0 s264,0964,334268,43029

model observations

runrequestedobservedsourceverification
run-20261102-015302-e1907b59qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-015702-033aab98qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-020002-c8680ac1qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-024213-cd12e80fqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-024414-b4a4c0f1qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-024637-153cbef0qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-033745-147a6170qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-034056-a469ad46qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-034231-ceec4cf9qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-050517-4824113cqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-051140-154e7756qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-051856-7a01f2f0qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-065152-be03d69aqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-065424-0122485bqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-065823-56d0518eqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-080204-89ac58c6qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-080410-d2c89897qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-081913-0789e06aqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-102224-77a554a3qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-102450-4c4dafd8qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-102846-f9da52d1qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-111029-a9c04726qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-111326-3c584bd3qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-111537-b9ab2fefqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-115850-e5f2348fqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-120221-58de15afqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-120435-e4b44447qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-124303-45bdfb12qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-125808-280ac90dqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-131314-47751b92qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-153629-de5ac66dqwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-154610-09481f31qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified
run-20261102-160115-cb48ab31qwen/Qwen3.8-27Bqwen/Qwen3.8-27Bagent_reportedunverified

Runs

in the order they started; the parameters column is the configuration each run was executed under

runparametersstartedtaskagentrepetitionstatusverdictscoretimeinput tokensgenerated tokenstotal tokenstool callsfailure classerror
run-20261102-015302-e1907b59knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 01:53:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 59 s139,5133,865143,37813
run-20261102-015702-033aab98knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 01:57:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 59 s110,1852,205112,39010
run-20261102-020002-c8680ac1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:00:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 1 s118,2772,192120,4699
run-20261102-024213-cd12e80fknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:42:13bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0001 m 60 s51,44782652,2735
run-20261102-024414-b4a4c0f1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:44:14bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 22 s73,2531,40774,6607
run-20261102-024637-153cbef0knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:46:37bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 22 s84,7901,31086,1008
run-20261102-033745-147a6170knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:37:45wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 10 s165,8752,586168,46118
run-20261102-034056-a469ad46knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:40:56wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0001 m 35 s53,8831,04554,9286
run-20261102-034231-ceec4cf9knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:42:31wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 16 s44,33870345,0415
run-20261102-050517-4824113cknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:05:17notes-search-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 23 s257,1027,946265,04819
run-20261102-051140-154e7756knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:11:40notes-search-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 15 s322,2559,563331,81821
run-20261102-051856-7a01f2f0knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:18:56notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0008 m 27 s334,13711,345345,48220
run-20261102-065152-be03d69aknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:51:52notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 32 s68,6912,28470,9757
run-20261102-065424-0122485bknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:54:24notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 58 s147,5283,954151,48213
run-20261102-065823-56d0518eknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:58:23notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 1 s144,2093,841148,05012
run-20261102-080204-89ac58c6knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:02:04slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 5 s88,7601,40690,1669
run-20261102-080410-d2c89897knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:04:10slugify-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s989,57118,7871,008,35851agentI'm looking at the test results more carefully now—most of them are passing, but there are two specific cases where the hyphen handling is producing unexpected triple hyphens instead of the expected output. The issue seems to be that when I'm building the test strings with the hyphen character, something about how the input is being processed is causing the hyphens to multiply in the output.
run-20261102-081913-0789e06aknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:19:13slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 35 s113,2332,116115,34911
run-20261102-102224-77a554a3knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:22:24cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 25 s87,4412,06289,5039
run-20261102-102450-4c4dafd8knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:24:50cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 56 s184,0373,928187,96513
run-20261102-102846-f9da52d1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:28:46cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 53 s166,1052,393168,49814
run-20261102-111029-a9c04726knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:10:29ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 57 s118,8372,616121,45312
run-20261102-111326-3c584bd3knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:13:26ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 10 s81,2801,90383,1837
run-20261102-111537-b9ab2fefknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:15:37ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 1 s130,3242,843133,16712
run-20261102-115850-e5f2348fknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:58:50stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 30 s174,8333,032177,86512
run-20261102-120221-58de15afknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:02:21stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 13 s131,9341,632133,56610
run-20261102-120435-e4b44447knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:04:35stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 40 s86,40794887,3557
run-20261102-124303-45bdfb12knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:43:03cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 4 s1,030,27421,3011,051,57539agentSuite is green. Let me re-verify the full spec behavior with the final implementation, including a few extra edge cases I hadn't covered (staggered schedules, attempts, DST).
run-20261102-125808-280ac90dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:58:08cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 5 s823,34718,432841,77933agentThe implementation is complete and syntactically valid. Let me run the full test suite and my spec-based checks to confirm everything is green.
run-20261102-131314-47751b92knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 13:13:14cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s1,793,96820,1711,814,13953agentNow let me fix my test's history times (they must match the 06:00 occurrence instants, per "at that exact logical time") and re-run.
run-20261102-153629-de5ac66dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:36:29freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9419 m 40 s514,93012,666527,59625
run-20261102-154610-09481f31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:46:10freight-shop-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 3 s345,90824,250370,15818agentThe code works correctly — my test had the wrong assumption. I forgot the default divisor is 5000, so 130×30×20 gives volumetric 15.6 kg (billed 16.0 kg), not 3.0 kg. The linehaul is 4200, surcharge 500, total 4700 — and the group logic worked perfectly: `oversize` won, `heavy` was suppressed, winner named.
run-20261102-160115-cb48ab31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 16:01:15freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpartial0.94110 m 38 s402,64615,902418,54817

Not verified

Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
kindsubjectstatusrunnote
pluginagentic_knowledgeunsupportedrun-20261102-015302-e1907b59LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-015302-e1907b59descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-015702-033aab98LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-015702-033aab98descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-020002-c8680ac1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-020002-c8680ac1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024213-cd12e80fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024213-cd12e80fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024414-b4a4c0f1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024414-b4a4c0f1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024637-153cbef0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024637-153cbef0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-033745-147a6170LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-033745-147a6170descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034056-a469ad46LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034056-a469ad46descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034231-ceec4cf9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034231-ceec4cf9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-050517-4824113cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-050517-4824113cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-051140-154e7756LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-051140-154e7756descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-051856-7a01f2f0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-051856-7a01f2f0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065152-be03d69aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065152-be03d69adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065424-0122485bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065424-0122485bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065823-56d0518eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065823-56d0518edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-080204-89ac58c6LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-080204-89ac58c6descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-080410-d2c89897LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-080410-d2c89897descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-081913-0789e06aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-081913-0789e06adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102224-77a554a3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102224-77a554a3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102450-4c4dafd8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102450-4c4dafd8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102846-f9da52d1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102846-f9da52d1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111029-a9c04726LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111029-a9c04726descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111326-3c584bd3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111326-3c584bd3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111537-b9ab2fefLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111537-b9ab2fefdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115850-e5f2348fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115850-e5f2348fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-120221-58de15afLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-120221-58de15afdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-120435-e4b44447LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-120435-e4b44447descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-124303-45bdfb12LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-124303-45bdfb12descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-125808-280ac90dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-125808-280ac90ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-131314-47751b92LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-131314-47751b92descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-153629-de5ac66dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-153629-de5ac66ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-154610-09481f31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-154610-09481f31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-160115-cb48ab31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-160115-cb48ab31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-015302-e1907b59
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-015702-033aab98
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-020002-c8680ac1
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024213-cd12e80f
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024414-b4a4c0f1
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024637-153cbef0
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-033745-147a6170
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-034056-a469ad46
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-034231-ceec4cf9
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-050517-4824113c
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-051140-154e7756
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-051856-7a01f2f0
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065152-be03d69a
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065424-0122485b
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065823-56d0518e
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-080204-89ac58c6
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-080410-d2c89897
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-081913-0789e06a
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102224-77a554a3
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102450-4c4dafd8
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102846-f9da52d1
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111029-a9c04726
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111326-3c584bd3
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111537-b9ab2fef
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-115850-e5f2348f
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-120221-58de15af
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-120435-e4b44447
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-124303-45bdfb12
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-125808-280ac90d
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-131314-47751b92
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-153629-de5ac66d
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-154610-09481f31
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-160115-cb48ab31