Run
run-20261102-190125-007b2709
verdict
partial
score
0.950
time
9 m 34 s
input tokens
528,145
generated tokens
18,654
tokens
546,799
tool calls
17
status
completed
Where this run belongs
| field | value |
|---|---|
| experiment | router-config-comparison@1.0.0 |
| task | ledgerlite-reconcile-001@1.0.0 |
| parameters | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next |
| variant | v-e816befad22e |
| agent | codex@codex-cli 0.166.0 |
| runtime | llm-router |
| mode | router |
| repetition | 3 |
| session | 01a19da3-a26b-7e01-a007-e9ad909cb313 |
| manifest digest | sha256:dd26be7a530b7bf7abbda8fcd3100c6c1bf4d5283af4bcc9f4a8725452455102 |
Evaluation
| field | value |
|---|---|
| verdict | partial |
| score | 0.9500 |
| tests passed | 19 |
| tests failed | 1 |
| tests total | 20 |
What the agent reported
| field | value |
|---|---|
| started | 2026-11-02T19:01:25.938149 |
| finished | 2026-11-02T19:11:00.222224 |
| wall clock | 9 m 34 s |
| input tokens | 528,145 |
| total tokens | 546,799 |
| tool calls | 17 |
| exit code | 0 |
| failure class | none |
| error | none |
Model
| requested | observed | source | verification |
|---|---|---|---|
| qwen/Qwen3.8-Flash-Next | qwen/Qwen3.8-Flash-Next | agent_reported | unverified |
Plugins observed
| plugin | version | enabled | verification | note |
|---|---|---|---|---|
| agentic_knowledge | 1.0.0 | no | unsupported | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| agentic_routing_codex | 1.0.0 | no | unsupported | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
Artifacts
| kind | path | checksum |
|---|---|---|
| manifest | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-190125-937118-8982c5/manifest.json | sha256:1f5277cc18acdd3d8b7ce64e336af997dad9959fbe52f425a6bb8ff25933e01b |
| evaluation_output | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-190125-937118-8982c5/evaluation/pytest-output.txt | sha256:dadbbda9f44fb8402aa4f709c6d989e1e36150b1ea622964264d0683128006fc |
| junit | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-190125-937118-8982c5/evaluation/junit.xml | sha256:84322b4cd04cd81623f35b439cc2e1504a5b89c8b63b427c3bff91e4be83161e |
| run_record | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-190125-937118-8982c5/run_record.json | sha256:c0c4119900920822c44b4c31f15564d59b0a6f78b8051e000f56697a0db92268 |
Not verified
Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
| kind | subject | status | run | note |
|---|---|---|---|---|
| plugin | agentic_knowledge | unsupported | run-20261102-190125-007b2709 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-190125-007b2709 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-190125-007b2709 |