Run
run-20261102-145348-58a7a3f3
verdict
partial
score
0.920
time
12 m 29 s
input tokens
836,667
generated tokens
23,155
tokens
859,822
tool calls
30
status
completed
Where this run belongs
| field | value |
|---|---|
| experiment | router-config-comparison@1.0.0 |
| task | cadence-catchup-001@1.0.0 |
| parameters | knowledge_enabled=True, model=auto_codex |
| variant | v-dccd72463be1 |
| agent | codex@codex-cli 0.166.0 |
| runtime | llm-router |
| mode | router |
| repetition | 1 |
| session | 01a19cc0-ee63-76d1-9204-c9d142cfadb9 |
| manifest digest | sha256:e9861c962454dae0f33f3d5e144361b8b6495efb56b4f8e4d6e8eab688bb59fc |
Evaluation
| field | value |
|---|---|
| verdict | partial |
| score | 0.9200 |
| tests passed | 23 |
| tests failed | 2 |
| tests total | 25 |
What the agent reported
| field | value |
|---|---|
| started | 2026-11-02T14:53:48.079224 |
| finished | 2026-11-02T15:06:17.256237 |
| wall clock | 12 m 29 s |
| input tokens | 836,667 |
| total tokens | 859,822 |
| tool calls | 30 |
| exit code | 0 |
| failure class | none |
| error |
Model
| requested | observed | source | verification |
|---|---|---|---|
| auto_codex | auto_codex | agent_reported | unverified |
Plugins observed
| plugin | version | enabled | verification | note |
|---|---|---|---|---|
| agentic_knowledge | 1.0.0 | no | unsupported | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| agentic_routing_codex | 1.0.0 | no | unsupported | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
Artifacts
| kind | path | checksum |
|---|---|---|
| manifest | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/manifest.json | sha256:c7beff4a9124d00e7754cb7d64ff705b2669d2cc00b7432bb2dfe9a723d81c54 |
| evaluation_output | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/evaluation/pytest-output.txt | sha256:0314f1b7134a5e7b5c45cfc5c0eb31794c4bd20c5810332bba16a28a0290e0f0 |
| junit | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/evaluation/junit.xml | sha256:e706c7504040d11760e0682e996ae1451b012205022e04ff52186024f6f0bf1a |
| run_record | /mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/run_record.json | sha256:e0f7fecbb591cf3211b89e05a1dec627f4edc4f4de3df1bb9c924e6b6746e349 |
Not verified
Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
| kind | subject | status | run | note |
|---|---|---|---|---|
| plugin | agentic_knowledge | unsupported | run-20261102-145348-58a7a3f3 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-145348-58a7a3f3 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| model | auto_codex | unverified | run-20261102-145348-58a7a3f3 |