Task
stockpile-writeoff-001@1.0.0
runs
12
success rate
100.0%
mean time
3 m 40 s
input tokens
2,345,811
generated tokens
47,327
tokens
2,393,138
tool calls
156
What the task asks
A write-off destroys the reserved part of an expired lot
Stock.write_off_expired removes the reserved quantity of an expired lot along with its free quantity, so an order that is already holding stock on the lot is left with nothing to commit. Restore the documented rule that a write-off removes only the free quantity and leaves the lot alive while a claim still rides on it.
full description (markdown source)
# A write-off destroys the reserved part of an expired lot `Stock.write_off_expired` in `src/stockpile/stock.py` answers one question: which of the expired lots' quantity can go away? The rule, as documented on the method: - a write-off removes only what is **free** — quantity nobody is holding; - committed quantity is already off the shelf, so it is never touched; - reserved quantity is somebody's claim, so it is never touched: the lot stays alive while a claim still rides on it, because the warehouse has to be able to commit the order it already promised. The defect zeroes the reserved quantity along with the free one. An order that is holding stock on a lot that has since expired is left with nothing to commit — no error at the write-off, just a claim that no longer corresponds to anything. The repository's own suite is green on the pinned commit, because it only ever writes off an expired lot that carries no reservation, for which keeping the reserved part and destroying it are the same thing. The defect only shows up when a reservation is still riding on a lot that has expired.
Constraints
- do not change the public API of the stockpile package
- do not modify the repository test suite under tests/
- do not change how reservations, commits or transfers work
- do not add third-party dependencies
Recorded identity
| field | value |
|---|---|
| uid | stockpile-writeoff-001@1.0.0 |
| category | bug_fix |
| difficulty | expert |
| evaluator | pytest_evaluator |
| base commit | HEAD |
| repository | repo-747f8117bee5bab7 |
| snapshot digest | sha256:f18166b57d49f1ac8badc5c2047738fcfd85d6fa3f8b673f831e05f82eae456b |
| source | datasets/_sources/stockpile |
| ref | HEAD |
| mutation | none |
| timeout | 900 s |
| hidden tests | hidden_tests |
| public tests | public_tests |
| definition digest | sha256:f18166b57d49f1ac8badc5c2047738fcfd85d6fa3f8b673f831e05f82eae456b |
| definition path | /mnt/data2/dev/develop/ak-bench/datasets/bug_fix/stockpile-writeoff-001 |
Runs of this task
in the order they started; the parameters column is the configuration each run was executed under
| run | parameters | started | agent | repetition | status | verdict | score | time | input tokens | generated tokens | total tokens | tool calls | failure class | error |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| run-20261102-115850-e5f2348f | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 11:58:50 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 30 s | 174,833 | 3,032 | 177,865 | 12 | ||
| run-20261102-120221-58de15af | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:02:21 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 13 s | 131,934 | 1,632 | 133,566 | 10 | ||
| run-20261102-120435-e4b44447 | knowledge_enabled=False, model=qwen/Qwen3.8-27B | 2026-11-02 12:04:35 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 1 m 40 s | 86,407 | 948 | 87,355 | 7 | ||
| run-20261102-120616-d577d4b1 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:06:16 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 5 m 15 s | 256,446 | 8,216 | 264,662 | 16 | ||
| run-20261102-121131-13e4a8b5 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:11:31 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 3 m 55 s | 216,253 | 5,255 | 221,508 | 12 | ||
| run-20261102-121528-03d9f220 | knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next | 2026-11-02 12:15:28 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 5 m 26 s | 293,346 | 8,697 | 302,043 | 17 | ||
| run-20261102-122054-f8985461 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:20:54 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 3 s | 130,716 | 3,022 | 133,738 | 10 | ||
| run-20261102-122358-fec2acfe | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:23:58 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 4 m 57 s | 284,384 | 4,090 | 288,474 | 16 | ||
| run-20261102-122856-43bd96e6 | knowledge_enabled=False, model=auto_codex | 2026-11-02 12:28:56 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 4 m 56 s | 290,116 | 5,054 | 295,170 | 18 | ||
| run-20261102-123353-08bae5f2 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:33:53 | codex@codex-cli 0.166.0 | 1 | completed | passed | 1.000 | 3 m 28 s | 174,055 | 3,204 | 177,259 | 12 | ||
| run-20261102-123722-abf5b6a0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:37:22 | codex@codex-cli 0.166.0 | 2 | completed | passed | 1.000 | 2 m 50 s | 159,452 | 1,673 | 161,125 | 12 | ||
| run-20261102-124013-4e335fc0 | knowledge_enabled=True, model=auto_codex | 2026-11-02 12:40:13 | codex@codex-cli 0.166.0 | 3 | completed | passed | 1.000 | 2 m 48 s | 147,869 | 2,504 | 150,373 | 14 |
Not verified
Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
| kind | subject | status | run | note |
|---|---|---|---|---|
| plugin | agentic_knowledge | unsupported | run-20261102-115850-e5f2348f | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-115850-e5f2348f | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120221-58de15af | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120221-58de15af | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120435-e4b44447 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120435-e4b44447 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-120616-d577d4b1 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-120616-d577d4b1 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121131-13e4a8b5 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121131-13e4a8b5 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-121528-03d9f220 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-121528-03d9f220 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122054-f8985461 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122054-f8985461 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122358-fec2acfe | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122358-fec2acfe | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-122856-43bd96e6 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-122856-43bd96e6 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123353-08bae5f2 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123353-08bae5f2 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-123722-abf5b6a0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-123722-abf5b6a0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| plugin | agentic_knowledge | unsupported | run-20261102-124013-4e335fc0 | LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, … |
| plugin | agentic_routing_codex | unsupported | run-20261102-124013-4e335fc0 | descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp … |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-115850-e5f2348f | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120221-58de15af | |
| model | qwen/Qwen3.8-27B | unverified | run-20261102-120435-e4b44447 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-120616-d577d4b1 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121131-13e4a8b5 | |
| model | qwen/Qwen3.8-Flash-Next | unverified | run-20261102-121528-03d9f220 | |
| model | auto_codex | unverified | run-20261102-122054-f8985461 | |
| model | auto_codex | unverified | run-20261102-122358-fec2acfe | |
| model | auto_codex | unverified | run-20261102-122856-43bd96e6 | |
| model | auto_codex | unverified | run-20261102-123353-08bae5f2 | |
| model | auto_codex | unverified | run-20261102-123722-abf5b6a0 | |
| model | auto_codex | unverified | run-20261102-124013-4e335fc0 |