AK-Benchbenchmark report

Experiment

router-config-comparison@1.0.0 - Router models versus Auto Codex, with and without knowledge

Four configurations asked for side by side — two router models and the Auto Codex alias with knowledge off and on — on every task of the dataset. The matrix is explicit rather than a full product: a full one would add arms nobody reads, and every arm costs real router time. Knowledge here is a request, not a confirmed state: the shared router refuses per-run plugin control, so the knowledge arm records the value it asked for and an unverified plugin state, and its ranking reads as "the auto_codex alias, with knowledge asked for".

runs
132
evaluated
114
success rate
80.3%
mean time
6 m 39 s
input tokens
32,241,345
generated tokens
1,020,410
tokens
33,261,755
tool calls
1,935

Configuration ranking

placeconfigurationrecordingrunsevaluatedsuccess ratemean timemean input tokensmean generated tokensmean total tokensmean tool callsagainst the baseline
1knowledge_enabled=True, model=auto_codexbookshop-stock-002, bookshop-tiers-001, cadence-catchup-001 +8
2 recordings
2026-11-02 02:31 → 2026-11-02 17:51		3330
84.8%
6 m 25 s218,4907,243225,73414success +6%, time 1.17x, tokens 0.78x
2knowledge_enabled=False, model=auto_codexbookshop-stock-002, bookshop-tiers-001, cadence-catchup-001 +8
2 recordings
2026-11-02 02:18 → 2026-11-02 17:13		3329
81.8%
6 m 41 s196,2306,933203,16313success +3%, time 1.22x, tokens 0.70x
3knowledge_enabled=False, model=qwen/Qwen3.8-27B baselinebookshop-stock-002, bookshop-tiers-001, cadence-catchup-001 +8
2 recordings
2026-11-02 01:53 → 2026-11-02 16:11		3328
78.8%
5 m 28 s284,2226,408290,63016
4knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Nextbookshop-stock-002, bookshop-tiers-001, cadence-catchup-001 +8
2 recordings
2026-11-02 02:03 → 2026-11-02 16:47		3327
75.8%
8 m 0 s278,06810,337288,40516success -3%, time 1.46x, tokens 0.99x

Success rate

knowledge_enabled=True, model=auto_codex
knowledge_enabled=False, model=auto_codex
knowledge_enabled=False, model=qwen/Qwen3.8-27B
knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next

Mean wall-clock time

knowledge_enabled=True, model=auto_codex
knowledge_enabled=False, model=auto_codex
knowledge_enabled=False, model=qwen/Qwen3.8-27B
knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next

each bar is measured against the largest value in its own column; time and tokens are compared only within this experiment, and a row is one configuration over all of its recordings. The token and tool-call columns are means per run, not sums

Descriptor and validity

fieldvalue
uidrouter-config-comparison@1.0.0
typeconfiguration
descriptorrouter-config-comparison@1.0.0
config hashsha256:784ceb045d7e7ebc9fb5330a7ff29810d3320a6febc57e0e94b4ec20e4e8d604
validityincomplete
created2026-11-02T01:53:02.672625
updated2026-11-02T17:51:03.418443

Variants

variantvaluesconfig hashbaselineruns
v-4d3337664165knowledge_enabled=False, model=qwen/Qwen3.8-27Bsha256:8da91d2e41ca62fb67cac3bde630ea18000e4d68c0e62430ffda49d61f483fa9yes15
v-5dfe3345dc0fknowledge_enabled=False, model=qwen/Qwen3.8-27Bsha256:d5703fbe3c7ec9075f0ab4b8a548fc54171589d978b6492e14c31d13b681646byes18
v-1bd895ea9679knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Nextsha256:18f8d0b48e31c8a666519c0994931d89919e7b85e8548a19eb7f9bbc601c7d71no18
v-e816befad22eknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Nextsha256:0aee5d2eab7cab432cd594b511295ef358b950541b6b1f85a17ee1a0a4e96949no15
v-17e7e69bf087knowledge_enabled=False, model=auto_codexsha256:850faa471d75cee92cde85cb1090df5b7235eb3ae61d1d64e9bfd74648f89719no18
v-5f6f603add50knowledge_enabled=False, model=auto_codexsha256:9157803bd654cf57d23f1d0537a8173a182e549942bb454be6dae74b44ee7386no15
v-a0ed565bcc26knowledge_enabled=True, model=auto_codexsha256:9ffbba6932454dede1a53082a2faeb161bf15b8d342ee4237cc6bfdacb20e80cno18
v-dccd72463be1knowledge_enabled=True, model=auto_codexsha256:82ce525d9ca9c06d2d26e107882e87de84783989996d9507f54e846d37a2f90dno15

a variant is one recording of one configuration; the ranking above counts the configurations, so several of these rows can share one ranking row — a uid opens that recording on its own page

Pinned descriptors

kindidversiondigest
agentcodex1.0.0sha256:b2556b7d5d0ea9e961365efd7b6f42830abcd27a511fd7e21e8a355d5f88dc07
dimensionknowledge_enabled1.0.0sha256:6a09fe2b19cb58b97629de4ece25144496f69f4c185f58f0ca36b1eba2e683d2
dimensionmodel1.0.0sha256:aa2813c508b0e1596258ec8bbd41dc7e2dd02c7874e502498a96d53fc33cf78f
evaluatorpytest_evaluator1.0.0sha256:9fc948866d2d3baf270ec289c71b920b0dccff1039c75b5272d147731235e719
metricexecution_time1.0.0sha256:df95800111948cc908941a569d23741a80f17d3032d1fba0b0b0b311b3a54ca5
metrichidden_test_pass_rate1.0.0sha256:f08c717a5eaca4af907156dbdfa26c7f6efa45baf1cb84fa0018d872af6a37ca
metrictask_success_rate1.0.0sha256:b1cd61f4f2da2994b2d20ecc3b973f528bdf8362c4046c543e5f8d6c6535e370
metrictotal_tokens1.0.0sha256:0a294005f700a7e8ff543645aecec1d12ae14b725736150691f0f3c3e20aa97d
runtimellm-router1.0.0sha256:3fd174cdc66527647d7f593c080677d37058e98e0f09d92b26808b938cbe3fbc

Metrics

nothing recorded

Not passed

runparametersstartedtaskagentrepetitionstatusverdictscoretimeinput tokensgenerated tokenstotal tokenstool callsfailure classerror
run-20261102-034956-2f8213a2knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 03:49:56wordcount-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s83,8282,87486,70212agentThe fix is on disk, but git doesn't report `text.py` as modified — verifying against HEAD.
run-20261102-040500-60833b88knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 04:05:00wordcount-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 2 s29,76080330,5634agentFound it — the working tree modified `text.split()` into `text.split(" ")`. Let me confirm which inputs misbehave.
run-20261102-052723-7c46d753knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 05:27:23notes-search-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s25,66863226,3006agentI'll start by exploring the repo structure and reading the spec.
run-20261102-054227-dc5f0497knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 05:42:27notes-search-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s68,1594,70372,8629agentVerifying against the spec rules with a throwaway script, plus the repo suite.
run-20261102-060259-4681bb55knowledge_enabled=False, model=auto_codex2026-11-02 06:02:59notes-search-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s92,6555,28797,94211agentFound a real bug: with `for ... else`, my scoring block sits inside `if terms:`, so a blank query appended nothing and returned `[]`. Restructuring so an empty term list scores 0 and matches.
run-20261102-061803-ca793f25knowledge_enabled=False, model=auto_codex2026-11-02 06:18:03notes-search-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 3 s364,79413,619378,41324agentThe implementation is correct — the last "failure" was another typo in my hand-written expected list (I swapped `t2`/`t1`), and the final direct probe confirmed the spec order `['t0','d','tg','t2','t1','c','b','a','e','m2','m1']` and correct scoring. Cleaning up the stale `.pyc` churn so the diff is just the implementation:
run-20261102-080410-d2c89897knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:04:10slugify-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s989,57118,7871,008,35851agentI'm looking at the test results more carefully now—most of them are passing, but there are two specific cases where the hyphen handling is producing unexpected triple hyphens instead of the expected output. The issue seems to be that when I'm building the test strings with the hyphen character, something about how the input is being processed is causing the hyphens to multiply in the output.
run-20261102-124303-45bdfb12knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:43:03cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 4 s1,030,27421,3011,051,57539agentSuite is green. Let me re-verify the full spec behavior with the final implementation, including a few extra edge cases I hadn't covered (staggered schedules, attempts, DST).
run-20261102-125808-280ac90dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:58:08cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 5 s823,34718,432841,77933agentThe implementation is complete and syntactically valid. Let me run the full test suite and my spec-based checks to confirm everything is green.
run-20261102-131314-47751b92knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 13:13:14cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s1,793,96820,1711,814,13953agentNow let me fix my test's history times (they must match the 06:00 occurrence instants, per "at that exact logical time") and re-run.
run-20261102-132819-55ee19e1knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:28:19cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 5 s949,88433,200983,08430agentThe `covers` helper was wrong — history-settled occurrences belong to neither list by spec. Fixing the helper.
run-20261102-134326-1f193cecknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:43:26cadence-catchup-001@1.0.0codex@codex-cli 0.166.02completedpartial0.96013 m 32 s946,33228,707975,03930
run-20261102-135659-dfdbb7eeknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:56:59cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s452,41432,517484,93119agentSeveral more of my expectations were wrong (an always-planned upstream settles its dependents, so real waits need staggered schedules). Rewriting with `(day, hour)` tuples and genuinely blocked upstreams.
run-20261102-141204-1573e7b2knowledge_enabled=False, model=auto_codex2026-11-02 14:12:04cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 4 s469,38726,193495,58019agentBoth were again my own expectation errors — the plan output is correct in each case. Now the critical rules: `depends_on_past`, the cap, ordering, and purity.
run-20261102-143842-25bc3410knowledge_enabled=False, model=auto_codex2026-11-02 14:38:42cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s507,66028,184535,84421agentMy assertion there forgot that `a`'s missing days are also planned and `b@1` is satisfied by history. Let me make the harness self-reporting so mismatches are diagnosable.
run-20261102-145348-58a7a3f3knowledge_enabled=True, model=auto_codex2026-11-02 14:53:48cadence-catchup-001@1.0.0codex@codex-cli 0.166.01completedpartial0.92012 m 29 s836,66723,155859,82230
run-20261102-150618-18c32d85knowledge_enabled=True, model=auto_codex2026-11-02 15:06:18cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 4 s543,45728,631572,08823agentThe scratch script itself is buggy. Let me print actual values to debug quickly.
run-20261102-152123-401b3de4knowledge_enabled=True, model=auto_codex2026-11-02 15:21:23cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s405,54824,862430,41022agentMost failures are test-harness artifacts, not implementation bugs — let me fix the script (tz-aware string formatting, wrong window for the staggered case, empty `reasons()` on a fully-planned chain) and re-run.
run-20261102-153629-de5ac66dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:36:29freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9419 m 40 s514,93012,666527,59625
run-20261102-154610-09481f31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:46:10freight-shop-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 3 s345,90824,250370,15818agentThe code works correctly — my test had the wrong assumption. I forgot the default divisor is 5000, so 130×30×20 gives volumetric 15.6 kg (billed 16.0 kg), not 3.0 kg. The linehaul is 4200, surcharge 500, total 4700 — and the group logic worked perfectly: `oversize` won, `heavy` was suppressed, winner named.
run-20261102-160115-cb48ab31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 16:01:15freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpartial0.94110 m 38 s402,64615,902418,54817
run-20261102-161153-16c04a4eknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 16:11:53freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.94111 m 36 s709,38023,886733,26625
run-20261102-164738-43ff8923knowledge_enabled=False, model=auto_codex2026-11-02 16:47:38freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9416 m 29 s254,4259,577264,00214
run-20261102-165407-d907f577knowledge_enabled=False, model=auto_codex2026-11-02 16:54:07freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94111 m 28 s361,98619,008380,99417
run-20261102-171345-07e43bdbknowledge_enabled=True, model=auto_codex2026-11-02 17:13:45freight-shop-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s581,22026,757607,97724agentAll 19 spec checks pass. Final verification — full suite plus a review of the finished body:
run-20261102-172849-b26fa228knowledge_enabled=True, model=auto_codex2026-11-02 17:28:49freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94110 m 30 s515,52217,044532,56623

All runs

runparametersstartedtaskagentrepetitionstatusverdictscoretimeinput tokensgenerated tokenstotal tokenstool callsfailure classerror
run-20261102-015302-e1907b59knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 01:53:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 59 s139,5133,865143,37813
run-20261102-015702-033aab98knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 01:57:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 59 s110,1852,205112,39010
run-20261102-020002-c8680ac1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:00:02bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 1 s118,2772,192120,4699
run-20261102-020305-819a6a56knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:03:05bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 16 s254,59910,261264,86020
run-20261102-020922-c802a0eeknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:09:22bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 56 s164,3094,902169,21114
run-20261102-021319-f8645cebknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:13:19bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 8 s223,6687,523231,19117
run-20261102-021828-a3b13607knowledge_enabled=False, model=auto_codex2026-11-02 02:18:28bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 46 s241,2974,789246,08617
run-20261102-022315-259a16a5knowledge_enabled=False, model=auto_codex2026-11-02 02:23:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 59 s128,2513,787132,03811
run-20261102-022715-0f5b5375knowledge_enabled=False, model=auto_codex2026-11-02 02:27:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 27 s173,6503,854177,50415
run-20261102-023143-af17689aknowledge_enabled=True, model=auto_codex2026-11-02 02:31:43bookshop-stock-002@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 31 s124,6783,136127,81410
run-20261102-023515-f1dff616knowledge_enabled=True, model=auto_codex2026-11-02 02:35:15bookshop-stock-002@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 57 s107,5132,363109,87611
run-20261102-023813-b7d6ced3knowledge_enabled=True, model=auto_codex2026-11-02 02:38:13bookshop-stock-002@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 58 s180,1993,237183,43613
run-20261102-024213-cd12e80fknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:42:13bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0001 m 60 s51,44782652,2735
run-20261102-024414-b4a4c0f1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:44:14bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 22 s73,2531,40774,6607
run-20261102-024637-153cbef0knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 02:46:37bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 22 s84,7901,31086,1008
run-20261102-024900-b4e495b9knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:49:00bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 48 s204,4546,473210,92718
run-20261102-025349-a41ee544knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:53:49bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0004 m 48 s190,9166,504197,42016
run-20261102-025838-8e5d4349knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 02:58:38bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 52 s185,1266,992192,11817
run-20261102-030330-6e680c03knowledge_enabled=False, model=auto_codex2026-11-02 03:03:30bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 49 s81,2491,66482,9137
run-20261102-030620-307d982cknowledge_enabled=False, model=auto_codex2026-11-02 03:06:20bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 43 s62,5881,46264,0506
run-20261102-031005-8ee792e8knowledge_enabled=False, model=auto_codex2026-11-02 03:10:05bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 39 s52,1581,25653,4145
run-20261102-031245-d48061aaknowledge_enabled=True, model=auto_codex2026-11-02 03:12:45bookshop-tiers-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0007 m 31 s65,0701,52766,5976
run-20261102-032017-d7e7635dknowledge_enabled=True, model=auto_codex2026-11-02 03:20:17bookshop-tiers-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0006 m 36 s84,4421,52985,9718
run-20261102-032654-eef72cc9knowledge_enabled=True, model=auto_codex2026-11-02 03:26:54bookshop-tiers-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00010 m 50 s89,2001,61190,8118
run-20261102-033745-147a6170knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:37:45wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 10 s165,8752,586168,46118
run-20261102-034056-a469ad46knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:40:56wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0001 m 35 s53,8831,04554,9286
run-20261102-034231-ceec4cf9knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 03:42:31wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 16 s44,33870345,0415
run-20261102-034347-4d78071aknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 03:43:47wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 8 s59,5932,20261,7959
run-20261102-034956-2f8213a2knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 03:49:56wordcount-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s83,8282,87486,70212agentThe fix is on disk, but git doesn't report `text.py` as modified — verifying against HEAD.
run-20261102-040500-60833b88knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 04:05:00wordcount-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 2 s29,76080330,5634agentFound it — the working tree modified `text.split()` into `text.split(" ")`. Let me confirm which inputs misbehave.
run-20261102-042003-4e77ac85knowledge_enabled=False, model=auto_codex2026-11-02 04:20:03wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0008 m 12 s65,1431,86867,0117
run-20261102-042815-65e2ad9bknowledge_enabled=False, model=auto_codex2026-11-02 04:28:15wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0006 m 51 s44,29172945,0205
run-20261102-043507-07326b31knowledge_enabled=False, model=auto_codex2026-11-02 04:35:07wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00011 m 9 s91,8942,13994,03310
run-20261102-044616-5ced7f24knowledge_enabled=True, model=auto_codex2026-11-02 04:46:16wordcount-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 20 s72,7571,52874,2858
run-20261102-045137-ae782a86knowledge_enabled=True, model=auto_codex2026-11-02 04:51:37wordcount-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0008 m 13 s57,8801,59859,4786
run-20261102-045951-9062760dknowledge_enabled=True, model=auto_codex2026-11-02 04:59:51wordcount-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 25 s111,7232,176113,89912
run-20261102-050517-4824113cknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:05:17notes-search-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 23 s257,1027,946265,04819
run-20261102-051140-154e7756knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:11:40notes-search-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 15 s322,2559,563331,81821
run-20261102-051856-7a01f2f0knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 05:18:56notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0008 m 27 s334,13711,345345,48220
run-20261102-052723-7c46d753knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 05:27:23notes-search-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s25,66863226,3006agentI'll start by exploring the repo structure and reading the spec.
run-20261102-054227-dc5f0497knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 05:42:27notes-search-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s68,1594,70372,8629agentVerifying against the spec rules with a throwaway script, plus the repo suite.
run-20261102-055730-c94232f9knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 05:57:30notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 28 s193,96210,301204,26317
run-20261102-060259-4681bb55knowledge_enabled=False, model=auto_codex2026-11-02 06:02:59notes-search-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s92,6555,28797,94211agentFound a real bug: with `for ... else`, my scoring block sits inside `if terms:`, so a blank query appended nothing and returned `[]`. Restructuring so an empty term list scores 0 and matches.
run-20261102-061803-ca793f25knowledge_enabled=False, model=auto_codex2026-11-02 06:18:03notes-search-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 3 s364,79413,619378,41324agentThe implementation is correct — the last "failure" was another typo in my hand-written expected list (I swapped `t2`/`t1`), and the final direct probe confirmed the spec order `['t0','d','tg','t2','t1','c','b','a','e','m2','m1']` and correct scoring. Cleaning up the stale `.pyc` churn so the diff is just the implementation:
run-20261102-063306-62006f1cknowledge_enabled=False, model=auto_codex2026-11-02 06:33:06notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0006 m 14 s127,0934,757131,85012
run-20261102-063921-31a5efefknowledge_enabled=True, model=auto_codex2026-11-02 06:39:21notes-search-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 21 s151,0275,654156,68113
run-20261102-064343-33d90543knowledge_enabled=True, model=auto_codex2026-11-02 06:43:43notes-search-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 18 s56,6252,03058,6558
run-20261102-064601-0d71057aknowledge_enabled=True, model=auto_codex2026-11-02 06:46:01notes-search-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 50 s190,8287,524198,35215
run-20261102-065152-be03d69aknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:51:52notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 32 s68,6912,28470,9757
run-20261102-065424-0122485bknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:54:24notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 58 s147,5283,954151,48213
run-20261102-065823-56d0518eknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 06:58:23notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 1 s144,2093,841148,05012
run-20261102-070225-983f28a4knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 07:02:25notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 26 s113,9877,555121,54210
run-20261102-070752-ee5e374fknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 07:07:52notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 42 s297,81511,995309,81018
run-20261102-071535-a34798d9knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 07:15:35notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0006 m 19 s194,7469,719204,46513
run-20261102-072154-ce0a96c9knowledge_enabled=False, model=auto_codex2026-11-02 07:21:54notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0009 m 24 s292,5866,876299,46221
run-20261102-073119-046c63c5knowledge_enabled=False, model=auto_codex2026-11-02 07:31:19notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0009 m 54 s186,1957,893194,08814
run-20261102-074114-fb309dd3knowledge_enabled=False, model=auto_codex2026-11-02 07:41:14notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 22 s139,4534,875144,32811
run-20261102-074537-1abe2bd8knowledge_enabled=True, model=auto_codex2026-11-02 07:45:37notes-sync-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0007 m 49 s168,2586,167174,42512
run-20261102-075327-d3b09ae5knowledge_enabled=True, model=auto_codex2026-11-02 07:53:27notes-sync-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0004 m 8 s92,3354,29096,62511
run-20261102-075736-7dc8b5faknowledge_enabled=True, model=auto_codex2026-11-02 07:57:36notes-sync-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 27 s126,1184,729130,84710
run-20261102-080204-89ac58c6knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:02:04slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 5 s88,7601,40690,1669
run-20261102-080410-d2c89897knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:04:10slugify-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 2 s989,57118,7871,008,35851agentI'm looking at the test results more carefully now—most of them are passing, but there are two specific cases where the hyphen handling is producing unexpected triple hyphens instead of the expected output. The issue seems to be that when I'm building the test strings with the hyphen character, something about how the input is being processed is causing the hyphens to multiply in the output.
run-20261102-081913-0789e06aknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 08:19:13slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 35 s113,2332,116115,34911
run-20261102-082149-abdd844bknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 08:21:49slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.00011 m 17 s147,9947,191155,18512
run-20261102-083306-81799937knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 08:33:06slugify-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 6 s77,3502,52779,8778
run-20261102-083513-c8a810d4knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 08:35:13slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0009 m 13 s139,4507,093146,54315
run-20261102-084427-5c4e6c25knowledge_enabled=False, model=auto_codex2026-11-02 08:44:27slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 54 s92,9172,28995,2069
run-20261102-084722-12cb8519knowledge_enabled=False, model=auto_codex2026-11-02 08:47:22slugify-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 3 s68,4371,56470,0017
run-20261102-084925-db233c9dknowledge_enabled=False, model=auto_codex2026-11-02 08:49:25slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 60 s67,0291,57168,6007
run-20261102-085126-7081e5a7knowledge_enabled=True, model=auto_codex2026-11-02 08:51:26slugify-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 50 s82,1122,40484,5168
run-20261102-085717-2d40efc9knowledge_enabled=True, model=auto_codex2026-11-02 08:57:17slugify-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 35 s112,6422,849115,49111
run-20261102-090053-801966e8knowledge_enabled=True, model=auto_codex2026-11-02 09:00:53slugify-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 15 s78,7282,14180,8698
run-20261102-102224-77a554a3knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:22:24cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 25 s87,4412,06289,5039
run-20261102-102450-4c4dafd8knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:24:50cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 56 s184,0373,928187,96513
run-20261102-102846-f9da52d1knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 10:28:46cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 53 s166,1052,393168,49814
run-20261102-103139-c174189bknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 10:31:39cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 20 s142,0814,157146,23813
run-20261102-103500-42595b9bknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 10:35:00cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 6 s136,1904,248140,43812
run-20261102-103806-ca54befbknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 10:38:06cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 43 s176,8744,786181,66014
run-20261102-104150-ee470964knowledge_enabled=False, model=auto_codex2026-11-02 10:41:50cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 36 s184,2632,829187,09215
run-20261102-104527-df556abcknowledge_enabled=False, model=auto_codex2026-11-02 10:45:27cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0005 m 33 s231,2506,615237,86516
run-20261102-105101-7f0ea089knowledge_enabled=False, model=auto_codex2026-11-02 10:51:01cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 31 s81,7561,51383,2699
run-20261102-105332-509d420cknowledge_enabled=True, model=auto_codex2026-11-02 10:53:32cadence-takeover-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 51 s181,89210,799192,69115
run-20261102-105924-5844ec5cknowledge_enabled=True, model=auto_codex2026-11-02 10:59:24cadence-takeover-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0007 m 45 s486,0237,446493,46926
run-20261102-110711-12e9e01eknowledge_enabled=True, model=auto_codex2026-11-02 11:07:11cadence-takeover-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 18 s124,5802,632127,21213
run-20261102-111029-a9c04726knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:10:29ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 57 s118,8372,616121,45312
run-20261102-111326-3c584bd3knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:13:26ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 10 s81,2801,90383,1837
run-20261102-111537-b9ab2fefknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:15:37ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 1 s130,3242,843133,16712
run-20261102-111839-c5f2e4c1knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 11:18:39ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0004 m 26 s197,7436,744204,48715
run-20261102-112306-6bc27784knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 11:23:06ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0006 m 46 s359,67811,459371,13720
run-20261102-112953-68b1af75knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 11:29:53ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 12 s266,6577,835274,49219
run-20261102-113507-5543ffe1knowledge_enabled=False, model=auto_codex2026-11-02 11:35:07ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0006 m 49 s273,4338,650282,08317
run-20261102-114156-1ff0ba59knowledge_enabled=False, model=auto_codex2026-11-02 11:41:56ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 49 s97,4732,29499,7679
run-20261102-114446-b3513377knowledge_enabled=False, model=auto_codex2026-11-02 11:44:46ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0003 m 5 s137,6743,039140,71310
run-20261102-114752-9f3f4f92knowledge_enabled=True, model=auto_codex2026-11-02 11:47:52ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0002 m 59 s109,7083,384113,09210
run-20261102-115051-39be5247knowledge_enabled=True, model=auto_codex2026-11-02 11:50:51ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0005 m 19 s233,2265,848239,07416
run-20261102-115611-ee478152knowledge_enabled=True, model=auto_codex2026-11-02 11:56:11ledgerlite-rates-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 39 s82,7732,11484,88710
run-20261102-115850-e5f2348fknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 11:58:50stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 30 s174,8333,032177,86512
run-20261102-120221-58de15afknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:02:21stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 13 s131,9341,632133,56610
run-20261102-120435-e4b44447knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:04:35stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0001 m 40 s86,40794887,3557
run-20261102-120616-d577d4b1knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 12:06:16stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0005 m 15 s256,4468,216264,66216
run-20261102-121131-13e4a8b5knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 12:11:31stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0003 m 55 s216,2535,255221,50812
run-20261102-121528-03d9f220knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 12:15:28stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0005 m 26 s293,3468,697302,04317
run-20261102-122054-f8985461knowledge_enabled=False, model=auto_codex2026-11-02 12:20:54stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 3 s130,7163,022133,73810
run-20261102-122358-fec2acfeknowledge_enabled=False, model=auto_codex2026-11-02 12:23:58stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0004 m 57 s284,3844,090288,47416
run-20261102-122856-43bd96e6knowledge_enabled=False, model=auto_codex2026-11-02 12:28:56stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0004 m 56 s290,1165,054295,17018
run-20261102-123353-08bae5f2knowledge_enabled=True, model=auto_codex2026-11-02 12:33:53stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.01completedpassed1.0003 m 28 s174,0553,204177,25912
run-20261102-123722-abf5b6a0knowledge_enabled=True, model=auto_codex2026-11-02 12:37:22stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.02completedpassed1.0002 m 50 s159,4521,673161,12512
run-20261102-124013-4e335fc0knowledge_enabled=True, model=auto_codex2026-11-02 12:40:13stockpile-writeoff-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0002 m 48 s147,8692,504150,37314
run-20261102-124303-45bdfb12knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:43:03cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 4 s1,030,27421,3011,051,57539agentSuite is green. Let me re-verify the full spec behavior with the final implementation, including a few extra edge cases I hadn't covered (staggered schedules, attempts, DST).
run-20261102-125808-280ac90dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 12:58:08cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 5 s823,34718,432841,77933agentThe implementation is complete and syntactically valid. Let me run the full test suite and my spec-based checks to confirm everything is green.
run-20261102-131314-47751b92knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 13:13:14cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s1,793,96820,1711,814,13953agentNow let me fix my test's history times (they must match the 06:00 occurrence instants, per "at that exact logical time") and re-run.
run-20261102-132819-55ee19e1knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:28:19cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 5 s949,88433,200983,08430agentThe `covers` helper was wrong — history-settled occurrences belong to neither list by spec. Fixing the helper.
run-20261102-134326-1f193cecknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:43:26cadence-catchup-001@1.0.0codex@codex-cli 0.166.02completedpartial0.96013 m 32 s946,33228,707975,03930
run-20261102-135659-dfdbb7eeknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 13:56:59cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s452,41432,517484,93119agentSeveral more of my expectations were wrong (an always-planned upstream settles its dependents, so real waits need staggered schedules). Rewriting with `(day, hour)` tuples and genuinely blocked upstreams.
run-20261102-141204-1573e7b2knowledge_enabled=False, model=auto_codex2026-11-02 14:12:04cadence-catchup-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 4 s469,38726,193495,58019agentBoth were again my own expectation errors — the plan output is correct in each case. Now the critical rules: `depends_on_past`, the cap, ordering, and purity.
run-20261102-142710-0136dc94knowledge_enabled=False, model=auto_codex2026-11-02 14:27:10cadence-catchup-001@1.0.0codex@codex-cli 0.166.02completedpassed1.00011 m 32 s409,64723,502433,14916
run-20261102-143842-25bc3410knowledge_enabled=False, model=auto_codex2026-11-02 14:38:42cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s507,66028,184535,84421agentMy assertion there forgot that `a`'s missing days are also planned and `b@1` is satisfied by history. Let me make the harness self-reporting so mismatches are diagnosable.
run-20261102-145348-58a7a3f3knowledge_enabled=True, model=auto_codex2026-11-02 14:53:48cadence-catchup-001@1.0.0codex@codex-cli 0.166.01completedpartial0.92012 m 29 s836,66723,155859,82230
run-20261102-150618-18c32d85knowledge_enabled=True, model=auto_codex2026-11-02 15:06:18cadence-catchup-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 4 s543,45728,631572,08823agentThe scratch script itself is buggy. Let me print actual values to debug quickly.
run-20261102-152123-401b3de4knowledge_enabled=True, model=auto_codex2026-11-02 15:21:23cadence-catchup-001@1.0.0codex@codex-cli 0.166.03timeoutnot measured15 m 5 s405,54824,862430,41022agentMost failures are test-harness artifacts, not implementation bugs — let me fix the script (tz-aware string formatting, wrong window for the staggered case, empty `reasons()` on a fully-planned chain) and re-run.
run-20261102-153629-de5ac66dknowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:36:29freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9419 m 40 s514,93012,666527,59625
run-20261102-154610-09481f31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 15:46:10freight-shop-001@1.0.0codex@codex-cli 0.166.02timeoutnot measured15 m 3 s345,90824,250370,15818agentThe code works correctly — my test had the wrong assumption. I forgot the default divisor is 5000, so 130×30×20 gives volumetric 15.6 kg (billed 16.0 kg), not 3.0 kg. The linehaul is 4200, surcharge 500, total 4700 — and the group logic worked perfectly: `oversize` won, `heavy` was suppressed, winner named.
run-20261102-160115-cb48ab31knowledge_enabled=False, model=qwen/Qwen3.8-27B2026-11-02 16:01:15freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpartial0.94110 m 38 s402,64615,902418,54817
run-20261102-161153-16c04a4eknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 16:11:53freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.94111 m 36 s709,38023,886733,26625
run-20261102-162330-279c2d0eknowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 16:23:30freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpassed1.00011 m 50 s597,87025,858623,72824
run-20261102-163521-b51708f9knowledge_enabled=False, model=qwen/Qwen3.8-Flash-Next2026-11-02 16:35:21freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00012 m 16 s819,72125,306845,02729
run-20261102-164738-43ff8923knowledge_enabled=False, model=auto_codex2026-11-02 16:47:38freight-shop-001@1.0.0codex@codex-cli 0.166.01completedpartial0.9416 m 29 s254,4259,577264,00214
run-20261102-165407-d907f577knowledge_enabled=False, model=auto_codex2026-11-02 16:54:07freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94111 m 28 s361,98619,008380,99417
run-20261102-170536-da2abfe7knowledge_enabled=False, model=auto_codex2026-11-02 17:05:36freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpassed1.0008 m 7 s389,74114,953404,69420
run-20261102-171345-07e43bdbknowledge_enabled=True, model=auto_codex2026-11-02 17:13:45freight-shop-001@1.0.0codex@codex-cli 0.166.01timeoutnot measured15 m 3 s581,22026,757607,97724agentAll 19 spec checks pass. Final verification — full suite plus a review of the finished body:
run-20261102-172849-b26fa228knowledge_enabled=True, model=auto_codex2026-11-02 17:28:49freight-shop-001@1.0.0codex@codex-cli 0.166.02completedpartial0.94110 m 30 s515,52217,044532,56623
run-20261102-173920-82f7a48cknowledge_enabled=True, model=auto_codex2026-11-02 17:39:20freight-shop-001@1.0.0codex@codex-cli 0.166.03completedpassed1.00011 m 43 s676,05622,481698,53726

Artifacts

runkindpathchecksum
run-20261102-015302-e1907b59manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015302-828515-b2e5cc/manifest.jsonsha256:4fc5121fb948280efe36dc14b65b20bc39c067c5571416c6f51dd0140e029827
run-20261102-015302-e1907b59evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015302-828515-b2e5cc/evaluation/pytest-output.txtsha256:81dde9a9613f0344d22bc7629164179f2ee351fb71783c2c89c34dfe07638f80
run-20261102-015302-e1907b59junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015302-828515-b2e5cc/evaluation/junit.xmlsha256:67a3adba05a37866cdf770b6e2769cfe6404159acd3b7ab76386971e1e53ac1a
run-20261102-015302-e1907b59run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015302-828515-b2e5cc/run_record.jsonsha256:393964cfb9107adabe0f332d30a60c4479b690e529da29c6db3bcb5b45ea5d41
run-20261102-015702-033aab98manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015702-991392-c69773/manifest.jsonsha256:63290da3afb9786c4ea89ed3e28c9b32196ed8f7698f44244901a1a6fd2e9d27
run-20261102-015702-033aab98evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015702-991392-c69773/evaluation/pytest-output.txtsha256:8546f78a556474939cfb0ae1419dd9655a9ff772a772a333c91457d920422dd7
run-20261102-015702-033aab98junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015702-991392-c69773/evaluation/junit.xmlsha256:d4d3866e5d610df854cf1be9ddfc0aca692164e663914884b54460cef423644c
run-20261102-015702-033aab98run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-015702-991392-c69773/run_record.jsonsha256:956824999c2c3c5beb24c8dcfd8eb346d18d9deefd27e0593fa61f8496c6a147
run-20261102-020002-c8680ac1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020002-813436-1f0603/manifest.jsonsha256:c809681c4c4c80ed5caa22c3ca49276b6b2ddd46a06e7dbae33d5ad0983bc2e8
run-20261102-020002-c8680ac1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020002-813436-1f0603/evaluation/pytest-output.txtsha256:8546f78a556474939cfb0ae1419dd9655a9ff772a772a333c91457d920422dd7
run-20261102-020002-c8680ac1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020002-813436-1f0603/evaluation/junit.xmlsha256:275a5155ca5710c8a969735dbd9ac26d8b7983a22c8ef4a0b93a1eeccc30fa45
run-20261102-020002-c8680ac1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020002-813436-1f0603/run_record.jsonsha256:68379f03fcf360635dfc8efce31ccc57add2d8e0240c0ec9dd81640b7661b495
run-20261102-020305-819a6a56manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020305-319548-f4e2bb/manifest.jsonsha256:8c1cc6aa6869302239686f7be03f92126db2cf9c2b49e4f825cda47aaeaa2fc7
run-20261102-020305-819a6a56evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020305-319548-f4e2bb/evaluation/pytest-output.txtsha256:a24c8dbcf10408719b332d4ec092b3050663c1c6b8b6e452134ac5993c42f286
run-20261102-020305-819a6a56junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020305-319548-f4e2bb/evaluation/junit.xmlsha256:66d6a587e4333f7a3549f3f19b16d05e8f4f4c25179c7f75d058dc12d2a13f62
run-20261102-020305-819a6a56run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020305-319548-f4e2bb/run_record.jsonsha256:a613f536742615a46ed7759440ec9f04d9298359efd42d6221b55a1de5238144
run-20261102-020922-c802a0eemanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020922-341297-64c742/manifest.jsonsha256:59c8e7c928d0ceafa579e063db276b46907929966f593df69209afbc721c3209
run-20261102-020922-c802a0eeevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020922-341297-64c742/evaluation/pytest-output.txtsha256:81dde9a9613f0344d22bc7629164179f2ee351fb71783c2c89c34dfe07638f80
run-20261102-020922-c802a0eejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020922-341297-64c742/evaluation/junit.xmlsha256:aae82a78b691d7eedc856ec37abf874c087bfd6c00bf025451ff550e1de98bc9
run-20261102-020922-c802a0eerun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-020922-341297-64c742/run_record.jsonsha256:1b9e3585ed92ae9871c1ebcd160110dafe21a253298f80ce41504672986898aa
run-20261102-021319-f8645cebmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021319-260873-83471c/manifest.jsonsha256:afc70bd0046ead5e1621936a4508cf8b0728b0f2bd6ab5e457f83ef823232569
run-20261102-021319-f8645cebevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021319-260873-83471c/evaluation/pytest-output.txtsha256:7fe1ede214e4811ebcb72311a0d8354f1e087510f79d1e1b8ae4fdd65f46d20b
run-20261102-021319-f8645cebjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021319-260873-83471c/evaluation/junit.xmlsha256:f3f65d64cbe92eba5667b9bf989fe6561a99f42e1718241dea4abe7e4afa53d8
run-20261102-021319-f8645cebrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021319-260873-83471c/run_record.jsonsha256:29cccb194946d50a877fb931934595660f5bd61f62bc336080723dc5c96bfba6
run-20261102-021828-a3b13607manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021828-236085-58108a/manifest.jsonsha256:9e3ada04867b7b3c2c5f413d0f622bba6e11e27b85a5809a9c6de29ae71d4fbb
run-20261102-021828-a3b13607evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021828-236085-58108a/evaluation/pytest-output.txtsha256:81dde9a9613f0344d22bc7629164179f2ee351fb71783c2c89c34dfe07638f80
run-20261102-021828-a3b13607junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021828-236085-58108a/evaluation/junit.xmlsha256:3ce966eeeb5fa696d0087865190494c809e1173091dcf9a5085d1e2f91060246
run-20261102-021828-a3b13607run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-021828-236085-58108a/run_record.jsonsha256:86cc346be8059955a50a74ab5fd81e707914e06b4b809111e80f03667cede2dd
run-20261102-022315-259a16a5manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022315-294720-d5c541/manifest.jsonsha256:fbe8fe8cdf4c7af894fb91b503956e2212a890d60eba8e8000041e81f1269d6d
run-20261102-022315-259a16a5evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022315-294720-d5c541/evaluation/pytest-output.txtsha256:a24c8dbcf10408719b332d4ec092b3050663c1c6b8b6e452134ac5993c42f286
run-20261102-022315-259a16a5junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022315-294720-d5c541/evaluation/junit.xmlsha256:18b9a8707e2deea8630050d8831ba0cc5ceeaee3474855969d35d8c0c40cf0eb
run-20261102-022315-259a16a5run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022315-294720-d5c541/run_record.jsonsha256:14c0bde58630ad8219777b78b2dc8dd084b01f19b9c889910384b56c5f2f0a19
run-20261102-022715-0f5b5375manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022715-055567-5dd15a/manifest.jsonsha256:d2d9979faef237c9b9bcaff840310a43475ff5ddcd3949f886932408c8319f7a
run-20261102-022715-0f5b5375evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022715-055567-5dd15a/evaluation/pytest-output.txtsha256:79375968f950b8d32608d84b8cf78d0ef34e9941002f1625bf0c27356c25d561
run-20261102-022715-0f5b5375junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022715-055567-5dd15a/evaluation/junit.xmlsha256:7238f9bfabb33f9794eb3c0ad6be4bedf6c81a821972fc008ac0edd8857da3ec
run-20261102-022715-0f5b5375run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-022715-055567-5dd15a/run_record.jsonsha256:3794eac8910c980c02f73b4edf9de6b5c15b53cec33d09025f66136af15febce
run-20261102-023143-af17689amanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023143-331458-ec4dfc/manifest.jsonsha256:d1b14c2e5a734f74138dcc8f9ca151a78c246ecd60b096f45310876734b8b5fb
run-20261102-023143-af17689aevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023143-331458-ec4dfc/evaluation/pytest-output.txtsha256:7fe1ede214e4811ebcb72311a0d8354f1e087510f79d1e1b8ae4fdd65f46d20b
run-20261102-023143-af17689ajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023143-331458-ec4dfc/evaluation/junit.xmlsha256:88e0654f65ba42e897ece4222a499f5b9e9c8c63fea5851598ad0bd77f6cddeb
run-20261102-023143-af17689arun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023143-331458-ec4dfc/run_record.jsonsha256:530f1a3ad808e909b162d8008c5291f3636a260f239a7d11fab7107dc51c8c44
run-20261102-023515-f1dff616manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023515-389721-bc0890/manifest.jsonsha256:7ab11b8bf1fb8aca385487b43634ec47a756ad2e9527f2d0b01331113f356477
run-20261102-023515-f1dff616evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023515-389721-bc0890/evaluation/pytest-output.txtsha256:a24c8dbcf10408719b332d4ec092b3050663c1c6b8b6e452134ac5993c42f286
run-20261102-023515-f1dff616junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023515-389721-bc0890/evaluation/junit.xmlsha256:7070190cf4d64fcdd2076764bf9f18830159ebe4bf6d9be73b8378e16caacab8
run-20261102-023515-f1dff616run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023515-389721-bc0890/run_record.jsonsha256:d16279cd5dfa588a02901179cd17b5f14d063a2b2d7337ef777af3b300f4601c
run-20261102-023813-b7d6ced3manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023813-778150-a8866d/manifest.jsonsha256:81a4ad276fc4a1e5c7cff6867d4945dce9bbb39b61ff440574e7fc2720ba5f31
run-20261102-023813-b7d6ced3evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023813-778150-a8866d/evaluation/pytest-output.txtsha256:5649932328a64d158f3bbccb9822192e0e730296ec4224e93043cbd577996c8e
run-20261102-023813-b7d6ced3junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023813-778150-a8866d/evaluation/junit.xmlsha256:17b9fbf4c5185290bb5ba74de5ed3a958adc1f220c735d652022f90b0763fbc7
run-20261102-023813-b7d6ced3run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-023813-778150-a8866d/run_record.jsonsha256:875861cc4f4dbd5cf29f25f77ac6b5e23b19f8ddc1483050e3f829e78b69c84f
run-20261102-024213-cd12e80fmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024213-457669-b01bb4/manifest.jsonsha256:bda4069a76b910ee19bb94412d00f1a057780cccad2511e22679b40c682a5585
run-20261102-024213-cd12e80fevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024213-457669-b01bb4/evaluation/pytest-output.txtsha256:f34403be55c155b99efb9ceb0d2f20b57661a8b43849329574d4acb5e9fa4b15
run-20261102-024213-cd12e80fjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024213-457669-b01bb4/evaluation/junit.xmlsha256:8af13670436e79b0bc763c5bed8b827c20345f7a8f725dca61b9014e6df5fc8e
run-20261102-024213-cd12e80frun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024213-457669-b01bb4/run_record.jsonsha256:c97ea864cdf9a4b8d02d43a0dc915a9eded95c91f5958dbdf6d27cac9b2c9404
run-20261102-024414-b4a4c0f1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024414-432781-569656/manifest.jsonsha256:48b8b06bd9749f81528acb0d932588145c0919f27c697110e5d42d7c124189e5
run-20261102-024414-b4a4c0f1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024414-432781-569656/evaluation/pytest-output.txtsha256:f34403be55c155b99efb9ceb0d2f20b57661a8b43849329574d4acb5e9fa4b15
run-20261102-024414-b4a4c0f1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024414-432781-569656/evaluation/junit.xmlsha256:cf5c8051894f9968681b4de1ee0c157a46b744a993f63237a96538141ebd73d3
run-20261102-024414-b4a4c0f1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024414-432781-569656/run_record.jsonsha256:51d0fa7cd05c5cb9952b6fa5f65d4ff0db5a99542eca7733b472bcee613b6d8e
run-20261102-024637-153cbef0manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024637-014129-5445ef/manifest.jsonsha256:f7be6d6d8404e62e9e76dd9786eda3b07df65596512e8b05e43d508084a42611
run-20261102-024637-153cbef0evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024637-014129-5445ef/evaluation/pytest-output.txtsha256:3071c284df2a9970dc02f22be28655215dfe5c394fe5089db977917a150c4bd2
run-20261102-024637-153cbef0junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024637-014129-5445ef/evaluation/junit.xmlsha256:249be0aa6dff436934401b4b0526d34b607c8430c90ef80746dfb5c2e5e17dcb
run-20261102-024637-153cbef0run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024637-014129-5445ef/run_record.jsonsha256:f03e53144906de6ea05b29800458276e34713cb4204d4dfb5f415724d9a67f9c
run-20261102-024900-b4e495b9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024900-414536-51256c/manifest.jsonsha256:6c2ee7f8a23d20eeef2286cf1067e87d8ffb07b6e850b64aff07a32c518caa24
run-20261102-024900-b4e495b9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024900-414536-51256c/evaluation/pytest-output.txtsha256:3071c284df2a9970dc02f22be28655215dfe5c394fe5089db977917a150c4bd2
run-20261102-024900-b4e495b9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024900-414536-51256c/evaluation/junit.xmlsha256:a16674b09942ba2c008af7fbd5c881a4ee26fae43c51d8351bef9b7e2039d994
run-20261102-024900-b4e495b9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-024900-414536-51256c/run_record.jsonsha256:d7fcd25b8730cd43a4f1d258900b102ba4af29d6438cb0dc42e1c4fff1b30a65
run-20261102-025349-a41ee544manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025349-049439-090c44/manifest.jsonsha256:570db41f59e83df598ac88f3d8625bcf6aefcc0fbaa2d08c11651e160bd8fc51
run-20261102-025349-a41ee544evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025349-049439-090c44/evaluation/pytest-output.txtsha256:3071c284df2a9970dc02f22be28655215dfe5c394fe5089db977917a150c4bd2
run-20261102-025349-a41ee544junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025349-049439-090c44/evaluation/junit.xmlsha256:9c8e575df5cf3bf35fffd9d4bc0e1e47e1d2752531816f0b2080049dffa67489
run-20261102-025349-a41ee544run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025349-049439-090c44/run_record.jsonsha256:d98d86decfac140a55cf9e42046cf7b0ad3134a9270c9a9bafaaafbd8be1195b
run-20261102-025838-8e5d4349manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025838-217275-06f221/manifest.jsonsha256:5fd4a9e50e0de69299b2514771b7cd68675362941c347c20f798c2e2ffdb7975
run-20261102-025838-8e5d4349evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025838-217275-06f221/evaluation/pytest-output.txtsha256:f34403be55c155b99efb9ceb0d2f20b57661a8b43849329574d4acb5e9fa4b15
run-20261102-025838-8e5d4349junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025838-217275-06f221/evaluation/junit.xmlsha256:3e0ef3fb278dbf91959257b523f41155bab70daf7a84ad95484532fb52a9db15
run-20261102-025838-8e5d4349run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-025838-217275-06f221/run_record.jsonsha256:e2edc9d8c2163f941da5aecb275431505693fe5207cf9e84dc9bec4e1359644e
run-20261102-030330-6e680c03manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030330-745752-8a650a/manifest.jsonsha256:fc8e5d3871904dde3949fa28bcd7a56a89fcaac4c94601d19f2c374e5ee0f4ab
run-20261102-030330-6e680c03evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030330-745752-8a650a/evaluation/pytest-output.txtsha256:3071c284df2a9970dc02f22be28655215dfe5c394fe5089db977917a150c4bd2
run-20261102-030330-6e680c03junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030330-745752-8a650a/evaluation/junit.xmlsha256:ab81e6ea3a719b7159c1808f854cfd7b23d23482680d69513cde6908aabdc77d
run-20261102-030330-6e680c03run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030330-745752-8a650a/run_record.jsonsha256:490c533960a916c00ba1614ee30aebba6e5470c5b8f5cf4ccab830b0bd130b11
run-20261102-030620-307d982cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030620-989666-ba8d1a/manifest.jsonsha256:dd5ea2711f6df6f7845d2d2319bc1d9aff2664e08ef376fcb8bab283af821f38
run-20261102-030620-307d982cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030620-989666-ba8d1a/evaluation/pytest-output.txtsha256:f34403be55c155b99efb9ceb0d2f20b57661a8b43849329574d4acb5e9fa4b15
run-20261102-030620-307d982cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030620-989666-ba8d1a/evaluation/junit.xmlsha256:8f16274f54bd5f4831c5ff7a8390415aaa4c675b646362ac341d8f684a4f1bd4
run-20261102-030620-307d982crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-030620-989666-ba8d1a/run_record.jsonsha256:8359fedf36a87cee71be600c4c3fadc62adda956bfbaed40ac7c04ac9f45b403
run-20261102-031005-8ee792e8manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031005-411982-48a605/manifest.jsonsha256:a2d0ccfab33667437422159cf28f2637552166b93bfed46cd9b3229176e2674c
run-20261102-031005-8ee792e8evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031005-411982-48a605/evaluation/pytest-output.txtsha256:3071c284df2a9970dc02f22be28655215dfe5c394fe5089db977917a150c4bd2
run-20261102-031005-8ee792e8junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031005-411982-48a605/evaluation/junit.xmlsha256:2d5d32da737d410368ab335a004fd2dde10f2c37a6f6fda933ddf797a2760b72
run-20261102-031005-8ee792e8run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031005-411982-48a605/run_record.jsonsha256:b44faa562805fc2cef2a4ada0480b143e3ff37d73105c783fa98bbf32dd28551
run-20261102-031245-d48061aamanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031245-221236-1c1852/manifest.jsonsha256:45c4d66187fbdecb0541260591e82bc9177ffbaf9598b64e2d752fccfe847f65
run-20261102-031245-d48061aaevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031245-221236-1c1852/evaluation/pytest-output.txtsha256:1fd84170e91c9f7b330865ff3d43fdcbaf977062fbc7bc4402cc92a6161a9951
run-20261102-031245-d48061aajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031245-221236-1c1852/evaluation/junit.xmlsha256:c0aa0f4656469210bd2d7a1e667da03eac8f2e149193a82051081719818d8e95
run-20261102-031245-d48061aarun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-031245-221236-1c1852/run_record.jsonsha256:da34e1a3db7333dda39c2341639540115d5df507a1e9bf8bf2e8d3e26c8a605e
run-20261102-032017-d7e7635dmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032017-096640-07bedc/manifest.jsonsha256:1fc591787c932d29138c52208e5a28ce433fa2345f938fd6d9f700a60284a9d1
run-20261102-032017-d7e7635devaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032017-096640-07bedc/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-032017-d7e7635djunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032017-096640-07bedc/evaluation/junit.xmlsha256:a00a7b126fe04e0baacca7f9729135d5d2a7cc6b70b8ebb3ec57a25baa44b991
run-20261102-032017-d7e7635drun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032017-096640-07bedc/run_record.jsonsha256:94f082e78ee8ceb92ca49480fa34020b57c719f6b4e3acfad0798d197148440d
run-20261102-032654-eef72cc9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032654-094278-4385fb/manifest.jsonsha256:1f6f3084f53dff652e12e75037d54fea9dab953b59db8204215b58e98861572b
run-20261102-032654-eef72cc9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032654-094278-4385fb/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-032654-eef72cc9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032654-094278-4385fb/evaluation/junit.xmlsha256:bc9d0615a2e7e448409a1397ec343f5693e255ad4ea19a1efb4996e7402f849b
run-20261102-032654-eef72cc9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-032654-094278-4385fb/run_record.jsonsha256:0a85370e35cb350b0c6bfea9a3e4b7db03a252bdf65567897a1bdc5eae4c4196
run-20261102-033745-147a6170manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-033745-233609-ec6081/manifest.jsonsha256:8d852c87558cd6e4438e5a370f59adc872f533832772fe1ef07cda2ab36649ab
run-20261102-033745-147a6170evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-033745-233609-ec6081/evaluation/pytest-output.txtsha256:41afd6a8301a8442889974bed19f1915bc3f71b0e4bc9004eec057accce8f18f
run-20261102-033745-147a6170junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-033745-233609-ec6081/evaluation/junit.xmlsha256:7f7a104f9687c82bea3894aa9c20b26af797201d23c6bd9f0021d42cc0de80ae
run-20261102-033745-147a6170run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-033745-233609-ec6081/run_record.jsonsha256:96db52bacb81e200a758ef028d9d2ba17045d0bb3c0f13b5216a226d0317d6f8
run-20261102-034056-a469ad46manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034056-219090-36f50d/manifest.jsonsha256:17a85cba1cc69cb4d7c5ec9e76f5bd039ba31759a4d2ab9278930c559cc26069
run-20261102-034056-a469ad46evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034056-219090-36f50d/evaluation/pytest-output.txtsha256:6a710add340ce86c1d53e7acfbff7ef6e4eb1d275ae1adb39e2be99ab69933cc
run-20261102-034056-a469ad46junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034056-219090-36f50d/evaluation/junit.xmlsha256:14748da99311659763678ff7c3e4f68b12b11b64b760149b260de6e2ca00280c
run-20261102-034056-a469ad46run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034056-219090-36f50d/run_record.jsonsha256:1caed700c786ca7c49de6c7e206844403f3704b076226c370778442edf3cd097
run-20261102-034231-ceec4cf9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034231-435967-f4fbcb/manifest.jsonsha256:6330d251601859e86c61f4a94d273a813514dbb60fa1a6a99a2c77c295cf8dc5
run-20261102-034231-ceec4cf9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034231-435967-f4fbcb/evaluation/pytest-output.txtsha256:31b6f7777e237a3cf5e3990bcab15fa114ba1225511ad3ae1eb6fc689b723fd7
run-20261102-034231-ceec4cf9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034231-435967-f4fbcb/evaluation/junit.xmlsha256:eb122f5ffc47bff983812d362ffd6d32904670b597606f9d1c8c1ddaf8de1d4d
run-20261102-034231-ceec4cf9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034231-435967-f4fbcb/run_record.jsonsha256:34d66a2f61187a985b5a4b05550f5115a48624a0843d5f2034275f7963cd8466
run-20261102-034347-4d78071amanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034347-886854-17a3dc/manifest.jsonsha256:98721f82821a3f3f0fe7ab5e0dc93ae09c26da7d23fd8481ccb95200f5dfdad6
run-20261102-034347-4d78071aevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034347-886854-17a3dc/evaluation/pytest-output.txtsha256:d14c45bd446914edde03cc34c2657783addfa289760dd6266ee701ff2e254653
run-20261102-034347-4d78071ajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034347-886854-17a3dc/evaluation/junit.xmlsha256:32c50bd92e712ca9e8c07c8c10057ab8b058819b59af8889fd894e83c8aa5ada
run-20261102-034347-4d78071arun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034347-886854-17a3dc/run_record.jsonsha256:aa94a6fb5688e4a30df9bdd5134d9f1cabca7db1b90470d6ee4726ee8803236f
run-20261102-034956-2f8213a2manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034956-989128-324c59/manifest.jsonsha256:adc07568c84bacce48b89708a28c6b1a9ab1ceb0e3c388cadb8395663acea86f
run-20261102-034956-2f8213a2run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-034956-989128-324c59/run_record.jsonsha256:6b9bf834085e801f46a42037418a9f939bdc24a557c52d3caf9de941e144c47d
run-20261102-040500-60833b88manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-040500-205320-f9fdf2/manifest.jsonsha256:b0d04da7c7a14026214e6e1d1a8368bf7bf7ceaf8f5152b36ced6003670316ff
run-20261102-040500-60833b88run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-040500-205320-f9fdf2/run_record.jsonsha256:0673a3be52f871920f964798cde1b8b4dd9972ff2d9e1b26a23c05d6884bc388
run-20261102-042003-4e77ac85manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042003-198280-8b5847/manifest.jsonsha256:4a88770a7dae9d48b9e4cd7cdd5ea41999dcf21b428172ba3c4bea0be947ce43
run-20261102-042003-4e77ac85evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042003-198280-8b5847/evaluation/pytest-output.txtsha256:d14c45bd446914edde03cc34c2657783addfa289760dd6266ee701ff2e254653
run-20261102-042003-4e77ac85junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042003-198280-8b5847/evaluation/junit.xmlsha256:e206a16cd8fc79436792960d32a9fb7bc9b61a862d9a7de87c55c5782e3c7132
run-20261102-042003-4e77ac85run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042003-198280-8b5847/run_record.jsonsha256:bd93c8e44ce311fcc2b26a76ac87f4814e23798ecd75649e355b646bf8f17fe7
run-20261102-042815-65e2ad9bmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042815-677478-ad1b63/manifest.jsonsha256:388ffed7000b914d42e6fa974b36e7081b1cfb21518abcd9f2cdd38518c847da
run-20261102-042815-65e2ad9bevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042815-677478-ad1b63/evaluation/pytest-output.txtsha256:d14c45bd446914edde03cc34c2657783addfa289760dd6266ee701ff2e254653
run-20261102-042815-65e2ad9bjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042815-677478-ad1b63/evaluation/junit.xmlsha256:3b57b57727c622e1d3103da38dcffbb6dbca51ee7c724fedb41842d342012ada
run-20261102-042815-65e2ad9brun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-042815-677478-ad1b63/run_record.jsonsha256:593d2a74a4ef358259287090c78a5d7934f9242e8feabaa1113309bda3a08439
run-20261102-043507-07326b31manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-043507-113690-e35d0c/manifest.jsonsha256:1c80bab14e2fa3c1ea7a1f2f5445277c5ee61ea80817ab15a019cab1fbd25cb3
run-20261102-043507-07326b31evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-043507-113690-e35d0c/evaluation/pytest-output.txtsha256:d14c45bd446914edde03cc34c2657783addfa289760dd6266ee701ff2e254653
run-20261102-043507-07326b31junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-043507-113690-e35d0c/evaluation/junit.xmlsha256:2e6097fe0bdf1dce0b885b3f3af20c291ec39803919bc7469580aebc53e5ab82
run-20261102-043507-07326b31run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-043507-113690-e35d0c/run_record.jsonsha256:69982e0a75f06646d86ffddc1c0e6366f3bfa002123a53f4a420983c4ef412ca
run-20261102-044616-5ced7f24manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-044616-550627-eedbf9/manifest.jsonsha256:3d549c24d2a031fe0491b3cf681ee729be65350767d42a94276637f59b53f570
run-20261102-044616-5ced7f24evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-044616-550627-eedbf9/evaluation/pytest-output.txtsha256:d14c45bd446914edde03cc34c2657783addfa289760dd6266ee701ff2e254653
run-20261102-044616-5ced7f24junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-044616-550627-eedbf9/evaluation/junit.xmlsha256:66c183c391d77e646f93be96438d079baca56b224756e132b04aabc220f7f618
run-20261102-044616-5ced7f24run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-044616-550627-eedbf9/run_record.jsonsha256:f835e1bde3a4cce19fb811b3e6bf5ed1b43a85b93462c7a40c2d51969c688e0e
run-20261102-045137-ae782a86manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045137-437095-b5a1f6/manifest.jsonsha256:c05be93598249b2932a878ada92ff565cba66a856c27ed0d5393f45551b0b08a
run-20261102-045137-ae782a86evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045137-437095-b5a1f6/evaluation/pytest-output.txtsha256:f062a5c0280dc177333913813fbeb8b77bcf3af76aa0d7758b47a1b51f8098c1
run-20261102-045137-ae782a86junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045137-437095-b5a1f6/evaluation/junit.xmlsha256:123c441e5c7c9b5f0a9083a08afd19be14b056f5b6e983ddf079a7dec5a4c9f6
run-20261102-045137-ae782a86run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045137-437095-b5a1f6/run_record.jsonsha256:d2ea1c24294d0bf38667e6151aacc524d05f1a56df1973fc99060146fa2f8297
run-20261102-045951-9062760dmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045951-544132-24a5fa/manifest.jsonsha256:8aa43997ce044cfa8c23b753818c7d7f3f0f4186a08642a4ba3c11c7ea496c78
run-20261102-045951-9062760devaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045951-544132-24a5fa/evaluation/pytest-output.txtsha256:31b6f7777e237a3cf5e3990bcab15fa114ba1225511ad3ae1eb6fc689b723fd7
run-20261102-045951-9062760djunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045951-544132-24a5fa/evaluation/junit.xmlsha256:e77ac65346a05059bb2a1ec6a5fbe7c2758930695e0773fc137c81eda6e7a0cf
run-20261102-045951-9062760drun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-045951-544132-24a5fa/run_record.jsonsha256:458fc4cd01509ec0d9e3457c21b9c931522b2b98d57cae647209ff2edc43d919
run-20261102-050517-4824113cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-050517-004765-2b6689/manifest.jsonsha256:069a69a92e227f8c3b2394221fb328802fcd0603a81842f63f70da7b4f267c68
run-20261102-050517-4824113cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-050517-004765-2b6689/evaluation/pytest-output.txtsha256:397cfe9bbfb478c58298ca2083c128a717f7856604c062646064e48810c3b190
run-20261102-050517-4824113cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-050517-004765-2b6689/evaluation/junit.xmlsha256:389e6caed6f53d3e18ce706b006e7f07660dc9c8cdbc93b5513156c5d17672ce
run-20261102-050517-4824113crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-050517-004765-2b6689/run_record.jsonsha256:d3cda0df27e12e6c1dec0978a1eabf22344c0032220a5f61c05e4f91c65ebc8a
run-20261102-051140-154e7756manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051140-639495-63f5a9/manifest.jsonsha256:83344c2d691d5b854c77de764136bd424055238f3126542cda8765218f2347ae
run-20261102-051140-154e7756evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051140-639495-63f5a9/evaluation/pytest-output.txtsha256:397cfe9bbfb478c58298ca2083c128a717f7856604c062646064e48810c3b190
run-20261102-051140-154e7756junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051140-639495-63f5a9/evaluation/junit.xmlsha256:fc7e81d2566111cbffcfbdecb7ca7562a48d506f036e8735d184d5de049afb49
run-20261102-051140-154e7756run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051140-639495-63f5a9/run_record.jsonsha256:b0d0e2f95795496cf2954453a495ac793591fc0fd2fa1816494f1e9128c43211
run-20261102-051856-7a01f2f0manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051856-576692-4654e2/manifest.jsonsha256:b7abb8d488a60dc3e1acf4b66ab138194685983e6f14c537c02745c078dc1142
run-20261102-051856-7a01f2f0evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051856-576692-4654e2/evaluation/pytest-output.txtsha256:6a1e591ccd7961d2b7e7738b943242f926e5180292d291a812187b6a3608810a
run-20261102-051856-7a01f2f0junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051856-576692-4654e2/evaluation/junit.xmlsha256:d7f1ef52d0e8fc9bce495b270928db7a4321c56b2ef048ed3bb30c9f38bd6bfb
run-20261102-051856-7a01f2f0run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-051856-576692-4654e2/run_record.jsonsha256:541ed6e1e0c64482e3ec2c2ca19987cb56e3a45b04931b8e3eb947763c5eb9e7
run-20261102-052723-7c46d753manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-052723-995402-be2507/manifest.jsonsha256:e08d033e9e6d36a25f4e5f4f2b858dc5389f704b5d7cf69e6d180332a102719e
run-20261102-052723-7c46d753run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-052723-995402-be2507/run_record.jsonsha256:e52efb087b799780f2bea6fe2c8d1dc8771f523ff79d00885e60762148386778
run-20261102-054227-dc5f0497manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-054227-650415-74d3ae/manifest.jsonsha256:69c4f143e943ebdcabd3966d45b5bf078823520b6bd2ae673f3096673a195ccc
run-20261102-054227-dc5f0497run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-054227-650415-74d3ae/run_record.jsonsha256:f71829aa1a874793dfaa24d2454bdb6e67d918cf37d1663f5e4d4daefb61ea9c
run-20261102-055730-c94232f9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-055730-868320-b6f69b/manifest.jsonsha256:0d59f02594da5d228feebaea2ef87b91ba1522eda3c2aedc3c60f74af1f031f0
run-20261102-055730-c94232f9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-055730-868320-b6f69b/evaluation/pytest-output.txtsha256:686170959f120960c3f5e38d801516df7dcdf077e8aadf21f1ba2a1f3e323cc8
run-20261102-055730-c94232f9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-055730-868320-b6f69b/evaluation/junit.xmlsha256:5abc1b72fb49b70aa2957d5cc8255d0e6b9962e106cba1581ce207b557a97cf6
run-20261102-055730-c94232f9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-055730-868320-b6f69b/run_record.jsonsha256:f5b40198faefdcdc95678a9f74865dc9537aa86c68fc90df8044263816f4d60e
run-20261102-060259-4681bb55manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-060259-850074-1e801f/manifest.jsonsha256:caad414b8d3d14d4dc7ec21748b2d297242c22879dddc0b7af44d57222b1db77
run-20261102-060259-4681bb55run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-060259-850074-1e801f/run_record.jsonsha256:c53b6a460406cfb31beaa3cde184b4f4952daada40fde7e60151a3230cd1e990
run-20261102-061803-ca793f25manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-061803-376938-ec48e1/manifest.jsonsha256:6c967eebccc719289a8d2bb24e4d520327af3370bc3d27ae17fc9c0b7151a757
run-20261102-061803-ca793f25run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-061803-376938-ec48e1/run_record.jsonsha256:a8a0fa16203bdaa8e9a0ec348c987710e55233e7a75358aff2dd915aefa2a78d
run-20261102-063306-62006f1cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063306-857454-9ba71f/manifest.jsonsha256:ebce63eab79be2ab61445534018ce09b73f7654605b93f90cf90ef0766ce8333
run-20261102-063306-62006f1cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063306-857454-9ba71f/evaluation/pytest-output.txtsha256:63356a0136df8d747c8985b35c60afc78187b59541cacab1ac0a2866ff8b146f
run-20261102-063306-62006f1cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063306-857454-9ba71f/evaluation/junit.xmlsha256:d4fcc3c34ab3e1ea9f5a8559e2ef487494d755dcc57ea946e779296a56e224d1
run-20261102-063306-62006f1crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063306-857454-9ba71f/run_record.jsonsha256:4e329a57de45fa4d1751bbc56e312585910096a1ea236f0e19918bd3b564fbe8
run-20261102-063921-31a5efefmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063921-831609-464359/manifest.jsonsha256:268040078b4879e2cc8f1611caacc3c6526a31f4892fe857159746dbfff1c693
run-20261102-063921-31a5efefevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063921-831609-464359/evaluation/pytest-output.txtsha256:189457d159512f5bc9a7fa5f4d2d731a63522e832c5336b243c6ce2b734182cb
run-20261102-063921-31a5efefjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063921-831609-464359/evaluation/junit.xmlsha256:dd0b3a65504abbec58ef49afd784d0c4da94683b1da2ddac8df26971051649b3
run-20261102-063921-31a5efefrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-063921-831609-464359/run_record.jsonsha256:e5afdde235800acaa247054aabe99d890f6d0ecc04ead62c5da5bb4e2c0b7e9e
run-20261102-064343-33d90543manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064343-528649-e7cba7/manifest.jsonsha256:9decc34b1a0c441c1251a42cd994062e515309f444168ed8584a7cacc3c56ebc
run-20261102-064343-33d90543evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064343-528649-e7cba7/evaluation/pytest-output.txtsha256:397cfe9bbfb478c58298ca2083c128a717f7856604c062646064e48810c3b190
run-20261102-064343-33d90543junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064343-528649-e7cba7/evaluation/junit.xmlsha256:e4a10f3c525a366198ce82c6f5b1484a81d6215de42b9b48c9dc19d2bd6fc11a
run-20261102-064343-33d90543run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064343-528649-e7cba7/run_record.jsonsha256:6864d14f641ce565cce9a058aebf1fe686d88b5bd7a30e07628e416305acfee7
run-20261102-064601-0d71057amanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064601-954304-24269b/manifest.jsonsha256:11f93957ccd94a83fff3840765078e7f3b5e1916431cf4128ac91bfcb3ed228e
run-20261102-064601-0d71057aevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064601-954304-24269b/evaluation/pytest-output.txtsha256:397cfe9bbfb478c58298ca2083c128a717f7856604c062646064e48810c3b190
run-20261102-064601-0d71057ajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064601-954304-24269b/evaluation/junit.xmlsha256:9ee69518425fe4c4783c8b258b77b85ace1bc5504885f0f7cc69ec50c5fcc84d
run-20261102-064601-0d71057arun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-064601-954304-24269b/run_record.jsonsha256:3ff202570b3de0d11b52948075630f8b2cde4e35fea0bdbd3ba8af2d4f5d3863
run-20261102-065152-be03d69amanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065152-195360-31e6e2/manifest.jsonsha256:ac0598251ac41b4584224b88b7e49374d9b8c4de1f9756251e29a82be36617b8
run-20261102-065152-be03d69aevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065152-195360-31e6e2/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-065152-be03d69ajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065152-195360-31e6e2/evaluation/junit.xmlsha256:51bf6dd831fb7c5080363600824800de5513781e169146ae74aa9a011728d8b2
run-20261102-065152-be03d69arun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065152-195360-31e6e2/run_record.jsonsha256:cc1ee6ecef61fbffdd06bc5ef8b3570c48cba3bbf69919e3a891cc023f01957d
run-20261102-065424-0122485bmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065424-460453-b0b0dc/manifest.jsonsha256:8207794ba9ae4396c889415cfb55438f473a8ef7aece0871d7c493fe5f4ee9de
run-20261102-065424-0122485bevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065424-460453-b0b0dc/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-065424-0122485bjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065424-460453-b0b0dc/evaluation/junit.xmlsha256:9fbc13d4e62c6c1e48b2e73c0ebcbdc943dbcddf4adfa057634eab7b4e1fee07
run-20261102-065424-0122485brun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065424-460453-b0b0dc/run_record.jsonsha256:28d0eba92cd625a978bf5eedd68c1236e5dd025b49dc704ad477617296fca2ca
run-20261102-065823-56d0518emanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065823-737508-ff3986/manifest.jsonsha256:62982f842cd07b95e5abb0fc6065ddf902d4c117469a52173cb99c49cb7ad9cd
run-20261102-065823-56d0518eevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065823-737508-ff3986/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-065823-56d0518ejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065823-737508-ff3986/evaluation/junit.xmlsha256:1f74dddaea46a0e0f15664de6e01806c41cd62f3d3768266d96364770083d4a7
run-20261102-065823-56d0518erun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-065823-737508-ff3986/run_record.jsonsha256:ba60e47ce9305444123433da54a076000d9f790f131ddacb793f493b862488e7
run-20261102-070225-983f28a4manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070225-522607-2aed0f/manifest.jsonsha256:5ca2a8953d84fa8de86116313a1de77bf7a6537f1634cc63567416e44fcab2bb
run-20261102-070225-983f28a4evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070225-522607-2aed0f/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-070225-983f28a4junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070225-522607-2aed0f/evaluation/junit.xmlsha256:eb7a978b8e0f28b1b97d91038b596044cb1ad167e33d6b809d34ff274c99b93b
run-20261102-070225-983f28a4run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070225-522607-2aed0f/run_record.jsonsha256:ab477ccfbb9452a73caa6dcb213347f19104766330b8f40704ddbc5ff73716d3
run-20261102-070752-ee5e374fmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070752-504469-e651b8/manifest.jsonsha256:2f4059eb8892373bc95e2900edbce64f414a480c20ac8e3a620a3299c4e9c18c
run-20261102-070752-ee5e374fevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070752-504469-e651b8/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-070752-ee5e374fjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070752-504469-e651b8/evaluation/junit.xmlsha256:40b7ec673941ca3f8adf93d00228c5f3be9dc82a9e1374d24b89ea2b76e7b8a5
run-20261102-070752-ee5e374frun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-070752-504469-e651b8/run_record.jsonsha256:7be42b97397986f3c670c8b822b07e518d1de92d9038981f8efd8aa7e2776e11
run-20261102-071535-a34798d9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-071535-455925-1435eb/manifest.jsonsha256:499f0e068b41ee2aa3c05b860bfffee511b87d9a144001d13e85ec89aae6bb5f
run-20261102-071535-a34798d9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-071535-455925-1435eb/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-071535-a34798d9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-071535-455925-1435eb/evaluation/junit.xmlsha256:c8e8b1cf65bce9542e3a111f25b7f0a9eb9a4e7d408d622cc1485379c6bda022
run-20261102-071535-a34798d9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-071535-455925-1435eb/run_record.jsonsha256:b62502dff485abd133cfb5f4e2b4dabb94d9392103289fbc7ce44311f863c5b3
run-20261102-072154-ce0a96c9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-072154-656080-ea3c70/manifest.jsonsha256:cbf868bab79f76929d9b9d768b6857e3e25ecc92d1b0bdcc97e9e46bab805f06
run-20261102-072154-ce0a96c9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-072154-656080-ea3c70/evaluation/pytest-output.txtsha256:e103cee88e234273f24f1f62918c25844efe86e65fe453f506b3f30a02014d98
run-20261102-072154-ce0a96c9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-072154-656080-ea3c70/evaluation/junit.xmlsha256:b225eeb8d67474aaeff90c2b5cd7354240c3e4ccdada061691100df6c74aad9a
run-20261102-072154-ce0a96c9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-072154-656080-ea3c70/run_record.jsonsha256:d04d57f42b009f106f1f1b40dd5ac499f003f30994b74144ccda7489b5c38826
run-20261102-073119-046c63c5manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-073119-552519-542138/manifest.jsonsha256:9f2177384d4e274beddb285dfa71619f1a83d5c61396e6982775eeb98cb75f7e
run-20261102-073119-046c63c5evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-073119-552519-542138/evaluation/pytest-output.txtsha256:88a915766ec63f26acf991a2c3c7caef92ac3a098cf7a2de8aab958498457606
run-20261102-073119-046c63c5junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-073119-552519-542138/evaluation/junit.xmlsha256:d17074e5c3f3da400030ea247169ac4941e32fda0180ba30076a3ef3ea5c9246
run-20261102-073119-046c63c5run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-073119-552519-542138/run_record.jsonsha256:d7cfe71caae639180c88a156781cda836ee03a0dc3c03feb7da3cfab3cb9edff
run-20261102-074114-fb309dd3manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074114-487776-f51a55/manifest.jsonsha256:35828e6438b2d1bebe406c7e3bf505b37fc5377e805eb18b3fcb45028255c1f2
run-20261102-074114-fb309dd3evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074114-487776-f51a55/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-074114-fb309dd3junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074114-487776-f51a55/evaluation/junit.xmlsha256:08e34e5606abaec82ebec32fc41296c7b3248e0710943aa22fa918ff7089fb90
run-20261102-074114-fb309dd3run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074114-487776-f51a55/run_record.jsonsha256:033521ec316f7b5288a6ffa2b8c2494c61569941aec5d3531bb8c018350d3c54
run-20261102-074537-1abe2bd8manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074537-844315-589950/manifest.jsonsha256:4fa38b71945fad3f50ac50f00994d4ef58917f92a74217e7d3c9e7d07d29fa2e
run-20261102-074537-1abe2bd8evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074537-844315-589950/evaluation/pytest-output.txtsha256:4f72f91046e8da2c557345b093ff7757b5b0db1cb45edd63985f07dc1237863e
run-20261102-074537-1abe2bd8junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074537-844315-589950/evaluation/junit.xmlsha256:82a8dd85472a898ed8906ffaab1bcf93887152cf90cbdcd72732a3e7a04725d7
run-20261102-074537-1abe2bd8run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-074537-844315-589950/run_record.jsonsha256:2ad64a2f3b7080de39f16b19e9b744ef2d1629e668438e5d2434ad1ee5e2314a
run-20261102-075327-d3b09ae5manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075327-806281-dad6a1/manifest.jsonsha256:d425fc3ec771fc58700c85dab93e55495c9a889e4337043e3fa12aeba64a82cb
run-20261102-075327-d3b09ae5evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075327-806281-dad6a1/evaluation/pytest-output.txtsha256:3b593f5c3415c8335420f6ccb3e980022e624aee533f64096142416a4495396b
run-20261102-075327-d3b09ae5junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075327-806281-dad6a1/evaluation/junit.xmlsha256:6347175ea2e057d0534110b8465daeffa839060353bf4afdb20d8638f57f5689
run-20261102-075327-d3b09ae5run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075327-806281-dad6a1/run_record.jsonsha256:1c38c133a28bd8c103f5f2705b0ee476174b130af453edb69d30768f1a1cce1b
run-20261102-075736-7dc8b5famanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075736-642982-e96113/manifest.jsonsha256:c91340c52ba6e9c7fb6dad86cd8e8c7d7f08cc68110dc426073524ca167dd905
run-20261102-075736-7dc8b5faevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075736-642982-e96113/evaluation/pytest-output.txtsha256:cd92bfb2e50b84a7f22c6c9b34054a2dee00103715558413d9b57e947d21381a
run-20261102-075736-7dc8b5fajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075736-642982-e96113/evaluation/junit.xmlsha256:72329271f2ef09f6d32e3d217c01921a27227d18d93aca614ed9f4f1f2f81a0e
run-20261102-075736-7dc8b5farun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-075736-642982-e96113/run_record.jsonsha256:15dfb28b80bf82b0e6d59af0981ed022046227420b0fca85f4840a8be2755b5a
run-20261102-080204-89ac58c6manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080204-192479-4c6450/manifest.jsonsha256:f261d5e0248911b121705e40cad70e751036012f9a2ffaea6ffdc4c2273b8b58
run-20261102-080204-89ac58c6evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080204-192479-4c6450/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-080204-89ac58c6junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080204-192479-4c6450/evaluation/junit.xmlsha256:62e4f9e2f475db86624cb3e054fe0fdfeee7cf575d7a47ed951a7d57479d64f5
run-20261102-080204-89ac58c6run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080204-192479-4c6450/run_record.jsonsha256:18cdf4b459d7a5329ff60ce1ca5ee024be43ec6e1488b5b6f30178ca69d1d2b7
run-20261102-080410-d2c89897manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080410-025754-ef4cdd/manifest.jsonsha256:48be7dd8a8ad184e90afc72f3a509877f99a8c6ca064de72241832fef6d63411
run-20261102-080410-d2c89897run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-080410-025754-ef4cdd/run_record.jsonsha256:ca24836cd54f87dbc7de10b6e2dd72422e1d5c7e5d533a8f78a7e1140db34e7f
run-20261102-081913-0789e06amanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-081913-033298-d6494f/manifest.jsonsha256:a394a2e0062a67593ac53972de99d05d58d5750e17c8ee4754aa0dee422de3c1
run-20261102-081913-0789e06aevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-081913-033298-d6494f/evaluation/pytest-output.txtsha256:899c1157b37357cd0ce9c8788f129f6c1b5b29216d718f3ceff01dc3b43acafc
run-20261102-081913-0789e06ajunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-081913-033298-d6494f/evaluation/junit.xmlsha256:7479276430f7ef2618afe9d9f0835ade6c41bd5c324a78df56cb81546cbef815
run-20261102-081913-0789e06arun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-081913-033298-d6494f/run_record.jsonsha256:efc8d44a47e14301060f4a7c0835303287a33416f38e6bda515ff62a114d738b
run-20261102-082149-abdd844bmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-082149-315875-cfbf9e/manifest.jsonsha256:3ac7110c337e4171c26a2ab48484528ec62498f5ed35246f9e0f543f37d95c9c
run-20261102-082149-abdd844bevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-082149-315875-cfbf9e/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-082149-abdd844bjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-082149-315875-cfbf9e/evaluation/junit.xmlsha256:1eed3367b4845ef693a59af71cd6ee00aa8d09fea5fbf15ee35f92961758f9b3
run-20261102-082149-abdd844brun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-082149-315875-cfbf9e/run_record.jsonsha256:d74128ffe61d6bf29732505a95fc59c84f0914cfc47d87a2e44047c4eec740fc
run-20261102-083306-81799937manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083306-798597-4b705f/manifest.jsonsha256:adeee56c12142bd60b70d0c97119f2ade3295d2e8e56f2966d6d18022eb58382
run-20261102-083306-81799937evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083306-798597-4b705f/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-083306-81799937junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083306-798597-4b705f/evaluation/junit.xmlsha256:83a49c4ecd0ea79f02f036336615bc3eda88aa78dd751ae1039c0a076e572695
run-20261102-083306-81799937run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083306-798597-4b705f/run_record.jsonsha256:a9508355b4391f0a633fe6f67456d8a3389719f95cb291a2ad388a1816484698
run-20261102-083513-c8a810d4manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083513-530936-c83d05/manifest.jsonsha256:0d9a898fa1892b26f31e1bb68f7a0735379dbbb0d62d3178d6fd44663cc164ec
run-20261102-083513-c8a810d4evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083513-530936-c83d05/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-083513-c8a810d4junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083513-530936-c83d05/evaluation/junit.xmlsha256:f0681726e0638ebf40e20e3cf8d53c9e73b352e5b20a5e64c7342dcee0c3b4b8
run-20261102-083513-c8a810d4run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-083513-530936-c83d05/run_record.jsonsha256:aa144547532102793a70548a645592191c13bd6af2e256133e6264a301ecae69
run-20261102-084427-5c4e6c25manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084427-111481-d8b55e/manifest.jsonsha256:cfcae41b34fb892a91ea83b6b19cca52d9a019a4d757270a38c7b9beedb20689
run-20261102-084427-5c4e6c25evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084427-111481-d8b55e/evaluation/pytest-output.txtsha256:a5e1e05b8424b1fa75e60d353151fd76a6e808a7498e28784349d305c72a552e
run-20261102-084427-5c4e6c25junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084427-111481-d8b55e/evaluation/junit.xmlsha256:9488e281600cecd202011d12ad04cdf323b3ce075a44d8bb1e963cd1a15b47b0
run-20261102-084427-5c4e6c25run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084427-111481-d8b55e/run_record.jsonsha256:0cdcf39dd69223cf82bae276c5419081d7f598e29f4c9c787bdaca0c11d32e60
run-20261102-084722-12cb8519manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084722-014850-c4fb9c/manifest.jsonsha256:9218ff68d252ff712f65f14d669b710bb23ccf078b8e6bc57734d32bd6f1fa10
run-20261102-084722-12cb8519evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084722-014850-c4fb9c/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-084722-12cb8519junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084722-014850-c4fb9c/evaluation/junit.xmlsha256:74e8c8f3df5219f156bc617afb101ef95fa9a86d16e879a5bbac476c740a3588
run-20261102-084722-12cb8519run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084722-014850-c4fb9c/run_record.jsonsha256:b168af6c4f6b54d9cbd099bac04127ab03b10ce3495eb28164ec87ba3300e35f
run-20261102-084925-db233c9dmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084925-998612-e1d4ec/manifest.jsonsha256:fd72d05552e4cca37f638a63c984c15ee053d3a2881dc85ad1e9466af9e5210a
run-20261102-084925-db233c9devaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084925-998612-e1d4ec/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-084925-db233c9djunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084925-998612-e1d4ec/evaluation/junit.xmlsha256:e89c74d56fc2a9bae530e9f5577b74ac9fdcbe237911a89c8fbe475185809976
run-20261102-084925-db233c9drun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-084925-998612-e1d4ec/run_record.jsonsha256:526b8d2c2c7294b3a5570cce25316688c7d7ad9f366932961391949b1dd9d451
run-20261102-085126-7081e5a7manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085126-598281-4f840b/manifest.jsonsha256:1ffb7b02356973e7bbab2126fea9721dfac603a6c2fa47abbfccdd96bb9c9f73
run-20261102-085126-7081e5a7evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085126-598281-4f840b/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-085126-7081e5a7junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085126-598281-4f840b/evaluation/junit.xmlsha256:b628edb21fe16427664b3bc8e543ed905c3086c7b1089b418187de442f3822fe
run-20261102-085126-7081e5a7run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085126-598281-4f840b/run_record.jsonsha256:feb30a7dbccc1cd83e13361db72448cc2305ade2ab5f3b3af71470536dfbe26b
run-20261102-085717-2d40efc9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085717-126374-11cf2f/manifest.jsonsha256:165b572d24617cfbd5e1a63d742e429717626851932e414e1b2a3bedde5a2faa
run-20261102-085717-2d40efc9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085717-126374-11cf2f/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-085717-2d40efc9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085717-126374-11cf2f/evaluation/junit.xmlsha256:d190ea32660fd635469759c8fc99781d6d35352d35a31bbd25e24a735e45caed
run-20261102-085717-2d40efc9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-085717-126374-11cf2f/run_record.jsonsha256:6df50a081ddcd082657e5905601dac48f8f32a2fbd8f9a040c10e1bd21c110c4
run-20261102-090053-801966e8manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-090053-068023-24ab0e/manifest.jsonsha256:a5a326467671e5f61e0eac63e04840dafe73185c041d106da108be4ad5f059fa
run-20261102-090053-801966e8evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-090053-068023-24ab0e/evaluation/pytest-output.txtsha256:899c1157b37357cd0ce9c8788f129f6c1b5b29216d718f3ceff01dc3b43acafc
run-20261102-090053-801966e8junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-090053-068023-24ab0e/evaluation/junit.xmlsha256:256e12670c6f885adad5c0367038d876098d76ffb110a443cd7e65cdf24e6fc6
run-20261102-090053-801966e8run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-090053-068023-24ab0e/run_record.jsonsha256:74543ead9bdd106fedd15a18fa866e63da78f406b4c3eba471e0e61d0badcefb
run-20261102-102224-77a554a3manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102224-531075-a01f70/manifest.jsonsha256:e092c852525b4cd4d98369216b10123bad3698d34be3b72891657ef09235d00d
run-20261102-102224-77a554a3evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102224-531075-a01f70/evaluation/pytest-output.txtsha256:899c1157b37357cd0ce9c8788f129f6c1b5b29216d718f3ceff01dc3b43acafc
run-20261102-102224-77a554a3junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102224-531075-a01f70/evaluation/junit.xmlsha256:6a4d65eb319198a4ffa64363bbe6b572856faa46013b4d584699ce3f63c3a949
run-20261102-102224-77a554a3run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102224-531075-a01f70/run_record.jsonsha256:1e14532673c8c383dd127c2f9460dae9342a828489b95353514bb697735c78ea
run-20261102-102450-4c4dafd8manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102450-056436-dfdac2/manifest.jsonsha256:511fe9be614d8b89e274b06d2234410b21eef9a3c5f40b3f423cf3c81dd6783d
run-20261102-102450-4c4dafd8evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102450-056436-dfdac2/evaluation/pytest-output.txtsha256:471a8d57da183b8cf5f627404864e1676ab895570d3c197b60c6d35f9d07d7c0
run-20261102-102450-4c4dafd8junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102450-056436-dfdac2/evaluation/junit.xmlsha256:113c7a5c279a27c66955a87ddf394548348a1cdc0fac64c8d4f34bb9200fef29
run-20261102-102450-4c4dafd8run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102450-056436-dfdac2/run_record.jsonsha256:acb3ec427b8bb2c2e73a5c751304248227d4dedff57b34975daf1d91782d0d93
run-20261102-102846-f9da52d1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102846-335326-a1c965/manifest.jsonsha256:2de9664a2140214e4d1a7a65219d8f708b7e41973b19f516aa76244d7db3e354
run-20261102-102846-f9da52d1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102846-335326-a1c965/evaluation/pytest-output.txtsha256:2b0c02bd40a24b45d8b5998499b5f9fdc7663cef5ef8c1f0060fbe3718d7d21f
run-20261102-102846-f9da52d1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102846-335326-a1c965/evaluation/junit.xmlsha256:6045d574565d9f35b7c939ee64612fb5119c6b6b596e25cae005bbfc5faeb422
run-20261102-102846-f9da52d1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-102846-335326-a1c965/run_record.jsonsha256:6fd50f3b47c78b48da9a35cfecae94063f82eca0b11fe76be9163b3841177223
run-20261102-103139-c174189bmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103139-722883-ded8af/manifest.jsonsha256:13c976dfc11318dac6456a2fcfff9b244a806fc71634b966a47b826759aa9a60
run-20261102-103139-c174189bevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103139-722883-ded8af/evaluation/pytest-output.txtsha256:8933019e9584827a9f0e4ad9d59e1a23d0cc25cb232163884abf75137dbe7f24
run-20261102-103139-c174189bjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103139-722883-ded8af/evaluation/junit.xmlsha256:e26fd955beb4b03e744d922631fd41a60d73a77e620eccc250d3952cb81e4441
run-20261102-103139-c174189brun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103139-722883-ded8af/run_record.jsonsha256:518d5419aacbc74b50e97c7f5f8fa8f3200ddc3970cbf19b6d18dacd8bf60f97
run-20261102-103500-42595b9bmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103500-031925-fea2e6/manifest.jsonsha256:7c3a96a63cf3ec2250e59d1ed8ce569fcf08fe7c9f5f48946041fcf81da7fa91
run-20261102-103500-42595b9bevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103500-031925-fea2e6/evaluation/pytest-output.txtsha256:02bfaa8d85ebea5d433d89bf4d9703675e4721f81f1a945e08dfeb429a0b3557
run-20261102-103500-42595b9bjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103500-031925-fea2e6/evaluation/junit.xmlsha256:3145e17048ff9182b1173b73799de4e8fabe95cadf455ac82f3feb5d45e01e54
run-20261102-103500-42595b9brun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103500-031925-fea2e6/run_record.jsonsha256:250a4ed865802a3ef6d4530e5448ab715916cf77d81b261fc43c43bfc7d7e0e2
run-20261102-103806-ca54befbmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103806-998901-876c68/manifest.jsonsha256:338a27d29674da504c95878a3fc419a59c1d6abddc3bca0ad0886fee2ea208a0
run-20261102-103806-ca54befbevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103806-998901-876c68/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-103806-ca54befbjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103806-998901-876c68/evaluation/junit.xmlsha256:636743dfd550a3e726d94d8adb21964336a392c7a7374851c4687cebece50419
run-20261102-103806-ca54befbrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-103806-998901-876c68/run_record.jsonsha256:b6d65d23b49c99d0f0c48368386dc9ff8ce4233508a91296d346df8507c4d681
run-20261102-104150-ee470964manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104150-713351-70a3cc/manifest.jsonsha256:2bf69bbbbf54f985a6f780fd7ab589f88b45f6089e124982af8b146d40a985d7
run-20261102-104150-ee470964evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104150-713351-70a3cc/evaluation/pytest-output.txtsha256:899c1157b37357cd0ce9c8788f129f6c1b5b29216d718f3ceff01dc3b43acafc
run-20261102-104150-ee470964junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104150-713351-70a3cc/evaluation/junit.xmlsha256:7eadb05a1018186b4a57cd9bf22ea5a67d092189b7b38c1d4abeeb860af2e636
run-20261102-104150-ee470964run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104150-713351-70a3cc/run_record.jsonsha256:30c647447e2190576d7a5932e02ad28a4c4441eb998b9ed2eaaa4f5d13496053
run-20261102-104527-df556abcmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104527-861427-f0f7c6/manifest.jsonsha256:1b35bfbc08a543db38319d21471e5a54f3c569a075bdaf6f2d57c4642e56fe0b
run-20261102-104527-df556abcevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104527-861427-f0f7c6/evaluation/pytest-output.txtsha256:90f7471c36f6516c5c7996366fcf45f85082aee4a183c1d95e3f59e43924717e
run-20261102-104527-df556abcjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104527-861427-f0f7c6/evaluation/junit.xmlsha256:cebb91dcda611ba50fde29c525a0381d2482571cbe3f0cccdb181a712f48b5f9
run-20261102-104527-df556abcrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-104527-861427-f0f7c6/run_record.jsonsha256:a5fe396faf06df5c4f901f56ae42246bbc52d1c876674a6164001f8e2b472585
run-20261102-105101-7f0ea089manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105101-242131-e0e1d1/manifest.jsonsha256:56a31622cadb6d37472bea7156a08ae2988a51a2105271b45b6e62df35308c06
run-20261102-105101-7f0ea089evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105101-242131-e0e1d1/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-105101-7f0ea089junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105101-242131-e0e1d1/evaluation/junit.xmlsha256:bc4ed37876fbe7c3ec49ecb521f32f65d1fafa10c10d0a85afbbd38dbf647149
run-20261102-105101-7f0ea089run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105101-242131-e0e1d1/run_record.jsonsha256:b2503d2451200740f892a73df397c81ca31655b053aea9866b04e3b7ab3e900e
run-20261102-105332-509d420cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105332-842591-bd6b3e/manifest.jsonsha256:ff7f660525ae71908a019fddc9161a9ed9e945212a29e62ed9163db6a859d48f
run-20261102-105332-509d420cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105332-842591-bd6b3e/evaluation/pytest-output.txtsha256:e3d95197892949f7d3f1384585ea22c6317c24bd007758e0115fa7c2adb91b7f
run-20261102-105332-509d420cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105332-842591-bd6b3e/evaluation/junit.xmlsha256:79a50c8f09d54ace3b25a8a27e9e0f53573e1df7798dc0ada55673b31417f88f
run-20261102-105332-509d420crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105332-842591-bd6b3e/run_record.jsonsha256:caf518a314eacfc963836a8d9d58b2db3fde179ad46884e04916956df5e47297
run-20261102-105924-5844ec5cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105924-881247-a3b972/manifest.jsonsha256:fa0da466b2872e9b0b32f1abdf2e6e9e972837440eee5439c55b1412f0231765
run-20261102-105924-5844ec5cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105924-881247-a3b972/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-105924-5844ec5cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105924-881247-a3b972/evaluation/junit.xmlsha256:da99d423b0eaaaa4ea1a64435a75673aebb0f39507265fa7f23d2995eda73c7c
run-20261102-105924-5844ec5crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-105924-881247-a3b972/run_record.jsonsha256:48e057d876f06cd0258fc82eb45081e9bf4396757dddb6cd7422869b833a93ba
run-20261102-110711-12e9e01emanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-110711-037468-19004b/manifest.jsonsha256:892b35579aa7bb55625f74547d2222805a2b2ff607c3eb9e6d0629a7f7022c55
run-20261102-110711-12e9e01eevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-110711-037468-19004b/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-110711-12e9e01ejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-110711-037468-19004b/evaluation/junit.xmlsha256:1e97a7cbe38f60164dc8839582ace0ae0fda6bcda05d32e4fd92d5b534d0dacd
run-20261102-110711-12e9e01erun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-110711-037468-19004b/run_record.jsonsha256:cd73a1f1bb9ba3265fa734cdce621cdb0413dc01a1153a9f6c1b0491c9156439
run-20261102-111029-a9c04726manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111029-551387-9ad612/manifest.jsonsha256:2163e31439bb8952395634958b9daa651199e37c912cedaade402600fc8be624
run-20261102-111029-a9c04726evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111029-551387-9ad612/evaluation/pytest-output.txtsha256:90f7471c36f6516c5c7996366fcf45f85082aee4a183c1d95e3f59e43924717e
run-20261102-111029-a9c04726junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111029-551387-9ad612/evaluation/junit.xmlsha256:235ea877a1f05463981a289e131fd5c96ef8cd2e994b8b45aaa49182b6c8a09c
run-20261102-111029-a9c04726run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111029-551387-9ad612/run_record.jsonsha256:321d9c4e6165251aa8ec3112a4f93d000138818d316f4d8dba523af0782a2f2f
run-20261102-111326-3c584bd3manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111326-995991-950f41/manifest.jsonsha256:3ae576735630d6014b752319868fdc091e981af608653e0ce1616a40ef110557
run-20261102-111326-3c584bd3evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111326-995991-950f41/evaluation/pytest-output.txtsha256:e3d95197892949f7d3f1384585ea22c6317c24bd007758e0115fa7c2adb91b7f
run-20261102-111326-3c584bd3junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111326-995991-950f41/evaluation/junit.xmlsha256:9337c979d86201480f77148f45becbaad015398f2fcae4d8beab92a560abaf00
run-20261102-111326-3c584bd3run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111326-995991-950f41/run_record.jsonsha256:7a1c3d4f2202db57cc79cd78818c132f4fb8a8fe1fb02c63e103bc5c3b41a139
run-20261102-111537-b9ab2fefmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111537-978673-a7368b/manifest.jsonsha256:c6d05b4fd510bba0f6afa66cd1bfe5f91c742c9e4e1b7eae2db81f7f27c3fc81
run-20261102-111537-b9ab2fefevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111537-978673-a7368b/evaluation/pytest-output.txtsha256:e4a0d3dcc82d278028a31132c5039d6434fbd393a1affff957615260924b81a6
run-20261102-111537-b9ab2fefjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111537-978673-a7368b/evaluation/junit.xmlsha256:6050f0baf41d97e97d08da6163bd4be7f527e6e7c5c3a2d5aaba3eac08b412e4
run-20261102-111537-b9ab2fefrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111537-978673-a7368b/run_record.jsonsha256:1d400ab76daedae5a8fdbe7f8b4c4cac15e68cbba2aae8ffa8ca192c46aeee26
run-20261102-111839-c5f2e4c1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111839-934928-34e551/manifest.jsonsha256:75a32728835a55a20c3e5116737cbd30d4487bbf903c7b956a2999062fc55f41
run-20261102-111839-c5f2e4c1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111839-934928-34e551/evaluation/pytest-output.txtsha256:e3d95197892949f7d3f1384585ea22c6317c24bd007758e0115fa7c2adb91b7f
run-20261102-111839-c5f2e4c1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111839-934928-34e551/evaluation/junit.xmlsha256:f2a18e67b3542aef652dcd078083b12c807d9c8380e002402d6651b2385fea03
run-20261102-111839-c5f2e4c1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-111839-934928-34e551/run_record.jsonsha256:411d8bfc7ec52a44abb472754a03de943f13ad2a8189359676d295db71e4dcb3
run-20261102-112306-6bc27784manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112306-635617-d61886/manifest.jsonsha256:b46c8270dc8c7168d0c6258b9e5e4dc2c26dff5dd4d22538a06630c46bc3c2f7
run-20261102-112306-6bc27784evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112306-635617-d61886/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-112306-6bc27784junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112306-635617-d61886/evaluation/junit.xmlsha256:faed250809d13f3f72b11870d19988d117880eaae263e2a25e84770e1712fed5
run-20261102-112306-6bc27784run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112306-635617-d61886/run_record.jsonsha256:74fc38019387f77eef2d3c19b350637d53c2ab67f1d3f8df4f00837fc02a859d
run-20261102-112953-68b1af75manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112953-900161-63f7d0/manifest.jsonsha256:437afdc13f3a085cd493108d0651c6bc43d56a6d557b7873a67e7ac4b9eba078
run-20261102-112953-68b1af75evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112953-900161-63f7d0/evaluation/pytest-output.txtsha256:1fd84170e91c9f7b330865ff3d43fdcbaf977062fbc7bc4402cc92a6161a9951
run-20261102-112953-68b1af75junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112953-900161-63f7d0/evaluation/junit.xmlsha256:1f423be890af0f6bc0e2601c1e36d8e2f2a3b608cdb48eb10e2dc5b1dba2cc08
run-20261102-112953-68b1af75run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-112953-900161-63f7d0/run_record.jsonsha256:84e40a16dab28cde0e23152d3ee7e4b89b0f2ba416bd81c357b8970f65c39fdd
run-20261102-113507-5543ffe1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-113507-094219-cf8d83/manifest.jsonsha256:02e6b201b6ed6964b58d94645bf040b05124eb3643951419d3190aad66a40b95
run-20261102-113507-5543ffe1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-113507-094219-cf8d83/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-113507-5543ffe1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-113507-094219-cf8d83/evaluation/junit.xmlsha256:00d29f348aa42b342cd619223af4a7fccb65e4cbf95aa6ad5f84a23a1c7f6093
run-20261102-113507-5543ffe1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-113507-094219-cf8d83/run_record.jsonsha256:6ab286cfae214b9283a48677d096d28ccc8d08f546a8800768dabe271b9b4739
run-20261102-114156-1ff0ba59manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114156-748312-7db18a/manifest.jsonsha256:224dcaf434edcba12951853e7df608d9029e6f5140be29113999650b84ad18a0
run-20261102-114156-1ff0ba59evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114156-748312-7db18a/evaluation/pytest-output.txtsha256:2b0c02bd40a24b45d8b5998499b5f9fdc7663cef5ef8c1f0060fbe3718d7d21f
run-20261102-114156-1ff0ba59junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114156-748312-7db18a/evaluation/junit.xmlsha256:b780eab768d2a95a7251ac03669dfdab5703ddac14a6a208ff166fe3a76b6cd0
run-20261102-114156-1ff0ba59run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114156-748312-7db18a/run_record.jsonsha256:bbe0484279fc87684fd6f731df393b914a48afeb1ef0b7bfe3d1ab149c9349fa
run-20261102-114446-b3513377manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114446-326901-dd0ccb/manifest.jsonsha256:46e6eedd0af99cc046e276c1d80c4c4f7edb2ee3ff4d2ea63b6e16746c080933
run-20261102-114446-b3513377evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114446-326901-dd0ccb/evaluation/pytest-output.txtsha256:899c1157b37357cd0ce9c8788f129f6c1b5b29216d718f3ceff01dc3b43acafc
run-20261102-114446-b3513377junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114446-326901-dd0ccb/evaluation/junit.xmlsha256:94fda4de077146790f669b26e27b77649342ac84110f8c9fd890eff5069d83ff
run-20261102-114446-b3513377run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114446-326901-dd0ccb/run_record.jsonsha256:aeb803d601ab5022d96e8b36f1033edb133b63b9357141b61cddeca072fdd56c
run-20261102-114752-9f3f4f92manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114752-154940-71adf2/manifest.jsonsha256:9cafb3e18d745627d463b895e61ffb67f6ac919ff628aea1c945dcc337f8e480
run-20261102-114752-9f3f4f92evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114752-154940-71adf2/evaluation/pytest-output.txtsha256:44c998dcdc2c22e29d3eea53d131f0bdd90768cf4c75de3c7cbc9d2e04a6006e
run-20261102-114752-9f3f4f92junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114752-154940-71adf2/evaluation/junit.xmlsha256:1e32fc3cf3f3107e6972ad17f576bf34e00008587b8e8c71696eb9008cc7ac60
run-20261102-114752-9f3f4f92run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-114752-154940-71adf2/run_record.jsonsha256:a8bfa07323537f10a8f8a2b6f8fca4bd7193572d53a00a3ce7595a404635e110
run-20261102-115051-39be5247manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115051-692528-878246/manifest.jsonsha256:720454f080cd4cb73c39909b2c1e7718acc3f36180af537bf48edc6e0bc957d5
run-20261102-115051-39be5247evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115051-692528-878246/evaluation/pytest-output.txtsha256:e3d95197892949f7d3f1384585ea22c6317c24bd007758e0115fa7c2adb91b7f
run-20261102-115051-39be5247junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115051-692528-878246/evaluation/junit.xmlsha256:46c3610fcbe0695e768a126e28f40087d876c84a8d6868aa753d46e33ce47db9
run-20261102-115051-39be5247run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115051-692528-878246/run_record.jsonsha256:a65345e63be132c590205b48e94ea4c4fa8bae082aafe0eedde88bcb70f4856a
run-20261102-115611-ee478152manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115611-438672-7365cb/manifest.jsonsha256:d1fd61440c5bfb8fd67b6b044467f92e8dc7982b70074a5e3c91564811d5d1c5
run-20261102-115611-ee478152evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115611-438672-7365cb/evaluation/pytest-output.txtsha256:e3d95197892949f7d3f1384585ea22c6317c24bd007758e0115fa7c2adb91b7f
run-20261102-115611-ee478152junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115611-438672-7365cb/evaluation/junit.xmlsha256:2d27ce681424824e5613716a151da80c991459f35c8809ce46359435e04650e2
run-20261102-115611-ee478152run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115611-438672-7365cb/run_record.jsonsha256:96999f63de53fa220af6c196c532ef2d2569761801ae445313dd517a9ba08976
run-20261102-115850-e5f2348fmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115850-903916-d3d92c/manifest.jsonsha256:a1ff84287b70501a24cc5ce24656fbdf70360690cf4a9a1428c3f257f0e3bd56
run-20261102-115850-e5f2348fevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115850-903916-d3d92c/evaluation/pytest-output.txtsha256:4317ae4f4bee172c40a648986b52978c41a873522d318d9c9370201b46522098
run-20261102-115850-e5f2348fjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115850-903916-d3d92c/evaluation/junit.xmlsha256:a68438209df896c53ad265603bab74af863c894bab4cd8cef616390bd6b8775a
run-20261102-115850-e5f2348frun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-115850-903916-d3d92c/run_record.jsonsha256:b4b9f1c259c35b5a5bb85e3d9b9689cc3414b3ce134da7af30ee071be6efd79e
run-20261102-120221-58de15afmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120221-715929-53840b/manifest.jsonsha256:276a2e357d1d6c610409eb53f9b38c9c843830e5d4b977522d6c5a59c5beaff0
run-20261102-120221-58de15afevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120221-715929-53840b/evaluation/pytest-output.txtsha256:9738f121db081702d460432ed4962d242aa468970c0778fbb5122cbf619cd9a5
run-20261102-120221-58de15afjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120221-715929-53840b/evaluation/junit.xmlsha256:86a1b86a05661f118529f3fe93a3fe08fa1238f5113acbc8ae3860f7cffa707d
run-20261102-120221-58de15afrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120221-715929-53840b/run_record.jsonsha256:93d24678944c95baeaa5de034ecdc7c11cbbcf7c4e757b5941eb88eac7a6ab99
run-20261102-120435-e4b44447manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120435-274917-0bc3b4/manifest.jsonsha256:6db42a12fc71922d86ed27c54b86307b45deff96302fd2bfdf50659714056a5d
run-20261102-120435-e4b44447evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120435-274917-0bc3b4/evaluation/pytest-output.txtsha256:4317ae4f4bee172c40a648986b52978c41a873522d318d9c9370201b46522098
run-20261102-120435-e4b44447junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120435-274917-0bc3b4/evaluation/junit.xmlsha256:7f9aa1c0c35071da2a393fa8b63e66f3c58eebbcc1a35f52241052edfce14140
run-20261102-120435-e4b44447run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120435-274917-0bc3b4/run_record.jsonsha256:d73ae965550f76736c397182d97b163bac4370854736fa8bb737295d1f372dff
run-20261102-120616-d577d4b1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120616-305502-d12d9c/manifest.jsonsha256:2d6a8fb4b6ddb3e1831ad8c45d852096509aab8c869c89d15d28af7311035ba8
run-20261102-120616-d577d4b1evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120616-305502-d12d9c/evaluation/pytest-output.txtsha256:c84c206b4bbe9aa1fa87615cc2e54cad3e2d5b45ae36f3f4dfa9ccc6b1d38404
run-20261102-120616-d577d4b1junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120616-305502-d12d9c/evaluation/junit.xmlsha256:476c02f3906a3b47ce925ddf286e3c073937aad185f95898c6c05f92406760ba
run-20261102-120616-d577d4b1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-120616-305502-d12d9c/run_record.jsonsha256:a2df5816ae81d7d25ee840b598335d2f35b57a20ba1e51786a5765327ec0975d
run-20261102-121131-13e4a8b5manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121131-906329-a4522d/manifest.jsonsha256:4e0b2213ca2e6e66c7f27abfa57eb84b5196ca0247e87ea161a7c7aafbd35b1a
run-20261102-121131-13e4a8b5evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121131-906329-a4522d/evaluation/pytest-output.txtsha256:a4c1d593684e393f43f03885cc440b0249442b44ff71ccbedede1fd1bcf7d69d
run-20261102-121131-13e4a8b5junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121131-906329-a4522d/evaluation/junit.xmlsha256:dc119abd039ed4f4ff6488f1b74710a71c62629b0291dcd9fc6c1fded31f35b8
run-20261102-121131-13e4a8b5run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121131-906329-a4522d/run_record.jsonsha256:25c8b3fceb199bc072ddfec55b67c99f2ce4125a9d411b274671eb8f128eb3a4
run-20261102-121528-03d9f220manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121528-159854-1b1389/manifest.jsonsha256:91b97e65a51e28b725df7cc05e2cfaf89623b74658283c754703799e93f4ee0c
run-20261102-121528-03d9f220evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121528-159854-1b1389/evaluation/pytest-output.txtsha256:91170cba0f01d5b722272f37deeecc07e31ce69a10eb1784c238b864f41e44a7
run-20261102-121528-03d9f220junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121528-159854-1b1389/evaluation/junit.xmlsha256:5b43c0c285daf853d16a665a63072488ef0d0123d8bca836a0eaa9f1b0aed280
run-20261102-121528-03d9f220run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-121528-159854-1b1389/run_record.jsonsha256:6cdcbdb534ac141eff89560193349e15622d8138e5581db4d9607345cfaa1934
run-20261102-122054-f8985461manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122054-804860-af506a/manifest.jsonsha256:fa4391716e3c210e9e62fecfc8c1d8570fcc0939128f66ac7677838bf7d2bd95
run-20261102-122054-f8985461evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122054-804860-af506a/evaluation/pytest-output.txtsha256:edad392a4c3ce92531a81631e23654b967c5bec95737266753eb0d70fce7c72d
run-20261102-122054-f8985461junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122054-804860-af506a/evaluation/junit.xmlsha256:615a59ecd0bcbcb9483f262f4871dd4f3d85adf1c2e6d802bc4fc199e1ce3b61
run-20261102-122054-f8985461run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122054-804860-af506a/run_record.jsonsha256:b8972d74a7b40b28ed9c7c349692debd9f16cf5488955274804bd22104d3f41a
run-20261102-122358-fec2acfemanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122358-806190-8dd097/manifest.jsonsha256:5c3ff95b3ec4f3a8a96dfadae78b7ee4cf59e3cedbb8fa55c148606ff16fa3c7
run-20261102-122358-fec2acfeevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122358-806190-8dd097/evaluation/pytest-output.txtsha256:c4b64d9d41f0f0bc649913de8047576b7741e13b909d82a94732cdef836da0ad
run-20261102-122358-fec2acfejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122358-806190-8dd097/evaluation/junit.xmlsha256:357bf4602773d1d354e375fd29eb77dcfcc9f0d81854c89cee8e67138420f0fc
run-20261102-122358-fec2acferun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122358-806190-8dd097/run_record.jsonsha256:d035fcc0810795274da31cf2a22e0bf94820859d428893156c521ab0583e9f03
run-20261102-122856-43bd96e6manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122856-648755-dd8af8/manifest.jsonsha256:cfcc44adceda7e67cbbd6a3b4a1b8ced58e848c5e8bea6aa25944c82313ba3e5
run-20261102-122856-43bd96e6evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122856-648755-dd8af8/evaluation/pytest-output.txtsha256:9738f121db081702d460432ed4962d242aa468970c0778fbb5122cbf619cd9a5
run-20261102-122856-43bd96e6junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122856-648755-dd8af8/evaluation/junit.xmlsha256:df22f772572cb97c41779931dfbd9042e7bd8da562df0b1f30c2da44c958ea12
run-20261102-122856-43bd96e6run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-122856-648755-dd8af8/run_record.jsonsha256:082b757841387914d7c52d3261fd42491ef487be1aa0f509cdde68f8be4fadf9
run-20261102-123353-08bae5f2manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123353-523687-795d94/manifest.jsonsha256:48ccc8e3d059bd200a20818ede1f7bb31826c7f71bf62a4408d4365c241a304b
run-20261102-123353-08bae5f2evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123353-523687-795d94/evaluation/pytest-output.txtsha256:9f428dc56dd1e68db59178aca6e90cf0b9f898387bf11f0890ec6ce0c67acaad
run-20261102-123353-08bae5f2junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123353-523687-795d94/evaluation/junit.xmlsha256:ca22a525a4f8794eff07d363faf28700ca1aea922c940976a406e8f61c08d84b
run-20261102-123353-08bae5f2run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123353-523687-795d94/run_record.jsonsha256:2abc915110a5d08405f726925a59b018ee8ecbc31705d1d4703611c0ffd99f97
run-20261102-123722-abf5b6a0manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123722-543457-55cd54/manifest.jsonsha256:b748bab21b9fa9ae0a11f28715a27254b87ed3ce885c9b0ff797cdacf40008bb
run-20261102-123722-abf5b6a0evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123722-543457-55cd54/evaluation/pytest-output.txtsha256:4317ae4f4bee172c40a648986b52978c41a873522d318d9c9370201b46522098
run-20261102-123722-abf5b6a0junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123722-543457-55cd54/evaluation/junit.xmlsha256:4dadc4ca81d664ea6e87bf541b02b5901f5865970b3ca16754a89fb24342b687
run-20261102-123722-abf5b6a0run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-123722-543457-55cd54/run_record.jsonsha256:2e6c6ff0dfcb5f6d575a2888b6ad40f001cce29078609a8c084aacf338c72bac
run-20261102-124013-4e335fc0manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124013-894582-58541e/manifest.jsonsha256:b8af5abb244b195453b601246445bde6f2dbd34fb33a4525030255d7dc3ce584
run-20261102-124013-4e335fc0evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124013-894582-58541e/evaluation/pytest-output.txtsha256:f97bd483abacefd56226eda140d69d425150fe16bd7cf2e869542d1e8fed9a14
run-20261102-124013-4e335fc0junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124013-894582-58541e/evaluation/junit.xmlsha256:31373fd4211df0b04d25bc45eda1b843be43d0a77a8f68b74301b6d1b57d19bd
run-20261102-124013-4e335fc0run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124013-894582-58541e/run_record.jsonsha256:db44f0a71f5229e7b924ebdcd9fed889b4b1be84bc3aaafa70e2231adbcb8af8
run-20261102-124303-45bdfb12manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124303-207770-3283e6/manifest.jsonsha256:7a264d64a9eef5d766ed7560654296f6c25a08bd54aabfc873cf427bf95543c6
run-20261102-124303-45bdfb12run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-124303-207770-3283e6/run_record.jsonsha256:d408d95a49df71d5832d9c0f1deb6f3ff07883d67ccfe66421bfe77ee305d49e
run-20261102-125808-280ac90dmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-125808-165622-d233e0/manifest.jsonsha256:ad904b0e04f2f6b802f5d23d7484049900d867c5d7310ad2d70fad4293d8ab14
run-20261102-125808-280ac90drun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-125808-165622-d233e0/run_record.jsonsha256:621e3e70345070283810e4bf741b6f5e24773cafa23b966a9bb3be81ec22c5de
run-20261102-131314-47751b92manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-131314-439849-194a87/manifest.jsonsha256:3926b3089a20ed563311252c8388def7a7a6fa3fc4c55252c1f26e18e6cad4c2
run-20261102-131314-47751b92run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-131314-439849-194a87/run_record.jsonsha256:98e86f04dcd65df5cba38fe2b917ccf7c66fb659f0890dd613e39fa20bfa8e09
run-20261102-132819-55ee19e1manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-132819-925782-8c5d03/manifest.jsonsha256:a02bbfaff3a18eef546f5fba6d8fb50c66e12c670b05c01cab323794c8386fd4
run-20261102-132819-55ee19e1run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-132819-925782-8c5d03/run_record.jsonsha256:26af7b43f927f8762138942c2426848acd16817306679a8e7b2f07479383404b
run-20261102-134326-1f193cecmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-134326-010763-24adc4/manifest.jsonsha256:9e4d0af3a46b8fbe90435aff5d67253b2e7ee6ee75986422245f861d5ccb3a06
run-20261102-134326-1f193cecevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-134326-010763-24adc4/evaluation/pytest-output.txtsha256:b9858d425197bdf5ce488f91241eb87e1f333fe7aca637d1df9d73b099747885
run-20261102-134326-1f193cecjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-134326-010763-24adc4/evaluation/junit.xmlsha256:13de7bcd25c584b49fcdd0bec1c07042b77eb22fce36b00b60953afde743bc2d
run-20261102-134326-1f193cecrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-134326-010763-24adc4/run_record.jsonsha256:dea2200731bf2cfd8a2aa44a8606735beb9d5c53aa0bd7b4edd939ff608c4bef
run-20261102-135659-dfdbb7eemanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-135659-006548-ab002e/manifest.jsonsha256:c636fa8c7840421bf7f6069a7fe99914b9ddb43fb2bcd4dc69e1d0a356e11a5f
run-20261102-135659-dfdbb7eerun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-135659-006548-ab002e/run_record.jsonsha256:aba04e27875693b1f20230d36e6f7f78c4ebc8ff47c8feba835920c027911126
run-20261102-141204-1573e7b2manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-141204-642425-930739/manifest.jsonsha256:3d79fae25aee08e5875f7875d8a4dcfe5fb3d327a2f97394fca197a2332fa53d
run-20261102-141204-1573e7b2run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-141204-642425-930739/run_record.jsonsha256:ee12157a50079cf50bd12a9da2bdb5829e3bc7ae1b5c52df748f11aef57e0d70
run-20261102-142710-0136dc94manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-142710-012953-15f141/manifest.jsonsha256:84924002b5ced70362389a753932027db9d8e147ef8b1d8d2ecef0b7906e01ba
run-20261102-142710-0136dc94evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-142710-012953-15f141/evaluation/pytest-output.txtsha256:db6a4fb39e492c15f2f48c5d1aa7736dc19307f338e35dde087ae6f3d319573d
run-20261102-142710-0136dc94junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-142710-012953-15f141/evaluation/junit.xmlsha256:89164bbd4e552dcfe20b6a077b3d74a9680de229c3d14f9ed29e9459bf4854c2
run-20261102-142710-0136dc94run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-142710-012953-15f141/run_record.jsonsha256:d522b1bdea0a458f83efc46aca18a32ad1bad91afd30a35cd6d33bda758f7964
run-20261102-143842-25bc3410manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-143842-464067-18b07c/manifest.jsonsha256:9aad996bfd2e7ed84be0a383145fd3f8a8a1615b8e7d381b6dbaafa265f3224a
run-20261102-143842-25bc3410run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-143842-464067-18b07c/run_record.jsonsha256:c926a744d797d23e5c4f5d36a96010cc0540b33ec60a539482cd88e14c4d49c8
run-20261102-145348-58a7a3f3manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/manifest.jsonsha256:c7beff4a9124d00e7754cb7d64ff705b2669d2cc00b7432bb2dfe9a723d81c54
run-20261102-145348-58a7a3f3evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/evaluation/pytest-output.txtsha256:0314f1b7134a5e7b5c45cfc5c0eb31794c4bd20c5810332bba16a28a0290e0f0
run-20261102-145348-58a7a3f3junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/evaluation/junit.xmlsha256:e706c7504040d11760e0682e996ae1451b012205022e04ff52186024f6f0bf1a
run-20261102-145348-58a7a3f3run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-145348-079045-e23afd/run_record.jsonsha256:e0f7fecbb591cf3211b89e05a1dec627f4edc4f4de3df1bb9c924e6b6746e349
run-20261102-150618-18c32d85manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-150618-095735-eef740/manifest.jsonsha256:285b38ce481497dd11d6a3b717b05237c05e80bda8bda72b64320227c5132fde
run-20261102-150618-18c32d85run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-150618-095735-eef740/run_record.jsonsha256:fcba82d4b8ac881da5403209b9c6e34d74a9460c14ef847eb9295bf7789ea78e
run-20261102-152123-401b3de4manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-152123-593721-3fbc2c/manifest.jsonsha256:ae649eb515a8e2d23af904263bea48227624a5e22588e5d8630d97520370cba0
run-20261102-152123-401b3de4run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-152123-593721-3fbc2c/run_record.jsonsha256:d4683c1c605c01e6b840d68ddcfc1b5e29194a2e8dddbe88e8c51b3af8a56b47
run-20261102-153629-de5ac66dmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-153629-748457-fcc18e/manifest.jsonsha256:ac09c55636a34490ff51b0b3ffd8e89153c191dd73d183f5661e1d87db2ff712
run-20261102-153629-de5ac66devaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-153629-748457-fcc18e/evaluation/pytest-output.txtsha256:68058228fb2dd30ff07c0d3ede5740055c350298ee277328bc6c14a9bbd5a4ac
run-20261102-153629-de5ac66djunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-153629-748457-fcc18e/evaluation/junit.xmlsha256:852c0c4edf17ba70b960cbfc8d7381c71765ce9bcc86c4aa2679c175b5e034dc
run-20261102-153629-de5ac66drun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-153629-748457-fcc18e/run_record.jsonsha256:bf528b1cb8f691cd21b67689a1b2f116d944be9341e823c7e88d6797159dba46
run-20261102-154610-09481f31manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-154610-788323-b33b05/manifest.jsonsha256:faf5e9d340a2ab9cbf90440415cf31e70318cca26b3f486b9e1daab366b6de2a
run-20261102-154610-09481f31run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-154610-788323-b33b05/run_record.jsonsha256:33b76e847fc40c55c03bcecd53fb2e07150ef250719b422ef2a266069a46be61
run-20261102-160115-cb48ab31manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-160115-059447-d85e5d/manifest.jsonsha256:717586ca2ffd799b91c4ad46890fd5ba78a171656d840fc21712a28e3db8019d
run-20261102-160115-cb48ab31evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-160115-059447-d85e5d/evaluation/pytest-output.txtsha256:2b014553ce5322f149049d5a10719be32316eb5a3cdfe8d1f16dbe56683fb8c2
run-20261102-160115-cb48ab31junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-160115-059447-d85e5d/evaluation/junit.xmlsha256:8157e696c64de58f02811714ca5c4010fcbfc0735380abd65e81b5e2e07585d8
run-20261102-160115-cb48ab31run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-160115-059447-d85e5d/run_record.jsonsha256:5073229ab10e36720214cd7ee54c0a4760e6b58ab2565d7aeb3c066778a347c9
run-20261102-161153-16c04a4emanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-161153-510938-a0b2fd/manifest.jsonsha256:c5603f0d71a390b10db91c4943805c5ec97d4cd5937a5b51d2f5f9361b17a964
run-20261102-161153-16c04a4eevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-161153-510938-a0b2fd/evaluation/pytest-output.txtsha256:b343cce45024e4cf74754dc7db572eb3e74a3ea1de8932780f1da164e8df2ba3
run-20261102-161153-16c04a4ejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-161153-510938-a0b2fd/evaluation/junit.xmlsha256:b872aa2a22ad7c06e82cd5b6938b157fccb59d15f0cfab8f10ac68d2320cfc53
run-20261102-161153-16c04a4erun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-161153-510938-a0b2fd/run_record.jsonsha256:9df9340b30be9257d518e9285f394d11182943d254b203af430ac01d1028d7b4
run-20261102-162330-279c2d0emanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-162330-123083-a6cdf0/manifest.jsonsha256:64c82378a5f71e5bc44ca8f3e72c13df6b65fa25f292a7608e05c4c13db2eaac
run-20261102-162330-279c2d0eevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-162330-123083-a6cdf0/evaluation/pytest-output.txtsha256:a9eb507c86335687324402298463be0288a973c8d5584049b8434c766c0ce114
run-20261102-162330-279c2d0ejunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-162330-123083-a6cdf0/evaluation/junit.xmlsha256:964a961becce25e88878f48a1ae1a4b2993e9fcee7d12bac5f6d8607b3c9f9e5
run-20261102-162330-279c2d0erun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-162330-123083-a6cdf0/run_record.jsonsha256:78b903b1a3e09f18db5bd50ec490c1399d2ee036099ff7d5c4260c2cc5b08f9b
run-20261102-163521-b51708f9manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-163521-444067-397b40/manifest.jsonsha256:bc03be0b0bf1e2f502541ed1188df6d91df78ed4c390adbfd1ac9f36279de2f2
run-20261102-163521-b51708f9evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-163521-444067-397b40/evaluation/pytest-output.txtsha256:6748f4bf6bdb892115858ef2cbfafee36afbdd75280611a19cd48d2aa613be11
run-20261102-163521-b51708f9junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-163521-444067-397b40/evaluation/junit.xmlsha256:fd0aa64f5dd22e8077265a31504f9ec744bfd1d605670c296001bd72337c34f8
run-20261102-163521-b51708f9run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-163521-444067-397b40/run_record.jsonsha256:d4c4b4d4fedccfe4a242590382e3db9c614f6ddfffe4a08b60e5a1c7e4b41a8f
run-20261102-164738-43ff8923manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-164738-331357-978463/manifest.jsonsha256:1390930ea4cd97fdc20222cfa5bc50037a2813d8366a3982fac7236f5dfd714c
run-20261102-164738-43ff8923evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-164738-331357-978463/evaluation/pytest-output.txtsha256:68058228fb2dd30ff07c0d3ede5740055c350298ee277328bc6c14a9bbd5a4ac
run-20261102-164738-43ff8923junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-164738-331357-978463/evaluation/junit.xmlsha256:3f3256ab8f83487e84576ad66fd38e8ed133b83027f71b08e768951c74f3dd63
run-20261102-164738-43ff8923run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-164738-331357-978463/run_record.jsonsha256:b287b8107b8a9fce0fbe1e8e3c90750d5475b35ac57dcdfcec1ce37d42bee1e5
run-20261102-165407-d907f577manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-165407-684731-97860f/manifest.jsonsha256:2c11e0e6e4c93078abc103f6948fac446d2a0296920d08fa8eddaea9fadb3e34
run-20261102-165407-d907f577evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-165407-684731-97860f/evaluation/pytest-output.txtsha256:b343cce45024e4cf74754dc7db572eb3e74a3ea1de8932780f1da164e8df2ba3
run-20261102-165407-d907f577junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-165407-684731-97860f/evaluation/junit.xmlsha256:3bfbf59266e7234ae32fb456c41546a6474c0c1165d6933f6c9938e2ee7ce21f
run-20261102-165407-d907f577run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-165407-684731-97860f/run_record.jsonsha256:0fc8c1f2f8e6bde0a14a58c76fd3c0571ce5c428e34da7bbda2c9f58c3e82965
run-20261102-170536-da2abfe7manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-170536-782519-5e730f/manifest.jsonsha256:0be48f0dd73db43655e4a47aad030d605d794396856333a7171eb8e622894dd1
run-20261102-170536-da2abfe7evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-170536-782519-5e730f/evaluation/pytest-output.txtsha256:57ade89e74e3b9e2e18533c44b432ee9c6bbfe5833b2598448bf369f967a4194
run-20261102-170536-da2abfe7junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-170536-782519-5e730f/evaluation/junit.xmlsha256:28f506682eabf4620605e177b0bbc0e86a2b46662897bac70acd34ca987284eb
run-20261102-170536-da2abfe7run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-170536-782519-5e730f/run_record.jsonsha256:694ac3b917ddc788f4063da60623921487f88cd67ed7980fd4aa6258af353865
run-20261102-171345-07e43bdbmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-171345-162256-01d133/manifest.jsonsha256:46e3148529673ce63b90f2beeb08e79b81ca45283bd3d664869d9539b0b5a585
run-20261102-171345-07e43bdbrun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-171345-162256-01d133/run_record.jsonsha256:0d3c879dadc5b8c7cf6e3f0da2de93b2042701be689e463249ffbeb65180eb29
run-20261102-172849-b26fa228manifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-172849-634919-ab2940/manifest.jsonsha256:ae150e03d0615268d31186c302854965821081d05feebdbc64ca30cbb5f76462
run-20261102-172849-b26fa228evaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-172849-634919-ab2940/evaluation/pytest-output.txtsha256:68058228fb2dd30ff07c0d3ede5740055c350298ee277328bc6c14a9bbd5a4ac
run-20261102-172849-b26fa228junit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-172849-634919-ab2940/evaluation/junit.xmlsha256:c3d36d1ffffe6d732fc60eb9dd072bad7eafb453b4149869356aca3be6d7d771
run-20261102-172849-b26fa228run_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-172849-634919-ab2940/run_record.jsonsha256:38b300a14b877c6476c933fd661c9f58c4999f4df1023ad1f9a64a7c0b61d46d
run-20261102-173920-82f7a48cmanifest/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-173920-124943-bae8f7/manifest.jsonsha256:54c932ed13081ea0726b7839206de61121058f187569cc1574aa734641a912eb
run-20261102-173920-82f7a48cevaluation_output/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-173920-124943-bae8f7/evaluation/pytest-output.txtsha256:6748f4bf6bdb892115858ef2cbfafee36afbdd75280611a19cd48d2aa613be11
run-20261102-173920-82f7a48cjunit/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-173920-124943-bae8f7/evaluation/junit.xmlsha256:ac459c98844aed5d7b0820faada48830a75b51d1335ab0e2492b5cb5e0e57e03
run-20261102-173920-82f7a48crun_record/mnt/data2/dev/develop/ak-bench-data/artifacts/runs/codex-20261102-173920-124943-bae8f7/run_record.jsonsha256:1785aca4ae5edf261820878e1f3217eba4847fc1edca34894f8a79b69d687d82

Not verified

Configurations that are not verified. They stay in the report, because a result produced under them is only as trustworthy as they are.
kindsubjectstatusrunnote
pluginagentic_knowledgeunsupportedrun-20261102-015302-e1907b59LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-015302-e1907b59descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-015702-033aab98LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-015702-033aab98descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-020002-c8680ac1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-020002-c8680ac1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-020305-819a6a56LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-020305-819a6a56descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-020922-c802a0eeLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-020922-c802a0eedescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-021319-f8645cebLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-021319-f8645cebdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-021828-a3b13607LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-021828-a3b13607descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-022315-259a16a5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-022315-259a16a5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-022715-0f5b5375LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-022715-0f5b5375descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023143-af17689aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023143-af17689adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023515-f1dff616LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023515-f1dff616descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-023813-b7d6ced3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-023813-b7d6ced3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024213-cd12e80fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024213-cd12e80fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024414-b4a4c0f1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024414-b4a4c0f1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024637-153cbef0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024637-153cbef0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-024900-b4e495b9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-024900-b4e495b9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-025349-a41ee544LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-025349-a41ee544descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-025838-8e5d4349LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-025838-8e5d4349descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-030330-6e680c03LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-030330-6e680c03descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-030620-307d982cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-030620-307d982cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-031005-8ee792e8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-031005-8ee792e8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-031245-d48061aaLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-031245-d48061aadescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-032017-d7e7635dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-032017-d7e7635ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-032654-eef72cc9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-032654-eef72cc9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-033745-147a6170LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-033745-147a6170descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034056-a469ad46LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034056-a469ad46descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034231-ceec4cf9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034231-ceec4cf9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034347-4d78071aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034347-4d78071adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-034956-2f8213a2LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-034956-2f8213a2descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-040500-60833b88LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-040500-60833b88descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-042003-4e77ac85LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-042003-4e77ac85descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-042815-65e2ad9bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-042815-65e2ad9bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-043507-07326b31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-043507-07326b31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-044616-5ced7f24LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-044616-5ced7f24descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-045137-ae782a86LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-045137-ae782a86descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-045951-9062760dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-045951-9062760ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-050517-4824113cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-050517-4824113cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-051140-154e7756LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-051140-154e7756descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-051856-7a01f2f0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-051856-7a01f2f0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-052723-7c46d753LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-052723-7c46d753descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-054227-dc5f0497LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-054227-dc5f0497descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-055730-c94232f9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-055730-c94232f9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-060259-4681bb55LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-060259-4681bb55descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-061803-ca793f25LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-061803-ca793f25descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-063306-62006f1cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-063306-62006f1cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-063921-31a5efefLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-063921-31a5efefdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-064343-33d90543LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-064343-33d90543descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-064601-0d71057aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-064601-0d71057adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065152-be03d69aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065152-be03d69adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065424-0122485bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065424-0122485bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-065823-56d0518eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-065823-56d0518edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-070225-983f28a4LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-070225-983f28a4descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-070752-ee5e374fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-070752-ee5e374fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-071535-a34798d9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-071535-a34798d9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-072154-ce0a96c9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-072154-ce0a96c9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-073119-046c63c5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-073119-046c63c5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-074114-fb309dd3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-074114-fb309dd3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-074537-1abe2bd8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-074537-1abe2bd8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-075327-d3b09ae5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-075327-d3b09ae5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-075736-7dc8b5faLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-075736-7dc8b5fadescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-080204-89ac58c6LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-080204-89ac58c6descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-080410-d2c89897LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-080410-d2c89897descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-081913-0789e06aLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-081913-0789e06adescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-082149-abdd844bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-082149-abdd844bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-083306-81799937LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-083306-81799937descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-083513-c8a810d4LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-083513-c8a810d4descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084427-5c4e6c25LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084427-5c4e6c25descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084722-12cb8519LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084722-12cb8519descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-084925-db233c9dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-084925-db233c9ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-085126-7081e5a7LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-085126-7081e5a7descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-085717-2d40efc9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-085717-2d40efc9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-090053-801966e8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-090053-801966e8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102224-77a554a3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102224-77a554a3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102450-4c4dafd8LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102450-4c4dafd8descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-102846-f9da52d1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-102846-f9da52d1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-103139-c174189bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-103139-c174189bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-103500-42595b9bLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-103500-42595b9bdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-103806-ca54befbLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-103806-ca54befbdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-104150-ee470964LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-104150-ee470964descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-104527-df556abcLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-104527-df556abcdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105101-7f0ea089LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105101-7f0ea089descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105332-509d420cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105332-509d420cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-105924-5844ec5cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-105924-5844ec5cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-110711-12e9e01eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-110711-12e9e01edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111029-a9c04726LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111029-a9c04726descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111326-3c584bd3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111326-3c584bd3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111537-b9ab2fefLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111537-b9ab2fefdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-111839-c5f2e4c1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-111839-c5f2e4c1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-112306-6bc27784LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-112306-6bc27784descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-112953-68b1af75LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-112953-68b1af75descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-113507-5543ffe1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-113507-5543ffe1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114156-1ff0ba59LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114156-1ff0ba59descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114446-b3513377LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114446-b3513377descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-114752-9f3f4f92LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-114752-9f3f4f92descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115051-39be5247LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115051-39be5247descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115611-ee478152LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115611-ee478152descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-115850-e5f2348fLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-115850-e5f2348fdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-120221-58de15afLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-120221-58de15afdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-120435-e4b44447LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-120435-e4b44447descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-120616-d577d4b1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-120616-d577d4b1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-121131-13e4a8b5LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-121131-13e4a8b5descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-121528-03d9f220LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-121528-03d9f220descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122054-f8985461LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122054-f8985461descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122358-fec2acfeLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122358-fec2acfedescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-122856-43bd96e6LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-122856-43bd96e6descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-123353-08bae5f2LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-123353-08bae5f2descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-123722-abf5b6a0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-123722-abf5b6a0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-124013-4e335fc0LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-124013-4e335fc0descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-124303-45bdfb12LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-124303-45bdfb12descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-125808-280ac90dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-125808-280ac90ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-131314-47751b92LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-131314-47751b92descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-132819-55ee19e1LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-132819-55ee19e1descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-134326-1f193cecLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-134326-1f193cecdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-135659-dfdbb7eeLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-135659-dfdbb7eedescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-141204-1573e7b2LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-141204-1573e7b2descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-142710-0136dc94LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-142710-0136dc94descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-143842-25bc3410LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-143842-25bc3410descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-145348-58a7a3f3LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-145348-58a7a3f3descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-150618-18c32d85LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-150618-18c32d85descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-152123-401b3de4LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-152123-401b3de4descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-153629-de5ac66dLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-153629-de5ac66ddescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-154610-09481f31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-154610-09481f31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-160115-cb48ab31LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-160115-cb48ab31descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-161153-16c04a4eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-161153-16c04a4edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-162330-279c2d0eLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-162330-279c2d0edescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-163521-b51708f9LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-163521-b51708f9descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-164738-43ff8923LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-164738-43ff8923descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-165407-d907f577LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-165407-d907f577descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-170536-da2abfe7LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-170536-da2abfe7descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-171345-07e43bdbLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-171345-07e43bdbdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-172849-b26fa228LLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-172849-b26fa228descriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
pluginagentic_knowledgeunsupportedrun-20261102-173920-82f7a48cLLM_ROUTER_KNOWLEDGE_AGENTIC_ENABLED is not set, so the plugin keeps its built-in default; verification methods effective_router_config, plugin_runtime_events, …
pluginagentic_routing_codexunsupportedrun-20261102-173920-82f7a48cdescriptor declares no plugin-level toggle (benchmark.enabled_when), so activation is not observable and enabled is reported as false; verification methods resp …
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-015302-e1907b59
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-015702-033aab98
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-020002-c8680ac1
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-020305-819a6a56
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-020922-c802a0ee
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-021319-f8645ceb
modelauto_codexunverifiedrun-20261102-021828-a3b13607
modelauto_codexunverifiedrun-20261102-022315-259a16a5
modelauto_codexunverifiedrun-20261102-022715-0f5b5375
modelauto_codexunverifiedrun-20261102-023143-af17689a
modelauto_codexunverifiedrun-20261102-023515-f1dff616
modelauto_codexunverifiedrun-20261102-023813-b7d6ced3
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024213-cd12e80f
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024414-b4a4c0f1
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-024637-153cbef0
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-024900-b4e495b9
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-025349-a41ee544
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-025838-8e5d4349
modelauto_codexunverifiedrun-20261102-030330-6e680c03
modelauto_codexunverifiedrun-20261102-030620-307d982c
modelauto_codexunverifiedrun-20261102-031005-8ee792e8
modelauto_codexunverifiedrun-20261102-031245-d48061aa
modelauto_codexunverifiedrun-20261102-032017-d7e7635d
modelauto_codexunverifiedrun-20261102-032654-eef72cc9
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-033745-147a6170
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-034056-a469ad46
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-034231-ceec4cf9
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-034347-4d78071a
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-034956-2f8213a2
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-040500-60833b88
modelauto_codexunverifiedrun-20261102-042003-4e77ac85
modelauto_codexunverifiedrun-20261102-042815-65e2ad9b
modelauto_codexunverifiedrun-20261102-043507-07326b31
modelauto_codexunverifiedrun-20261102-044616-5ced7f24
modelauto_codexunverifiedrun-20261102-045137-ae782a86
modelauto_codexunverifiedrun-20261102-045951-9062760d
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-050517-4824113c
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-051140-154e7756
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-051856-7a01f2f0
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-052723-7c46d753
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-054227-dc5f0497
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-055730-c94232f9
modelauto_codexunverifiedrun-20261102-060259-4681bb55
modelauto_codexunverifiedrun-20261102-061803-ca793f25
modelauto_codexunverifiedrun-20261102-063306-62006f1c
modelauto_codexunverifiedrun-20261102-063921-31a5efef
modelauto_codexunverifiedrun-20261102-064343-33d90543
modelauto_codexunverifiedrun-20261102-064601-0d71057a
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065152-be03d69a
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065424-0122485b
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-065823-56d0518e
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-070225-983f28a4
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-070752-ee5e374f
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-071535-a34798d9
modelauto_codexunverifiedrun-20261102-072154-ce0a96c9
modelauto_codexunverifiedrun-20261102-073119-046c63c5
modelauto_codexunverifiedrun-20261102-074114-fb309dd3
modelauto_codexunverifiedrun-20261102-074537-1abe2bd8
modelauto_codexunverifiedrun-20261102-075327-d3b09ae5
modelauto_codexunverifiedrun-20261102-075736-7dc8b5fa
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-080204-89ac58c6
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-080410-d2c89897
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-081913-0789e06a
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-082149-abdd844b
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-083306-81799937
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-083513-c8a810d4
modelauto_codexunverifiedrun-20261102-084427-5c4e6c25
modelauto_codexunverifiedrun-20261102-084722-12cb8519
modelauto_codexunverifiedrun-20261102-084925-db233c9d
modelauto_codexunverifiedrun-20261102-085126-7081e5a7
modelauto_codexunverifiedrun-20261102-085717-2d40efc9
modelauto_codexunverifiedrun-20261102-090053-801966e8
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102224-77a554a3
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102450-4c4dafd8
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-102846-f9da52d1
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-103139-c174189b
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-103500-42595b9b
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-103806-ca54befb
modelauto_codexunverifiedrun-20261102-104150-ee470964
modelauto_codexunverifiedrun-20261102-104527-df556abc
modelauto_codexunverifiedrun-20261102-105101-7f0ea089
modelauto_codexunverifiedrun-20261102-105332-509d420c
modelauto_codexunverifiedrun-20261102-105924-5844ec5c
modelauto_codexunverifiedrun-20261102-110711-12e9e01e
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111029-a9c04726
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111326-3c584bd3
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-111537-b9ab2fef
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-111839-c5f2e4c1
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-112306-6bc27784
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-112953-68b1af75
modelauto_codexunverifiedrun-20261102-113507-5543ffe1
modelauto_codexunverifiedrun-20261102-114156-1ff0ba59
modelauto_codexunverifiedrun-20261102-114446-b3513377
modelauto_codexunverifiedrun-20261102-114752-9f3f4f92
modelauto_codexunverifiedrun-20261102-115051-39be5247
modelauto_codexunverifiedrun-20261102-115611-ee478152
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-115850-e5f2348f
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-120221-58de15af
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-120435-e4b44447
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-120616-d577d4b1
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-121131-13e4a8b5
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-121528-03d9f220
modelauto_codexunverifiedrun-20261102-122054-f8985461
modelauto_codexunverifiedrun-20261102-122358-fec2acfe
modelauto_codexunverifiedrun-20261102-122856-43bd96e6
modelauto_codexunverifiedrun-20261102-123353-08bae5f2
modelauto_codexunverifiedrun-20261102-123722-abf5b6a0
modelauto_codexunverifiedrun-20261102-124013-4e335fc0
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-124303-45bdfb12
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-125808-280ac90d
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-131314-47751b92
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-132819-55ee19e1
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-134326-1f193cec
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-135659-dfdbb7ee
modelauto_codexunverifiedrun-20261102-141204-1573e7b2
modelauto_codexunverifiedrun-20261102-142710-0136dc94
modelauto_codexunverifiedrun-20261102-143842-25bc3410
modelauto_codexunverifiedrun-20261102-145348-58a7a3f3
modelauto_codexunverifiedrun-20261102-150618-18c32d85
modelauto_codexunverifiedrun-20261102-152123-401b3de4
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-153629-de5ac66d
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-154610-09481f31
modelqwen/Qwen3.8-27Bunverifiedrun-20261102-160115-cb48ab31
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-161153-16c04a4e
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-162330-279c2d0e
modelqwen/Qwen3.8-Flash-Nextunverifiedrun-20261102-163521-b51708f9
modelauto_codexunverifiedrun-20261102-164738-43ff8923
modelauto_codexunverifiedrun-20261102-165407-d907f577
modelauto_codexunverifiedrun-20261102-170536-da2abfe7
modelauto_codexunverifiedrun-20261102-171345-07e43bdb
modelauto_codexunverifiedrun-20261102-172849-b26fa228
modelauto_codexunverifiedrun-20261102-173920-82f7a48c