MTGBench improvement loop

Overview · Experiment index

Experiment index

idstatusswitchnotememo line
xn5.76rejectedProducible-mana upper-bound screen. L5719
xn5.74rejectedExact mana frontier. safe class measured 4.42% / 4.80%; stopped at the safe-class gateL5655
xn5.73rejectedForced-pass certificate. no-go on the current mutation APIL5586
xn5.75measurement-onlyPriority decision-domain attribution. prototype at L5495; complete at L5537; commit 3f4ca44eeL5537
xn5.72rejectedOff-zone companion preflight screen. below the 1.5% stop gate; shadow counter keptL5467
xn5.71retainedShared trigger-entry snapshots. L5434
xn5.70rejectedStack-entry layer screen. eligible time 0.94% / 1.20% of contract+apply, below the 1.5% gateL5405
xn5.69rejectedReplacement bucket attribution; representation change rejected. counters retained, optimization notL5379
xn5.68neutralPHASE_INERT_DEPARTURE_LAYERS_LEGACYInert battlefield departure. +10.3% / +1.9% / -3.6% wall-clock, all within noiseL5344
affordability-probesmeasurement-only *review*Affordability probes classified by plan predictability. L5242
ranking-after-xn5.67measurement-only *review*Next throughput candidates after xn5.67 and layer-origin attribution. L5170
xn5.24-step1bmeasurement-only *review*origin => flush pairs and battlefield-departure kinds. L5108
xn5.24-step1measurement-onlyFull layer evaluations attributed by dirtying and flush site. xn5.26 closed as rejectedL4993
xn5.67measurement-onlyuProf re-profile after xn5.61-66 (reference workload). journal cloning 7.45% inclusive (5.7% entry vector); ObjectStore::get_mut 2.20% under evaluate_layersL4904
xn5.66rejectedReplacement-index write-generation shadow counter. 4,000-action upper bound 1.18% < 2% kill thresholdL4893
xn5.65retainedPHASE_OFF_ZONE_KEYWORD_MEMO_LEGACYDepth-zero off-zone keyword contribution memo. seed 91 -3.2%, seed 42 -2.7%, 8/8 signsL4878
xn5.64rejectedCounter screen: reject. L4839
xn5.63retained (supersedes xn5.63-screen)PHASE_OFF_ZONE_RECIPIENT_PREFILTER_LEGACYIndexed recipient prefilter (final). seed 91 -7.3%, seed 42 -5.1%, 8/8 games faster, floor 1.5%L4782
xn5.63-screensuperseded (superseded by xn5.63)Counter screen: reject indexed recipient prefilter. reject at 1,000 actions; overturned by the 4,000-action confirmationL4746
xn5.62retained (supersedes xn5.56)Fix the never-derived mana-reader gate. L4693
xn5.61retained (supersedes xn5.58)Retract unsafe replacement-index reuse. the correctness argument permitting reuse no longer heldL4633
xn5.59retainedActivation and raw legality attribution. attribution counters and regression retained; mana-only shortcut rejectedL4524
xn5.58retracted (superseded by xn5.61)PHASE_REPLACEMENT_INDEX_CACHE_LEGACYCache replacement-index preparation by state revision. was retained-candidate; reuse retracted as unsafe in xn5.61. Some bench labels call this xn559L4461
xn5.57retainedPHASE_ZONE_CHANGE_RECORD_LEGACYShare zone-change records across forks. -7.7% against a 0.1% floor, 8/8 signsL4405
xn5.56retained (superseded by xn5.62)PHASE_MANA_SUB_COST_LAYERS_LEGACYGate mana-sub-cost layer dirtiness on unspent-mana readers. retained as candidate; gate was never derived, fixed in xn5.62L4352
xn5.60retainedPHASE_PRIORITY_HANDOFF_LEGACYSettled priority handoff skipped state-based actions. correctness fix; neutral on timingL4275
xn5.55retainedTargetless CastSpell contract boundary. correctness fix; contract-cache invalidation and Kicker reducerL4140
parity-sweep-2026-09-19measurement-onlyParity sweep: optimized vs all legacy switches over 21 seeds. L4095
xn5.54retainedPHASE_DISPLAY_WRITE_LEGACYRead-before-write in display derivation. L4034
xn5.53BdeferredFrozen journal chunks after noise-floor re-measurement. L3987
xn5.53ArejectedJournal-free probe clones. kill criterion met: 13,610 decisive journal reads in 4,000 actionsL3909
xn5.52retained *review*PHASE_OFF_ZONE_RECONCILE_LEGACYReconciled off-zone keyword trigger probe. seed 91 retained-candidate; seed 42 neutralL3838
xn5.51retainedResidual payability before exact-filter witness. L3758
xn5.50retainedLazy source LKI snapshot in filter contexts. L3603
xn5.49retained *review*PHASE_OFF_ZONE_RECIPIENT_TIMERSRemove off-zone diagnostic probes from the hot path. seed 91 retained-candidate, seed 42 neutral (+8.8%)L3552
xn5.48retainedRead-before-write controller-source leave pruning. seed 42 -9.7%, 8/8 signsL3500
xn5.47retainedPre-screen exact-filter payment witness. L3443
xn5.46rejectedFull-evaluation layer reset COW writes. kill criteria fired; no Phase commitL3311
harness-paired-repeatsmeasurement-onlyHarness: paired repeats, noise floor and per-game sign agreement. L3256
xn5.45unknown *review*Lazy SBA counter-cancellation COW writes. section text not read closely; needs reviewL3190
xn5.39retainedFail-open payment-preview unpayability screen. L3118
xn5.44rejectedOff-zone indexed materialization memo. regressed in target-regime measurementsL3065
xn5.31.1retained *review*PHASE_OFF_ZONE_RECIPIENT_SKIP_LEGACYSkip zero-work off-zone recipients. L2996
xn5.43retainedLazy world-rule acquisition timestamps. L2925
xn5.37rejectedPHASE_OFF_ZONE_STAMP_LEGACYContent-keyed off-zone committed-result stamp. L2886
xn5.42rejected *review*Gate ChooseTarget probe by target shape. 'Both were reverted; neither was retained in Phase'L2832
xn5.41rejectedCached non-final ChooseTarget proof. L2803
xn5.38retained *review*Structural ChooseTarget validation. L2725
xn5.36measurement-onlyRound counters 2 (measurement only). opened xn5.37 and xn5.38; deferred definition-clone and adaptive-journal workL2615
xn5.29deferredSBA family attribution and event-kind gate. kill condition met; no PHASE_SBA_FAMILY_GATE_LEGACY addedL2536
xn5.35retainedPHASE_OFF_ZONE_SOURCE_PREFILTER_LEGACYOff-zone trigger source prefilter. L2454
xn5.34rejectedFrozen journal chunks. reject/defer for the current training workload; parent landing reverted in 9cadbf3L2435
xn5.33measurement-onlyRound attribution counters (measurement only). opened xn5.34; deferred xn5.29; closed xn5.30 as rejectedL2391
xn5.32retained *review*Direct trigger-source context construction. early-filter savings deferred/closed; server-release confirmation retainedL2305
xn5.31retainedElide no-op off-zone keyword reconciliation. retained evidence is the server-release winL2243
xn5.25rejected *review*Scratch rollback investigation. 'scratch rollback rejected' per the re-profile at L2146L2109
xn5.23retainedGameState turn-facts sharing. L2023
xn5.22retained (supersedes xn5.7)Shared object store retained. A/B arm removed after confirmation; commits 9aae3750d, fd1a90e06, d5a93aa2bL1983
build-followupsretainedBuild-time follow-ups (Cranelift ICE, sccache scope, opt-level 1, checksum freshness). checksum-freshness retained; bench-fast-inc opt-level 1 rejected; Cranelift ICE on windows-msvcL1819
build-iteration-profileretainedIteration build profile 320 s -> 45 s per edit. bench-fast-inc (lto off, 64 CGUs, -Z threads=8) retained; sccache for incremental rejectedL1704
xn5.20retained *review*ObjectStore accessor seam. L1600
xn5.19neutralHost-bound prune and provider candidate attribution. provider path unreachable; working baseline reset to xn5.19 at L1641L1546
xn5.18measurement-only *review*Contract-cache counter drain. L1505
xn5.17neutral (supersedes shared-casting-probe)Centralized benchmark-switch reads and shared-probe removal. L1441
xn5.9retainedPHASE_HEADLESS_OUTPUT_LEGACYHeadless AI result sink. closed as correctness-orientedL1390
xn5.5neutralHost-left casting-permission scan elimination. neutral overall throughput; no headline speedup claimedL1339
xn5.7retained (superseded by xn5.22)Object-store copy granularity prototype. retained as a bounded candidate; shared store retained at L1983L1302
xn5.8neutralClean-state target legality query. combined ~0.9% fall; kept as a rules-safe reductionL1256
xn5.4retained *review*PHASE_OFF_ZONE_TRIGGER_WRITES_LEGACYUnchanged off-zone trigger write elimination. L1214
xn5.3retained *review*Immutable creature-type vocabulary sharing. L1139
xn5.6measurement-only *review*Accepted branch-lifecycle report. L1082
xn5.2measurement-only *review*Clean late-game baseline. baseline; some seeds fail closed on action-domain rejectionsL965
stage0-cast-variant-queriesretained *review*PHASE_CAST_VARIANT_LEGACY_QUERYCast-variant existence queries. L435
stage0-recipient-indexretainedSnapshot-owned off-zone recipient index. rejections 557,185 -> 207,082 (-62.8%), collection 311 -> 232 ms (-25.4%)L395
stage0-source-indexretained *review*Snapshot-owned off-zone source index. L340
stage0-sparse-layer-trigger-grantretained *review*Sparse layer trigger-grant reconciliation. L307
shared-casting-probeneutral (superseded by xn5.17)PHASE_SHARED_CAST_PROBEShared casting probe. neutral; closed; probe removed in xn5.17L221
sprint-borrowed-effectsretractedBorrowed cached effects and activation-definition reuse: 19,362 ms retired. retired after cache-lifetime review (AGENTS.md precedent)L202
sprint-cache-lifetimeretracted (supersedes L172)Cache-lifetime correction: 18,793 ms retired. attractive aggregate depended on an unenforceable thread-local cache lifetime; slower corrected number is the referenceL188
sprint-deferred-displayrejectedDeferred-display A/B experiment. 3.6-3.8% slower; closed (AGENTS.md cites it as a written-down negative)L152

generated 2026-09-29 20:22:14 · read-only · refreshes every 30 s