Skip to content

Add Exp 014: contextWindow × compactionThreshold sensitivity#122

Merged
jimmytacks merged 1 commit into
mainfrom
experiment/014-context-window-threshold
Apr 3, 2026
Merged

Add Exp 014: contextWindow × compactionThreshold sensitivity#122
jimmytacks merged 1 commit into
mainfrom
experiment/014-context-window-threshold

Conversation

@jimmytacks
Copy link
Copy Markdown
Collaborator

Closes #121

Summary

  • contextWindow and compactionThreshold are non-decisions for lcm-subagent — incrementalInterval is the sole compaction driver
  • lcm-subagent peak context (43k) never reaches window threshold at any standard window (≥50k)
  • full-compaction's poor performance is partly a window artefact: at 64k its cost drops 45%
  • Strategy rankings stable across all window sizes and thresholds

Sweeps run

  1. contextWindow [30k–500k] × cycles [100, 150, 200] — lcm-subagent only → flat at ≥50k
  2. compactionThreshold [0.50–0.95] at 200k and 40k windows → irrelevant at standard windows
  3. All 6 strategies × contextWindow [64k, 128k, 200k] → rankings stable; full-compaction window-sensitive

FINDINGS.md updates

  • New Exp 014 section with full results
  • Added contextWindow and compactionThreshold to implementation parameters table (both marked as non-decisions)
  • Updated programme status and experiment index

🤖 Generated with Claude Code

Key finding: both contextWindow and compactionThreshold are non-decisions
for lcm-subagent deployment. The incrementalInterval (30k) is the sole
compaction driver — lcm-subagent's peak context (43k) never reaches the
window threshold at any standard window size (≥50k).

Cross-strategy validation shows full-compaction's poor performance is
partly a window artefact: at 64k window, its cost drops 45% and approaches
parity with other strategies. But lcm-subagent remains #1 at every window.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
@jimmytacks jimmytacks merged commit f29dbd0 into main Apr 3, 2026
1 check passed
@jimmytacks jimmytacks deleted the experiment/014-context-window-threshold branch April 3, 2026 10:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Exp 014: contextWindow × compactionThreshold sensitivity for lcm-subagent

1 participant