Skip to content

fix: diagnose packed-scale repeat instability without relaxing equality - #87

Merged
fank merged 1 commit into
mainfrom
claude/packed-gate-diagnostics
Nov 4, 2026
Merged

fank merged 1 commit into
mainfrom
claude/packed-gate-diagnostics

Conversation

@fank

@fank fank commented Nov 4, 2026

Copy link
Copy Markdown
Member

The real H100 gate stopped because the unmodified baseline was not repeat-stable. This establishes no packed/unpacked mismatch.

Changes:

  • Match both formats' tuning dictionaries rather than independently retuning them.
  • Synchronize/snapshot first output before second launch; assert independent output pointers and no overwrite.
  • Print compiled Stream-K setting, tuning, differing element count, max absolute difference and output pointers before exact repeat assertion.
  • Add explicit --disable-stream-k controlled storage-kernel comparison. Verify the compiled control is honored and label the pass scope. This is NOT production-default qualification. No equality tolerance changes.

Source inspection: Humming runner allocates fresh zero outputs/locks for each launch; launcher returns supplied output. SM90 BF16 Stream-K may use native atomic reductions for more than3 slices, with barriers gating only the first slice before other reducers. This is a plausible repeat-order mechanism, not a confirmed diagnosis without the new runtime log.

Validation here: Python compilation, --help and20 repository CPU tests pass. No GPU launched locally; serving owns runtime tests. Real-model/graph/packed-scale serving qualification remains pending.

@fank
fank marked this pull request as ready for review November 4, 2026 18:55
@fank
fank merged commit 29ee0de into main Nov 4, 2026
5 checks passed
@fank
fank deleted the claude/packed-gate-diagnostics branch November 4, 2026 18:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant