Skip to content

[Blog] Add "Full-Stack Performance Optimization of AR+DiT in SGL-Diffusion" - #378

Merged
LyH88 merged 12 commits into
lm-sys:mainfrom
ping1jing2:diffuison_blog
Aug 6, 2026
Merged

[Blog] Add "Full-Stack Performance Optimization of AR+DiT in SGL-Diffusion"#378
LyH88 merged 12 commits into
lm-sys:mainfrom
ping1jing2:diffuison_blog

Conversation

@ping1jing2

Copy link
Copy Markdown
Contributor

diffusion blog first version

@BBuf BBuf left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few documentation and reproducibility issues to address before publishing.

Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md
Comment thread blog/2026-08-05-glmImage-optimization.md
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated

@BBuf BBuf left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few additional comments on the figures.

Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md Outdated
Comment thread blog/2026-08-05-glmImage-optimization.md
Comment thread blog/2026-08-05-glmImage-optimization.md
Comment thread blog/2026-08-05-glmImage-optimization.md
Comment thread blog/2026-08-05-glmImage-optimization.md
@ping1jing2

Copy link
Copy Markdown
Contributor Author

i addressed all the comments above, but i think the below items need to be double check:

  1. PR #30683 is still open and #31320 is still a draft. Please mark these sections experimental and pin commit SHAs, or publish after they merge.----added a note below. file location

    To resolve these issues, we contributed three progressively staged PRs that evolve the system from a monolith to a fully decoupled, heterogeneous distributed architecture:

    Note: PR #31320 has not been merged yet. The commit SHA we adopt here is 4e520bd

  2. Please qualify optimal with the tested workload/configuration; the appendix later uses 2-NPU SP denoisers, which contradicts this absolute claim.-----added test result below. file location

    DiT denoising is optimal at batch=1 on a single NPU for both latency and throughput.

    Batch size AR (s) Denoising, 30 step (s) Denoising, 30 steps (s)
    1 20.4 0.407 12.2
    2 21.3 (+4.4%) 0.854 (+110%) 25.6 (+110%)
    4 22.8 (+12%) 1.98 (+386%) 59.6 (+389%)
    8 25.9 (+27%) 3.73 (+816%) 112.2 (+820%)
    16 29.4 (+44%) 7.24 (+1679%) 217.3 (+1681%)
    32 33.2 (+63%) 14.0 (+3339%) 420.6 (+3348%)

@LyH88
LyH88 merged commit ca05288 into lm-sys:main Aug 6, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants