chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,782 Commits 1 Branch 0 Tags
48fcd62d1f60110a4656805468dbd38e20c12bef
Commit Graph

309 Commits

Author SHA1 Message Date
Nickcp39
48fcd62d1f fix(glm-image): single-GPU T5 config + SP support for 4D latents (#18… (#18739) 
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2026-02-17 13:04:32 -08:00
triple-mu
504b2c58cf [diffusion] improve: improve torch.compile for MOVA (#18914) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-18 00:47:38 +08:00
Mick
bfe34c90ff Revert "[diffusion] operator: unify rotary embedding impl" (#18929) 2026-02-17 22:56:04 +08:00
Makcum888e
2aa0db7d9c [Diffusion] [NPU] Fix CI run (#18921) 2026-02-17 16:54:19 +03:00
Ratish P
f6cc02489f [diffusion]: fix sparse video gen 2 backend being applied to cross-attention (#18900) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-02-17 13:17:46 +03:00
triple-mu
26b2c63d03 [diffusion] operator: unify rotary embedding impl (#18164) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-17 12:02:48 +08:00
Ratish P
50ca24aebb [diffusion]: fix scheduler crash on ZMQ messages with unexpected frame counts (#17890) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-17 09:45:05 +08:00
Ratish P
c1d1337afc [diffusion][Wan]: fix sparse attention backends being applied to cross-attention (#17596) 2026-02-16 21:57:58 +08:00
Mick
de833f9e8e Revert "[diffusion]: Improve layerwise offload buffer reuse and shared-storage handling" (#18866) 2026-02-16 18:00:58 +08:00
Mick
d0c94e136a [diffusion] logging: improve peak vram logging (#18865) 2026-02-16 16:44:37 +08:00
Changyi Yang
61da34ad0b [diffusion] fix: fix LoRA weight snapshot aliasing in unmerge logic (#18883) 2026-02-16 15:39:45 +08:00
Johnsonms
bc79a64d3a [Diff]: support SGLANG_TORCH_PROFILER_DIR environment variable for profiler log directory (#18454) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-16 12:47:29 +08:00
Mick
0af9dcc407 [diffusion] refactor: refactor server_args adjust and validate logics (#18863) 2026-02-16 11:49:06 +08:00
Mick
78b4c9e248 [diffusion] fix: avoid saving output for warmup requests (#18867) 2026-02-16 11:48:28 +08:00
SoluMilken
07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
Ratish P
ddfe147377 [diffusion]: Improve layerwise offload buffer reuse and shared-storage handling (#18611) 2026-02-15 22:17:51 +08:00
Mick
3feb48139e [diffusion] quant: add support for svdquant and nunchaku (#18549) 
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-02-15 20:43:00 +08:00
Ratish P
274bf6607a [diffusion] fix: enable torch.compile for UlyssesAttention (#18840) 2026-02-15 15:54:27 +08:00
Xiaoyu Zhang
4067d9487d [diffusion] feat: opt vae decode with channels_last_3d (#18540) 2026-02-14 23:19:45 +08:00
R0CKSTAR
45a4697d45 [diffusion][MUSA] fix: MUSA platform breakage caused by PR #13662 (#18456) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-14 11:00:39 +08:00
Mick
37273408eb [diffusion] chore: use batched P2P ops in VAE parallel decoding (#18728) 2026-02-13 22:11:20 +08:00
Mick
efdd676d56 [diffusion] refactor: merge redundant default_dtype and param_dtype parameters in FSDP loader (#18789) 2026-02-13 21:18:02 +08:00
Xinwei Qiang
356e338607 [diffusion] feat: support SparseVideoGen2 attention backend (#17507) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 16:20:46 +08:00
xiaoye
5700b19cbf [diffusion] feat: support tp for qwen-image-edit-2511 (#18619) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 13:04:29 +08:00
HuangJi
f4d80f9d42 [diffusion] feat: allows quality adjustment of generated images/videos (#17937) 2026-02-13 11:56:20 +08:00
Bingxu Chen
6555b2a71d [diffusion] fix: fix ci on amd (#18716) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 11:51:24 +08:00
Mick
efcdda0176 [diffusion] fix: fix fsdp (#18187) 2026-02-10 20:22:20 +08:00
wxy
47978ee858 [diffusion] feat: support parallel wan-vae decode (#18179) 2026-02-10 18:32:00 +08:00
Mick
4f7da5ad0f [diffusion] chore: fix unclean shutdown and resource leaks (#18477) 2026-02-09 22:32:08 +08:00
yrk111222
76eb1c8406 [diffusion] feat: add ModelScope support (#17924) 2026-02-09 19:23:45 +08:00
Mick
6601bc24da [diffusion] chore: revise process title (#18446) 2026-02-09 00:14:06 +08:00
Mick
a41aff1243 [diffusion] refactor: group component loaders under the component_loaders/ directory (#18438) 2026-02-08 23:02:27 +08:00
wxy
43eecd8265 [diffusion] feat: support efficient sequence shard (#18161) 2026-02-08 21:09:39 +08:00
Makcum888e
00248d85c7 [diffusion] platform: support WAN/FLUX/Qwen-Image/Qwen-Image-edit on Ascend (#13662) 
Co-authored-by: dhx98 <haox.dai@gmail.com>
Co-authored-by: DHX98 <haoxiand@andrew.cmu.edu>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: DHX98 <DHX98@noreply.gitcode.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
 2026-02-08 10:45:30 +08:00
wxy
64950d8f97 [diffusion] feat: support saving videos directly on the server to avoid the overhead of tensor transfer (#18253) 2026-02-07 22:08:42 +08:00
Mick
31d4cd2ffd [diffusion] fix: respect dist_timeout option (#18386) 2026-02-07 20:56:04 +08:00
Hao Jin
d792aa7618 [diffusion] fix: remove unnecessary norm_type argument from GLM-Image dits (#18382) 
Co-authored-by: Hao Jin <Hao Jin>
 2026-02-07 20:35:12 +08:00
Xiaoyu Zhang
baec650462 [Diffusion] Apply fused_norm_scale_shift to LTX2/MOVA (#18257) 
Co-authored-by: yihanc <yingluosanqian@gmail.com>
 2026-02-07 17:28:42 +08:00
xiaoye
79d409f210 [diffusion] fix: offload text encoder model in image encoding stage (#18317) 2026-02-06 22:55:56 +08:00
陈一涵
f798ab9775 [diffusion] fix: fix torch.compile graph break caused by torch._dynamo.disable (#18336) 2026-02-06 14:48:09 +08:00
wxy
b639779dd8 [diffusion] feat: allow T5's TP Group to reuse the transformer's SP Group (#17818) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-06 00:12:19 +08:00
陈一涵
4aa03d91fd [diffusion] fix: fix accuracy bug caused by #14717 (#18296) 2026-02-05 20:36:18 +08:00
Xiaoyu Zhang
dff3ba202a [Diffusion] Support layerwise offload for mova (#18272) 2026-02-05 13:16:07 +08:00
Mick
f218234e4f [diffusion] chore: prohibit Chinese characters usage (#18249) 2026-02-05 09:22:26 +08:00
Mick
36a3e78af9 [diffusion] refactor: move model_stages into stages folder (#18248) 2026-02-05 00:23:31 +08:00
wxy
4c403045ec [diffusion] fix: fix the bug of redundant memory usage on GPU-0 (#18221) 2026-02-04 21:25:23 +08:00
Zhang Yiyang (SII)
0c9a0adc53 [diffusion] chore: clean MOVA codes (#18107) 2026-02-04 21:23:41 +08:00
Evrard-Nil
ce02df8592 [diffusion] logging: downgrade default prompt log from info to debug (#17813) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-04 19:19:02 +08:00
Jianying
4739f2e8d5 [diffusion] kernel: gated residual layernorm scale shift and layernorm scale shift kernel fusion for Qwen-Image, WAN and HunyuanVideo (#14717) 
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <joeyzhu@nvidia.com>
Co-authored-by: root <root@a4u8g-0120.ipp2a2.colossus.nvidia.com>
Co-authored-by: Yihan Chen <yingluosanqian@example.com>
Co-authored-by: 陈一涵 <yingluosanqian@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-04 13:46:20 +08:00
wxy
da758ed601 [diffusion] fix: fix server cache-dit bug under continuous dynamic requests (#17140) 2026-02-04 09:03:37 +08:00