Commit Graph
309 Commits
Author SHA1 Message Date
48fcd62d1f fix(glm-image): single-GPU T5 config + SP support for 4D latents (#18… (#18739)
Co-authored-by: Cursor <cursoragent@cursor.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
2026-02-17 13:04:32 -08:00
triple-muandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 504b2c58cf [diffusion] improve: improve torch.compile for MOVA (#18914)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-18 00:47:38 +08:00
Mick bfe34c90ff Revert "[diffusion] operator: unify rotary embedding impl" (#18929) 2026-02-17 22:56:04 +08:00
Makcum888e 2aa0db7d9c [Diffusion] [NPU] Fix CI run (#18921) 2026-02-17 16:54:19 +03:00
Ratish Pandronnie_zheng f6cc02489f [diffusion]: fix sparse video gen 2 backend being applied to cross-attention (#18900)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2026-02-17 13:17:46 +03:00
triple-muandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 26b2c63d03 [diffusion] operator: unify rotary embedding impl (#18164)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-17 12:02:48 +08:00
Ratish PandXiaoyu Zhang 50ca24aebb [diffusion]: fix scheduler crash on ZMQ messages with unexpected frame counts (#17890)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-02-17 09:45:05 +08:00
Ratish P c1d1337afc [diffusion][Wan]: fix sparse attention backends being applied to cross-attention (#17596) 2026-02-16 21:57:58 +08:00
Mick de833f9e8e Revert "[diffusion]: Improve layerwise offload buffer reuse and shared-storage handling" (#18866) 2026-02-16 18:00:58 +08:00
Mick d0c94e136a [diffusion] logging: improve peak vram logging (#18865) 2026-02-16 16:44:37 +08:00
Changyi Yang 61da34ad0b [diffusion] fix: fix LoRA weight snapshot aliasing in unmerge logic (#18883) 2026-02-16 15:39:45 +08:00
Johnsonmsandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> bc79a64d3a [Diff]: support SGLANG_TORCH_PROFILER_DIR environment variable for profiler log directory (#18454)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-16 12:47:29 +08:00
Mick 0af9dcc407 [diffusion] refactor: refactor server_args adjust and validate logics (#18863) 2026-02-16 11:49:06 +08:00
Mick 78b4c9e248 [diffusion] fix: avoid saving output for warmup requests (#18867) 2026-02-16 11:48:28 +08:00
SoluMilken 07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
Ratish P ddfe147377 [diffusion]: Improve layerwise offload buffer reuse and shared-storage handling (#18611) 2026-02-15 22:17:51 +08:00
3feb48139e [diffusion] quant: add support for svdquant and nunchaku (#18549)
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <53300651@qq.com>
2026-02-15 20:43:00 +08:00
Ratish P 274bf6607a [diffusion] fix: enable torch.compile for UlyssesAttention (#18840) 2026-02-15 15:54:27 +08:00
Xiaoyu Zhang 4067d9487d [diffusion] feat: opt vae decode with channels_last_3d (#18540) 2026-02-14 23:19:45 +08:00
R0CKSTAR 45a4697d45 [diffusion][MUSA] fix: MUSA platform breakage caused by PR #13662 (#18456)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-14 11:00:39 +08:00
Mick 37273408eb [diffusion] chore: use batched P2P ops in VAE parallel decoding (#18728) 2026-02-13 22:11:20 +08:00
Mick efdd676d56 [diffusion] refactor: merge redundant default_dtype and param_dtype parameters in FSDP loader (#18789) 2026-02-13 21:18:02 +08:00
Xinwei QiangandMick 356e338607 [diffusion] feat: support SparseVideoGen2 attention backend (#17507)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-13 16:20:46 +08:00
xiaoyeandMick 5700b19cbf [diffusion] feat: support tp for qwen-image-edit-2511 (#18619)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-13 13:04:29 +08:00
HuangJi f4d80f9d42 [diffusion] feat: allows quality adjustment of generated images/videos (#17937) 2026-02-13 11:56:20 +08:00
Bingxu ChenandMick 6555b2a71d [diffusion] fix: fix ci on amd (#18716)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-13 11:51:24 +08:00
Mick efcdda0176 [diffusion] fix: fix fsdp (#18187) 2026-02-10 20:22:20 +08:00
wxy 47978ee858 [diffusion] feat: support parallel wan-vae decode (#18179) 2026-02-10 18:32:00 +08:00
Mick 4f7da5ad0f [diffusion] chore: fix unclean shutdown and resource leaks (#18477) 2026-02-09 22:32:08 +08:00
yrk111222 76eb1c8406 [diffusion] feat: add ModelScope support (#17924) 2026-02-09 19:23:45 +08:00
Mick 6601bc24da [diffusion] chore: revise process title (#18446) 2026-02-09 00:14:06 +08:00
Mick a41aff1243 [diffusion] refactor: group component loaders under the component_loaders/ directory (#18438) 2026-02-08 23:02:27 +08:00
wxy 43eecd8265 [diffusion] feat: support efficient sequence shard (#18161) 2026-02-08 21:09:39 +08:00
00248d85c7 [diffusion] platform: support WAN/FLUX/Qwen-Image/Qwen-Image-edit on Ascend (#13662)
Co-authored-by: dhx98 <haox.dai@gmail.com>
Co-authored-by: DHX98 <haoxiand@andrew.cmu.edu>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: DHX98 <DHX98@noreply.gitcode.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
2026-02-08 10:45:30 +08:00
wxy 64950d8f97 [diffusion] feat: support saving videos directly on the server to avoid the overhead of tensor transfer (#18253) 2026-02-07 22:08:42 +08:00
Mick 31d4cd2ffd [diffusion] fix: respect dist_timeout option (#18386) 2026-02-07 20:56:04 +08:00
Hao JinandHao Jin <Hao Jin> d792aa7618 [diffusion] fix: remove unnecessary norm_type argument from GLM-Image dits (#18382)
Co-authored-by: Hao Jin <Hao Jin>
2026-02-07 20:35:12 +08:00
Xiaoyu Zhangandyihanc baec650462 [Diffusion] Apply fused_norm_scale_shift to LTX2/MOVA (#18257)
Co-authored-by: yihanc <yingluosanqian@gmail.com>
2026-02-07 17:28:42 +08:00
xiaoye 79d409f210 [diffusion] fix: offload text encoder model in image encoding stage (#18317) 2026-02-06 22:55:56 +08:00
陈一涵 f798ab9775 [diffusion] fix: fix torch.compile graph break caused by torch._dynamo.disable (#18336) 2026-02-06 14:48:09 +08:00
wxyandMick b639779dd8 [diffusion] feat: allow T5's TP Group to reuse the transformer's SP Group (#17818)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-06 00:12:19 +08:00
陈一涵 4aa03d91fd [diffusion] fix: fix accuracy bug caused by #14717 (#18296) 2026-02-05 20:36:18 +08:00
Xiaoyu Zhang dff3ba202a [Diffusion] Support layerwise offload for mova (#18272) 2026-02-05 13:16:07 +08:00
Mick f218234e4f [diffusion] chore: prohibit Chinese characters usage (#18249) 2026-02-05 09:22:26 +08:00
Mick 36a3e78af9 [diffusion] refactor: move model_stages into stages folder (#18248) 2026-02-05 00:23:31 +08:00
wxy 4c403045ec [diffusion] fix: fix the bug of redundant memory usage on GPU-0 (#18221) 2026-02-04 21:25:23 +08:00
Zhang Yiyang (SII) 0c9a0adc53 [diffusion] chore: clean MOVA codes (#18107) 2026-02-04 21:23:41 +08:00
Evrard-NilandMick ce02df8592 [diffusion] logging: downgrade default prompt log from info to debug (#17813)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-04 19:19:02 +08:00
4739f2e8d5 [diffusion] kernel: gated residual layernorm scale shift and layernorm scale shift kernel fusion for Qwen-Image, WAN and HunyuanVideo (#14717)
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <joeyzhu@nvidia.com>
Co-authored-by: root <root@a4u8g-0120.ipp2a2.colossus.nvidia.com>
Co-authored-by: Yihan Chen <yingluosanqian@example.com>
Co-authored-by: 陈一涵 <yingluosanqian@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-02-04 13:46:20 +08:00
wxy da758ed601 [diffusion] fix: fix server cache-dit bug under continuous dynamic requests (#17140) 2026-02-04 09:03:37 +08:00