Commit Graph
329 Commits
Author SHA1 Message Date
Zhang Yiyang (SII) 0c9a0adc53 [diffusion] chore: clean MOVA codes (#18107) 2026-02-04 21:23:41 +08:00
Evrard-NilandMick ce02df8592 [diffusion] logging: downgrade default prompt log from info to debug (#17813)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-04 19:19:02 +08:00
4739f2e8d5 [diffusion] kernel: gated residual layernorm scale shift and layernorm scale shift kernel fusion for Qwen-Image, WAN and HunyuanVideo (#14717)
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <joeyzhu@nvidia.com>
Co-authored-by: root <root@a4u8g-0120.ipp2a2.colossus.nvidia.com>
Co-authored-by: Yihan Chen <yingluosanqian@example.com>
Co-authored-by: 陈一涵 <yingluosanqian@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-02-04 13:46:20 +08:00
wxy da758ed601 [diffusion] fix: fix server cache-dit bug under continuous dynamic requests (#17140) 2026-02-04 09:03:37 +08:00
R0CKSTAR 7de650c83c [diffusion] hardware: support diffusion models on MTGPU (doc, 6/N) (#17346)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:44:57 -08:00
R0CKSTAR ec2461bc16 [diffusion] hardware: support diffusion models on MTGPU (multi-GPU, 5/N) (#17318)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:44:22 -08:00
R0CKSTAR acf724b036 [Diffusion] Only import sgl_kernel in custom op cuda path (SiluAndMul and RMSNorm) (#15592)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:42:58 -08:00
Xiaoyu Zhang eedd472025 [Diffusion] fix serving image_edit get input image bug (#18109) 2026-02-03 12:17:16 +08:00
Mick 62004fd2be [diffusion] UX: improve logging (#18122) 2026-02-03 10:35:05 +08:00
CHEN XiandKangyan-Zhou aa780a6258 [diffusion] fix: remove accelerate dependency for device mapping (#18026)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-02-02 17:24:19 +08:00
陈一涵andMick 86117dfe0e [diffusion] CI: deprecate WarmupRunner in CI (#18038)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-02 15:16:08 +08:00
Mick c84cd4b5ff [diffusion] fix: fix missing component names for VAELoader (#18069) 2026-02-02 09:48:17 +08:00
Mick 977096ae03 [diffusion] cli: introduce generic attention backend configuration in ServerArgs (#18036) 2026-02-02 09:47:40 +08:00
47592a23c7 [CI] Fix AMD CI by inlining dummy_grok config (#18044)
Co-authored-by: root <root@mi300x8-005.atl1.do.cpe.ice.amd.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-01 00:20:57 -08:00
Kangyan-Zhou 9c168fcac7 Fix Diffusion Request Validation to allow missing input artifacts if the input only contains text (#16610) 2026-01-31 23:38:40 -08:00
Mick 1a006c2a0d [diffusion] refactor: split component_loader into component-wise files (#17820) 2026-01-31 20:22:31 +08:00
Xiaoyu Zhang 22aad4e2c4 [Diffusion] Fix FLUX.1-schnell time embedding argument mismatch (#17988) 2026-01-31 11:47:27 +08:00
Xiaoyu Zhang abf13ccc11 [Diffusion] Fix lora default lora_scale bug (#17982) 2026-01-30 22:04:54 +08:00
EduardDurech 1b6798a6a4 Fix torch.__version__ for PEP440 (#15682) 2026-01-29 11:55:13 -08:00
Ratish P 88fb927cc9 [diffusion]: add dummy device attribute to fix AttributeError (#17949) 2026-01-29 09:35:12 -08:00
Yuhao Yang 3c2f4c7bbe [diffusion] model: sync with upstream z-Image (#17822) 2026-01-29 21:10:11 +08:00
RoyWangandroywang 30adf78f82 [diffusion]: align sglang diffusion AMD pyproject_other.toml diffusion dependency with pyproject.toml (#16225)
Co-authored-by: roywang <roywang@amd.com>
2026-01-29 01:50:57 -08:00
triple-mu 319f6886fe [diffusion] model: move tp_rmsnorm check to WanTransformerBlock (#17792) 2026-01-29 16:39:00 +08:00
Zhang Yiyang (SII) cdedbf1486 [diffusion] fix: resolve library mismatch in scheduler and update dit offload method name (#17916) 2026-01-29 15:54:36 +08:00
R0CKSTAR d3cdee0a04 [MUSA][4/N] Add common device utilities, distributed backend, and custom op wiring (#17246)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-01-28 23:13:24 -08:00
09a9147f59 [diffusion] model: support MOVA (#17704)
Co-authored-by: gaoyang07 <Gary1546308416AL@gmail.com>
Co-authored-by: cms42 <c@cms42.top>
Co-authored-by: cms42 <44895820+cms42@users.noreply.github.com>
Co-authored-by: Ruixiao Li <cgruixiao@outlook.com>
Co-authored-by: Li Ruixiao(SII) <80368770+Li-dongyang@users.noreply.github.com>
2026-01-29 09:12:08 +08:00
triple-mu 1d1e72e516 [diffusion] fix: fix comfyui import typo (#17834) 2026-01-28 23:49:55 +08:00
Mick 2573a262af [diffusion] doc: fix wrong docker run command (#17856) 2026-01-28 14:52:33 +08:00
陈一涵andgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 647428d8d6 [diffusion] perf: apply mul add fusion for Qwen-Image (#16299)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-28 09:40:13 +08:00
Yashika Gandhi - Google 32ea7bcdd8 [diffusion] endpoint: fix vertex generate (#17611) 2026-01-28 09:38:56 +08:00
Mick 88fcd8535f [diffusion] feat: add an arg for controlling the number of prefetched layers in layerwise-offload (#17693) 2026-01-28 09:34:27 +08:00
Mick 1507dc6cdf [diffusion] fix: fix suppressing error log on non-main ranks (#17712) 2026-01-28 09:29:19 +08:00
Xiaoyu Zhang 331a22427c [Diffusion] glm-image apply flashinfer rope (#17689) 2026-01-28 08:51:37 +08:00
fsygd 547e2d037e [diffusion] refactor: add arg to control the precision of dit (#17751) 2026-01-27 23:01:23 +08:00
WenhaoZhangniehen6174gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
0519b0935f [diffusion] comfyui: support Qwen-Image, Multi-GPU Z-Image, and Enhanced ComfyUI Integration (#17678)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-27 10:06:42 +08:00
Prozac614 12f794e516 [diffusion] fix: fix missing backend argument in pipelines_core initialization (#17343) 2026-01-26 15:47:10 +08:00
Mick b105dad5da [diffusion] refactor: remove useless lazy-import cache-dit codes (#17659) 2026-01-25 22:43:22 +08:00
59f027a8c8 [diffusion]: Fix ZImage SP sharding for caption and latent (#17301)
Co-authored-by: rhyshen <rhyshen@tencent.com>
Co-authored-by: florianzhao <florianzhao@tencent.com>
2026-01-25 10:10:48 +08:00
Xiaoyu Zhang 3992a023e6 Move fa4 from sgl-kernel to jit kernel (#17353) 2026-01-24 15:25:03 +08:00
Xiaoyu Zhang 7a4bb0d516 [Diffusion] Add diffusion time embedding to jit kernel (#17658) 2026-01-24 14:27:08 +08:00
d0919be733 [diffusion] model: LTX-2 Support (2/2) (#17496)
Co-authored-by: Fan Yin <1106310035@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
2026-01-24 12:51:37 +08:00
GMI Xiao JinandFlamingoPg 797a9811a2 [diffusion] model: LTX-2 (1/2) (#17495)
Co-authored-by: FlamingoPg <1106310035@qq.com>
2026-01-24 11:59:48 +08:00
Yuzhen Zhou 2169025b77 turn off dit_layerwise_offload for wan on rocm (#17569) 2026-01-23 15:22:42 +08:00
Xiaoyu Zhang 5324027007 [Diffusion] Make the apply_qknorm function easier to use (#17537) 2026-01-22 22:32:15 +08:00
triple-mu 3705f90629 [diffusion] model: optimize torch.compile (#17472) 2026-01-22 22:05:47 +08:00
Chi McIsaacandMick 71482dd171 [diffusion] feat: enable passing Cache‑DiT config for diffusers backend (#16662)
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
Signed-off-by: qimcis <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-22 13:13:34 +08:00
Xiaoyu Zhang 590969ee9c [Diffusion] Support select fa2 backend in hopper (#17514) 2026-01-22 08:23:53 +08:00
Xiaoyu Zhang 19089aa431 [Diffusion] Refactor diffusion is_cuda check (#17498) 2026-01-21 23:02:24 +08:00
Zhu Yuhua 2c1b164a92 [diffusion] improve: skip negative prompt encoding when guidance_scale <= 1.0 or negative_prompt is None (#16919)
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>
2026-01-21 20:01:55 +08:00
Fan Lin e7224e9681 [diffusion] fix: fix the LoRA weights mismatch caused by weights packing (#17355) 2026-01-21 18:17:16 +08:00