Commit Graph
42 Commits
Author SHA1 Message Date
Mick dc743fe4ba [diffusion] chore: clean srt imports (#17252) 2026-01-17 15:47:49 +08:00
Mick 16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) 2026-01-15 22:30:48 +08:00
LancerandLancer e997995037 [diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064)
Signed-off-by: Lancer <maruxiang6688@gmail.com>
Co-authored-by: Lancer <maruxiang6688@gmail.com>
2026-01-15 21:28:57 +08:00
Xiaoyu Zhang 0d904ef44c [diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058) 2026-01-15 00:12:33 +08:00
Yuhao Yangandjianyingzhu a0b4ba9032 [diffusion] model: GLM-Image (#16894)
Co-authored-by: jianyingzhu <53300651@qq.com>
2026-01-14 02:02:03 +08:00
Mick 7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
Alison Shao 63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Mick 2c09de343e [diffusion] improve: skip loading vision module for text encoders (#16304) 2026-01-03 19:30:45 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> f26f6c2c99 [diffusion] fix: make lora compatible with layerwise-offload (#16298)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-02 22:33:26 +08:00
Yuhao YangandMick 39ca57cd28 [diffusion] chore: tiny fix model config (#16159)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-30 22:11:38 +08:00
Mick 3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) 2025-12-30 22:06:57 +08:00
yh0903Han YuMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
49adb37e37 [diffusion] chore: fix ZMQ binding and model loading for FastWan compatibility (#13978)
Co-authored-by: Han Yu <hyu5@dt-login01.delta.ncsa.illinois.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-30 18:09:38 +08:00
Mick b5d9fc873b [diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069) 2025-12-29 23:37:59 +08:00
Yuhao Yang 0cd2b719a5 [diffusion] chore: remove useless params (#15925) 2025-12-28 01:01:08 +08:00
Mick 39d56196a0 [diffusion] logging: log available gpu mem while loading and generating (#15936) 2025-12-28 00:34:58 +08:00
Mick aa89c6a7e2 [diffusion] refactor: unify model loading and offloading behavior (#15923) 2025-12-27 16:18:24 +08:00
Yuhao Yang 29ce7b3612 [diffusion] chore: remove stepvideo code (#15918) 2025-12-27 13:25:05 +08:00
Xiaoyu ZhangandMick e6ce16a4c2 [diffusion] feat: support TP for Flux.1.dev (#15666)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-25 18:00:44 +08:00
ryang ffc23ef877 [diffusion] feat: generalize layerwise offloader to flux1 (#15633) 2025-12-23 22:22:40 +08:00
Xiaoyu Zhang 8999ce754f [diffusion] perf: support zero-cost weight offload and overlap with compute for wan-series (#15511) 2025-12-20 22:52:40 +08:00
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760)
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
2025-12-19 15:38:46 +08:00
R0CKSTAR 9f4ed93dd8 [diffusion] multi-platform: use current_platform.device_type to replace hard-coded cuda device (#15232)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2025-12-16 22:17:33 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 1dedb63860 [diffusion] chore: minor code cleanups (#15190)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-15 23:57:02 +08:00
Xiaoyu ZhangandMick 64b5c3ab90 [diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-15 00:33:29 +08:00
Mick 82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
Mick 5d804a3767 [diffusion] feat: support sageattn & sageattn3 backend (#14878) 2025-12-11 20:59:44 +08:00
Xiaoyu ZhangandMick 6d41791823 [diffusion] perf: add QKV fusion optimization for Flux models (#14505)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-06 20:44:16 +08:00
zyksir 46b05ef58f [diffusion] fix: fix bug about pin memory when offloading (#14472) 2025-12-05 15:26:30 +08:00
Mick beec8eed6a [diffusion] chore: further improve model searching logic (#14484) 2025-12-05 15:04:55 +08:00
zyksir fa0ca97694 [diffusion] improve: further optimize model load (#13836) 2025-12-05 10:45:20 +08:00
f764c6910d [diffusion] feat: support distilled vae generic (#14195)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-03 10:27:31 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 3ab8ae6847 [diffusion] fix: fix Flux.2 condition image resize (#14232)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-02 10:05:44 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 7ce8faae28 [diffusion] refactor: remove hard-code of instanceof on PipelineConfig (#14186)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-01 16:35:34 +08:00
Mick 951028968c [diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205) 2025-11-28 14:17:32 +08:00
Mick 5102d00901 [diffusion] model: support black-forest-labs/FLUX.2-dev (#14000) 2025-11-27 01:49:40 +08:00
Mick dfd7ab9682 [diffusion] feat: support LoRA (#13859) 2025-11-26 00:21:33 +08:00
Yibo Cai da182e4b83 [CI] fix lint error (#13891) 2025-11-24 20:51:33 -08:00
alisonshaoMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
83e7207763 [diffusion] CI: add validation and cleanup for corrupted safetensors in multimodal loader (#13870)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-25 12:02:43 +08:00
zyksirandMick 4360279036 [diffusion] server: use meta to avoid Linear init for TextEncoder (#13564)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-21 15:14:24 +08:00
Mick eda2f70033 [diffusion] doc: minor update docs (#13177) 2025-11-21 14:35:29 +08:00
Binyao Jiang 90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
+9 7bc1dae095 WIP: initial multimodal-gen support (#12484)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
2025-11-05 12:28:52 -08:00