chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,309 Commits 1 Branch 0 Tags
1b6798a6a47d76953125aa4e9f00f0d603a98499
Commit Graph

48 Commits

Author SHA1 Message Date
RoyWang
30adf78f82 [diffusion]: align sglang diffusion AMD pyproject_other.toml diffusion dependency with pyproject.toml (#16225) 
Co-authored-by: roywang <roywang@amd.com>
 2026-01-29 01:50:57 -08:00
Zhang Yiyang (SII)
cdedbf1486 [diffusion] fix: resolve library mismatch in scheduler and update dit offload method name (#17916) 2026-01-29 15:54:36 +08:00
Zhang Yiyang (SII)
09a9147f59 [diffusion] model: support MOVA (#17704) 
Co-authored-by: gaoyang07 <Gary1546308416AL@gmail.com>
Co-authored-by: cms42 <c@cms42.top>
Co-authored-by: cms42 <44895820+cms42@users.noreply.github.com>
Co-authored-by: Ruixiao Li <cgruixiao@outlook.com>
Co-authored-by: Li Ruixiao(SII) <80368770+Li-dongyang@users.noreply.github.com>
 2026-01-29 09:12:08 +08:00
fsygd
547e2d037e [diffusion] refactor: add arg to control the precision of dit (#17751) 2026-01-27 23:01:23 +08:00
GMI Xiao Jin
797a9811a2 [diffusion] model: LTX-2 (1/2) (#17495) 
Co-authored-by: FlamingoPg <1106310035@qq.com>
 2026-01-24 11:59:48 +08:00
Mick
09491a9bcd cli: support sglang version (#17250) 2026-01-18 13:20:24 +08:00
Mick
dc743fe4ba [diffusion] chore: clean srt imports (#17252) 2026-01-17 15:47:49 +08:00
Mick
16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) 2026-01-15 22:30:48 +08:00
Lancer
e997995037 [diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064) 
Signed-off-by: Lancer <maruxiang6688@gmail.com>
Co-authored-by: Lancer <maruxiang6688@gmail.com>
 2026-01-15 21:28:57 +08:00
Xiaoyu Zhang
0d904ef44c [diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058) 2026-01-15 00:12:33 +08:00
Yuhao Yang
a0b4ba9032 [diffusion] model: GLM-Image (#16894) 
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-01-14 02:02:03 +08:00
Mick
7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
Alison Shao
63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Mick
2c09de343e [diffusion] improve: skip loading vision module for text encoders (#16304) 2026-01-03 19:30:45 +08:00
Mick
f26f6c2c99 [diffusion] fix: make lora compatible with layerwise-offload (#16298) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-02 22:33:26 +08:00
Yuhao Yang
39ca57cd28 [diffusion] chore: tiny fix model config (#16159) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-30 22:11:38 +08:00
Mick
3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) 2025-12-30 22:06:57 +08:00
yh0903
49adb37e37 [diffusion] chore: fix ZMQ binding and model loading for FastWan compatibility (#13978) 
Co-authored-by: Han Yu <hyu5@dt-login01.delta.ncsa.illinois.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-30 18:09:38 +08:00
Mick
b5d9fc873b [diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069) 2025-12-29 23:37:59 +08:00
Yuhao Yang
0cd2b719a5 [diffusion] chore: remove useless params (#15925) 2025-12-28 01:01:08 +08:00
Mick
39d56196a0 [diffusion] logging: log available gpu mem while loading and generating (#15936) 2025-12-28 00:34:58 +08:00
Mick
aa89c6a7e2 [diffusion] refactor: unify model loading and offloading behavior (#15923) 2025-12-27 16:18:24 +08:00
Yuhao Yang
29ce7b3612 [diffusion] chore: remove stepvideo code (#15918) 2025-12-27 13:25:05 +08:00
Xiaoyu Zhang
e6ce16a4c2 [diffusion] feat: support TP for Flux.1.dev (#15666) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-25 18:00:44 +08:00
ryang
ffc23ef877 [diffusion] feat: generalize layerwise offloader to flux1 (#15633) 2025-12-23 22:22:40 +08:00
Xiaoyu Zhang
8999ce754f [diffusion] perf: support zero-cost weight offload and overlap with compute for wan-series (#15511) 2025-12-20 22:52:40 +08:00
Yuzhen Zhou
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760) 
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
 2025-12-19 15:38:46 +08:00
R0CKSTAR
9f4ed93dd8 [diffusion] multi-platform: use current_platform.device_type to replace hard-coded cuda device (#15232) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-12-16 22:17:33 +08:00
Mick
1dedb63860 [diffusion] chore: minor code cleanups (#15190) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-15 23:57:02 +08:00
Xiaoyu Zhang
64b5c3ab90 [diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-15 00:33:29 +08:00
Mick
82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
Mick
5d804a3767 [diffusion] feat: support sageattn & sageattn3 backend (#14878) 2025-12-11 20:59:44 +08:00
Xiaoyu Zhang
6d41791823 [diffusion] perf: add QKV fusion optimization for Flux models (#14505) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-06 20:44:16 +08:00
zyksir
46b05ef58f [diffusion] fix: fix bug about pin memory when offloading (#14472) 2025-12-05 15:26:30 +08:00
Mick
beec8eed6a [diffusion] chore: further improve model searching logic (#14484) 2025-12-05 15:04:55 +08:00
zyksir
fa0ca97694 [diffusion] improve: further optimize model load (#13836) 2025-12-05 10:45:20 +08:00
Dongjie Zou
f764c6910d [diffusion] feat: support distilled vae generic (#14195) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-03 10:27:31 +08:00
Mick
3ab8ae6847 [diffusion] fix: fix Flux.2 condition image resize (#14232) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-02 10:05:44 +08:00
Mick
7ce8faae28 [diffusion] refactor: remove hard-code of instanceof on PipelineConfig (#14186) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-01 16:35:34 +08:00
Mick
951028968c [diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205) 2025-11-28 14:17:32 +08:00
Mick
5102d00901 [diffusion] model: support black-forest-labs/FLUX.2-dev (#14000) 2025-11-27 01:49:40 +08:00
Mick
dfd7ab9682 [diffusion] feat: support LoRA (#13859) 2025-11-26 00:21:33 +08:00
Yibo Cai
da182e4b83 [CI] fix lint error (#13891) 2025-11-24 20:51:33 -08:00
alisonshao
83e7207763 [diffusion] CI: add validation and cleanup for corrupted safetensors in multimodal loader (#13870) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-25 12:02:43 +08:00
zyksir
4360279036 [diffusion] server: use meta to avoid Linear init for TextEncoder (#13564) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-11-21 15:14:24 +08:00
Mick
eda2f70033 [diffusion] doc: minor update docs (#13177) 2025-11-21 14:35:29 +08:00
Binyao Jiang
90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
Mick
7bc1dae095 WIP: initial multimodal-gen support (#12484) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
 2025-11-05 12:28:52 -08:00