chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,120 Commits 1 Branch 0 Tags
53240270075c2f0651a9909980c174da342e4a5f
Commit Graph

224 Commits

Author SHA1 Message Date
Xiaoyu Zhang
5324027007 [Diffusion] Make the apply_qknorm function easier to use (#17537) 2026-01-22 22:32:15 +08:00
triple-mu
3705f90629 [diffusion] model: optimize torch.compile (#17472) 2026-01-22 22:05:47 +08:00
Chi McIsaac
71482dd171 [diffusion] feat: enable passing Cache‑DiT config for diffusers backend (#16662) 
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
Signed-off-by: qimcis <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-22 13:13:34 +08:00
Xiaoyu Zhang
590969ee9c [Diffusion] Support select fa2 backend in hopper (#17514) 2026-01-22 08:23:53 +08:00
Xiaoyu Zhang
19089aa431 [Diffusion] Refactor diffusion is_cuda check (#17498) 2026-01-21 23:02:24 +08:00
Zhu Yuhua
2c1b164a92 [diffusion] improve: skip negative prompt encoding when guidance_scale <= 1.0 or negative_prompt is None (#16919) 
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>
 2026-01-21 20:01:55 +08:00
Fan Lin
e7224e9681 [diffusion] fix: fix the LoRA weights mismatch caused by weights packing (#17355) 2026-01-21 18:17:16 +08:00
HuangJi
e776239afd [diffusion] feat: support SageSparseLinearAttention attention backend (#17399) 2026-01-21 18:13:51 +08:00
blahblah
0a7a2017a0 [diffusion] refactor: refactor and simplify teacache for cachabledit and wanvideo (#16396) 
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: blahblah <blahblah>
 2026-01-21 15:42:45 +08:00
Xiaoyu Zhang
cc410a1088 [Diffusion] Apply qknorm to flux2 and apply lightx2v rms_norm_one_pass kernel(without residual) (#17305) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-19 21:25:33 +08:00
Xiaoyu Zhang
a3d9a21882 Revert "[Perf] fuse q, k norm for Flux2Attention (#17241)" (#17332) 2026-01-19 15:24:11 +08:00
Minglei Zhu
64946679b5 [Perf] fuse q, k norm for Flux2Attention (#17241) 
Co-authored-by: Minglei Zhu <zminglei@linkedin.com>
 2026-01-19 14:33:34 +08:00
Xiaoyu Zhang
330605cc88 [Diffusion] Apply jit qk_norm to flux1 (#17296) 2026-01-19 00:28:36 +08:00
Changyi Yang
8fd3399880 [diffusion] fix: set guidance_scale default to None (#17182) 2026-01-18 15:04:11 +08:00
Mick
09491a9bcd cli: support sglang version (#17250) 2026-01-18 13:20:24 +08:00
Michael
53609e5e5b Revert "[Diffusion] Move diffusion time embedding to jit kernel" (#17257) 2026-01-17 21:29:22 +08:00
Mick
dc743fe4ba [diffusion] chore: clean srt imports (#17252) 2026-01-17 15:47:49 +08:00
Xiaoyu Zhang
2cdd4370bc [Diffusion] Move diffusion time embedding to jit kernel (#16879) 2026-01-17 12:21:22 +08:00
R0CKSTAR
a1dd3d48ac [diffusion] hardware: support diffusion (single GPU, 3/N) (#17105) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-16 17:01:09 +08:00
Adarsh Shirawalmath
7c39ea68f3 [diffusion] model: support flux Klein (#17173) 2026-01-16 16:16:17 +08:00
Xiaoyu Zhang
6ee970a365 [Diffusion] Hot fix broken output_path default value (#17180) 2026-01-16 12:14:09 +08:00
Ratish P
c81bad1bf7 [diffusion] feat: add cloud storage support for API (#14579) 2026-01-16 10:29:38 +08:00
wxy
d11e2dc6f4 [diffusion] chore: improve the output_path config and enable the server to return inference duration (#16965) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-15 22:31:50 +08:00
Mick
16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) 2026-01-15 22:30:48 +08:00
R0CKSTAR
c9a45b7e3c [diffusion] fix: fix UMA detection (#17113) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-15 22:29:46 +08:00
HuangJi
e7df8bdc5c [diffusion] refactor: move SLA to attention_backend folder (#17020) 2026-01-15 21:36:48 +08:00
Lancer
e997995037 [diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064) 
Signed-off-by: Lancer <maruxiang6688@gmail.com>
Co-authored-by: Lancer <maruxiang6688@gmail.com>
 2026-01-15 21:28:57 +08:00
Xiaoyu Zhang
0d904ef44c [diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058) 2026-01-15 00:12:33 +08:00
Yuan Luo
969faaa410 [diffusion] fix: revise fa4 backend to support blackwell (#17077) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-14 23:31:46 +08:00
HuangJi
030496eb06 [diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962) 2026-01-14 14:44:10 +08:00
Mick
9524040220 [diffusion] chore: refactor warmup logic (#17027) 2026-01-14 11:35:06 +08:00
Yuhao Yang
a0b4ba9032 [diffusion] model: GLM-Image (#16894) 
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-01-14 02:02:03 +08:00
Mick
7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
ahb13
888d7e54d1 [diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790) 
Co-authored-by: root <root@nimrodb200.tail5cbfe.ts.net>
Co-authored-by: ahb13 <ahb13@qq.com>
 2026-01-13 21:11:19 +08:00
qichu-yun
3cb1fbaee4 [diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935) 2026-01-13 21:09:11 +08:00
Xiaoyu Zhang
740d3c0b39 [Diffusion] Remove useless dependency in diffusion (#16967) 2026-01-13 17:25:53 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
HuangJi
a83484275d [diffusion] perf: optimize linear calculation in SLA (#16648) 2026-01-13 09:38:35 +08:00
Mick
47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) 2026-01-13 09:29:07 +08:00
Mick
2b42309955 [diffusion] UX: provide solutions for OOM (#16940) 2026-01-13 09:25:27 +08:00
WenhaoZhang
76f69b7753 [diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
 2026-01-12 21:58:16 +08:00
HuangJi
2dadf63562 [diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-12 19:40:37 +08:00
HuangJi
feb39f7768 [diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536) 2026-01-12 13:55:38 +08:00
WenhaoZhang
5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 23:32:45 +08:00
wxy
76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) 2026-01-10 21:25:59 +08:00
WenhaoZhang
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 20:17:35 +08:00
sunxxuns
64a31d4b75 [diffusion] amd: fix SGLANG_DIFFUSION_ATTENTION_BACKEND env var for diffusion attention backend selection (#16325) 
Co-authored-by: root <root@mi300x8-008.atl1.do.cpe.ice.amd.com>
 2026-01-09 20:16:58 +08:00
Xiaoyu Zhang
9d4d57dbfa [Diffusion] Tiny rename parallel_groups (#16743) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-09 15:08:25 +08:00
triple-mu
f7f5c3896d [diffusion] model: wan tp+usp optimize (#16720) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-09 09:40:31 +08:00
cheng peng
82a8d77bc0 [Diffusion] model: fix zimage tp (#16719) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-08 22:47:21 +08:00