chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
8,935 Commits 1 Branch 0 Tags
6ee970a36509dfc28388368f19ebed0895180670
Commit Graph

204 Commits

Author SHA1 Message Date
Xiaoyu Zhang
6ee970a365 [Diffusion] Hot fix broken output_path default value (#17180) 2026-01-16 12:14:09 +08:00
Ratish P
c81bad1bf7 [diffusion] feat: add cloud storage support for API (#14579) 2026-01-16 10:29:38 +08:00
wxy
d11e2dc6f4 [diffusion] chore: improve the output_path config and enable the server to return inference duration (#16965) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-15 22:31:50 +08:00
Mick
16831ab6d7 [diffusion] fix: fix using upstream flash_attn on blackwell (#17111) 2026-01-15 22:30:48 +08:00
R0CKSTAR
c9a45b7e3c [diffusion] fix: fix UMA detection (#17113) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-15 22:29:46 +08:00
HuangJi
e7df8bdc5c [diffusion] refactor: move SLA to attention_backend folder (#17020) 2026-01-15 21:36:48 +08:00
Lancer
e997995037 [diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064) 
Signed-off-by: Lancer <maruxiang6688@gmail.com>
Co-authored-by: Lancer <maruxiang6688@gmail.com>
 2026-01-15 21:28:57 +08:00
Xiaoyu Zhang
0d904ef44c [diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058) 2026-01-15 00:12:33 +08:00
Yuan Luo
969faaa410 [diffusion] fix: revise fa4 backend to support blackwell (#17077) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-14 23:31:46 +08:00
HuangJi
030496eb06 [diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962) 2026-01-14 14:44:10 +08:00
Mick
9524040220 [diffusion] chore: refactor warmup logic (#17027) 2026-01-14 11:35:06 +08:00
Yuhao Yang
a0b4ba9032 [diffusion] model: GLM-Image (#16894) 
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-01-14 02:02:03 +08:00
Mick
7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
ahb13
888d7e54d1 [diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790) 
Co-authored-by: root <root@nimrodb200.tail5cbfe.ts.net>
Co-authored-by: ahb13 <ahb13@qq.com>
 2026-01-13 21:11:19 +08:00
qichu-yun
3cb1fbaee4 [diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935) 2026-01-13 21:09:11 +08:00
Xiaoyu Zhang
740d3c0b39 [Diffusion] Remove useless dependency in diffusion (#16967) 2026-01-13 17:25:53 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
HuangJi
a83484275d [diffusion] perf: optimize linear calculation in SLA (#16648) 2026-01-13 09:38:35 +08:00
Mick
47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) 2026-01-13 09:29:07 +08:00
Mick
2b42309955 [diffusion] UX: provide solutions for OOM (#16940) 2026-01-13 09:25:27 +08:00
WenhaoZhang
76f69b7753 [diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
 2026-01-12 21:58:16 +08:00
HuangJi
2dadf63562 [diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-12 19:40:37 +08:00
HuangJi
feb39f7768 [diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536) 2026-01-12 13:55:38 +08:00
WenhaoZhang
5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 23:32:45 +08:00
wxy
76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) 2026-01-10 21:25:59 +08:00
WenhaoZhang
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 20:17:35 +08:00
sunxxuns
64a31d4b75 [diffusion] amd: fix SGLANG_DIFFUSION_ATTENTION_BACKEND env var for diffusion attention backend selection (#16325) 
Co-authored-by: root <root@mi300x8-008.atl1.do.cpe.ice.amd.com>
 2026-01-09 20:16:58 +08:00
Xiaoyu Zhang
9d4d57dbfa [Diffusion] Tiny rename parallel_groups (#16743) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-09 15:08:25 +08:00
triple-mu
f7f5c3896d [diffusion] model: wan tp+usp optimize (#16720) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-09 09:40:31 +08:00
cheng peng
82a8d77bc0 [Diffusion] model: fix zimage tp (#16719) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-08 22:47:21 +08:00
Xiaoyu Zhang
294ff71d18 [Diffusion] Avoid cpu2gpu sync in flashinfer rope and apply flashinfer rope to wanvideo (#16668) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-08 22:44:38 +08:00
陈一涵
48b8dcd42e [jit kernel] support dtype as a cpp template parameter (#16452) 2026-01-08 13:54:33 +08:00
Fan Lin
41b434a7e6 [diffusion] endpoint: add API endpoint to query loaded LoRA adapters information (#16533) 2026-01-08 13:51:26 +08:00
Alison Shao
63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Yuhao Yang
e14f5ec8a8 [diffusion] refactor: eliminate redundant parameters in req (#16505) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-08 11:14:03 +08:00
Xiaoyu Zhang
5a5cece561 [Diffusion] clean useless and buggy set_seq_parallel_pg in yunchang (#16669) 2026-01-08 11:08:34 +08:00
Xiaoyu Zhang
32a6540afc [Diffusion] Fix Ulysses/Ring process group construction under TP to enable correct Wan2.2 tensor parallelism (#16532) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-07 20:52:36 +08:00
Mick
badcd02896 [diffusion] chore: automatically enable dit_layerwise_offload for Wan (#16499) 2026-01-07 10:22:08 +08:00
Kangyan-Zhou
18e2ef09d7 Add v1/models endpoint to diffusion model APIs so that they can be discovered by model gateway (#16425) 2026-01-06 14:28:24 -08:00
Xiaoyu Zhang
5e5b1183ed [Diffusion] Ring Attention support sage backend (#16496) 2026-01-06 14:45:53 +08:00
Adarsh Shirawalmath
7be1a8c70c [diffusion] feat: support diffusers backend - run any model supported by diffusers (#14112) 2026-01-06 12:30:57 +08:00
Mick
ca922d4b05 [diffusion] feat: support warmup with resolutions (#16434) 2026-01-06 10:32:18 +08:00
Qi Yuhang
dcfb92ddbc [diffusion] fix: fix using the sub-optimal fa kernel (#16382) 2026-01-05 16:25:41 +08:00
Kangyan-Zhou
ca80c19b55 Revert "[diffusion] feat: support warmup with resolutions" (#16433) 2026-01-04 18:44:05 -08:00
Mick
9a8ba3c189 [diffusion] feat: support warmup with resolutions (#16330) 2026-01-05 10:16:26 +08:00
Chi McIsaac
dcacc492d0 [diffusion] fix: fix RuntimeError in SageAttention3 on Blackwell with Qwen-Image (#16335) 
Co-authored-by: qimcis <qimcis@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 22:12:53 +08:00
Mick
2c09de343e [diffusion] improve: skip loading vision module for text encoders (#16304) 2026-01-03 19:30:45 +08:00
Xiaoyu Zhang
d0fb24ee7b [Diffusion] Flux2 tp support (#16219) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 17:02:27 +08:00
Alison Shao
5b4f790200 [diffusion] CI: add CI validation for diffusion model downloads (#16311) 2026-01-03 14:12:45 +08:00
triple-mu
888e126ac9 [diffusion] comment: fix typo (#16257) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 11:42:04 +08:00