chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,452 Commits 1 Branch 0 Tags
ec2461bc16e59d8a5738340fb559ccf396cd9af7
Commit Graph

259 Commits

Author SHA1 Message Date
R0CKSTAR
ec2461bc16 [diffusion] hardware: support diffusion models on MTGPU (multi-GPU, 5/N) (#17318) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-03 12:44:22 -08:00
R0CKSTAR
acf724b036 [Diffusion] Only import sgl_kernel in custom op cuda path (SiluAndMul and RMSNorm) (#15592) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-03 12:42:58 -08:00
Xiaoyu Zhang
eedd472025 [Diffusion] fix serving image_edit get input image bug (#18109) 2026-02-03 12:17:16 +08:00
Mick
62004fd2be [diffusion] UX: improve logging (#18122) 2026-02-03 10:35:05 +08:00
CHEN Xi
aa780a6258 [diffusion] fix: remove accelerate dependency for device mapping (#18026) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-02-02 17:24:19 +08:00
陈一涵
86117dfe0e [diffusion] CI: deprecate WarmupRunner in CI (#18038) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-02 15:16:08 +08:00
Mick
c84cd4b5ff [diffusion] fix: fix missing component names for VAELoader (#18069) 2026-02-02 09:48:17 +08:00
Mick
977096ae03 [diffusion] cli: introduce generic attention backend configuration in ServerArgs (#18036) 2026-02-02 09:47:40 +08:00
Kangyan-Zhou
9c168fcac7 Fix Diffusion Request Validation to allow missing input artifacts if the input only contains text (#16610) 2026-01-31 23:38:40 -08:00
Mick
1a006c2a0d [diffusion] refactor: split component_loader into component-wise files (#17820) 2026-01-31 20:22:31 +08:00
Xiaoyu Zhang
22aad4e2c4 [Diffusion] Fix FLUX.1-schnell time embedding argument mismatch (#17988) 2026-01-31 11:47:27 +08:00
Xiaoyu Zhang
abf13ccc11 [Diffusion] Fix lora default lora_scale bug (#17982) 2026-01-30 22:04:54 +08:00
EduardDurech
1b6798a6a4 Fix torch.__version__ for PEP440 (#15682) 2026-01-29 11:55:13 -08:00
Ratish P
88fb927cc9 [diffusion]: add dummy device attribute to fix AttributeError (#17949) 2026-01-29 09:35:12 -08:00
Yuhao Yang
3c2f4c7bbe [diffusion] model: sync with upstream z-Image (#17822) 2026-01-29 21:10:11 +08:00
RoyWang
30adf78f82 [diffusion]: align sglang diffusion AMD pyproject_other.toml diffusion dependency with pyproject.toml (#16225) 
Co-authored-by: roywang <roywang@amd.com>
 2026-01-29 01:50:57 -08:00
triple-mu
319f6886fe [diffusion] model: move tp_rmsnorm check to WanTransformerBlock (#17792) 2026-01-29 16:39:00 +08:00
Zhang Yiyang (SII)
cdedbf1486 [diffusion] fix: resolve library mismatch in scheduler and update dit offload method name (#17916) 2026-01-29 15:54:36 +08:00
R0CKSTAR
d3cdee0a04 [MUSA][4/N] Add common device utilities, distributed backend, and custom op wiring (#17246) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-28 23:13:24 -08:00
Zhang Yiyang (SII)
09a9147f59 [diffusion] model: support MOVA (#17704) 
Co-authored-by: gaoyang07 <Gary1546308416AL@gmail.com>
Co-authored-by: cms42 <c@cms42.top>
Co-authored-by: cms42 <44895820+cms42@users.noreply.github.com>
Co-authored-by: Ruixiao Li <cgruixiao@outlook.com>
Co-authored-by: Li Ruixiao(SII) <80368770+Li-dongyang@users.noreply.github.com>
 2026-01-29 09:12:08 +08:00
triple-mu
1d1e72e516 [diffusion] fix: fix comfyui import typo (#17834) 2026-01-28 23:49:55 +08:00
陈一涵
647428d8d6 [diffusion] perf: apply mul add fusion for Qwen-Image (#16299) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-28 09:40:13 +08:00
Yashika Gandhi - Google
32ea7bcdd8 [diffusion] endpoint: fix vertex generate (#17611) 2026-01-28 09:38:56 +08:00
Mick
88fcd8535f [diffusion] feat: add an arg for controlling the number of prefetched layers in layerwise-offload (#17693) 2026-01-28 09:34:27 +08:00
Mick
1507dc6cdf [diffusion] fix: fix suppressing error log on non-main ranks (#17712) 2026-01-28 09:29:19 +08:00
Xiaoyu Zhang
331a22427c [Diffusion] glm-image apply flashinfer rope (#17689) 2026-01-28 08:51:37 +08:00
fsygd
547e2d037e [diffusion] refactor: add arg to control the precision of dit (#17751) 2026-01-27 23:01:23 +08:00
WenhaoZhang
0519b0935f [diffusion] comfyui: support Qwen-Image, Multi-GPU Z-Image, and Enhanced ComfyUI Integration (#17678) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-27 10:06:42 +08:00
Prozac614
12f794e516 [diffusion] fix: fix missing backend argument in pipelines_core initialization (#17343) 2026-01-26 15:47:10 +08:00
Mick
b105dad5da [diffusion] refactor: remove useless lazy-import cache-dit codes (#17659) 2026-01-25 22:43:22 +08:00
Xiaoyu Zhang
3992a023e6 Move fa4 from sgl-kernel to jit kernel (#17353) 2026-01-24 15:25:03 +08:00
Xiaoyu Zhang
7a4bb0d516 [Diffusion] Add diffusion time embedding to jit kernel (#17658) 2026-01-24 14:27:08 +08:00
GMI Xiao Jin
d0919be733 [diffusion] model: LTX-2 Support (2/2) (#17496) 
Co-authored-by: Fan Yin <1106310035@qq.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
 2026-01-24 12:51:37 +08:00
GMI Xiao Jin
797a9811a2 [diffusion] model: LTX-2 (1/2) (#17495) 
Co-authored-by: FlamingoPg <1106310035@qq.com>
 2026-01-24 11:59:48 +08:00
Yuzhen Zhou
2169025b77 turn off dit_layerwise_offload for wan on rocm (#17569) 2026-01-23 15:22:42 +08:00
Xiaoyu Zhang
5324027007 [Diffusion] Make the apply_qknorm function easier to use (#17537) 2026-01-22 22:32:15 +08:00
triple-mu
3705f90629 [diffusion] model: optimize torch.compile (#17472) 2026-01-22 22:05:47 +08:00
Chi McIsaac
71482dd171 [diffusion] feat: enable passing Cache‑DiT config for diffusers backend (#16662) 
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
Signed-off-by: qimcis <chixie.mcisaac@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-22 13:13:34 +08:00
Xiaoyu Zhang
590969ee9c [Diffusion] Support select fa2 backend in hopper (#17514) 2026-01-22 08:23:53 +08:00
Xiaoyu Zhang
19089aa431 [Diffusion] Refactor diffusion is_cuda check (#17498) 2026-01-21 23:02:24 +08:00
Zhu Yuhua
2c1b164a92 [diffusion] improve: skip negative prompt encoding when guidance_scale <= 1.0 or negative_prompt is None (#16919) 
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>
 2026-01-21 20:01:55 +08:00
Fan Lin
e7224e9681 [diffusion] fix: fix the LoRA weights mismatch caused by weights packing (#17355) 2026-01-21 18:17:16 +08:00
HuangJi
e776239afd [diffusion] feat: support SageSparseLinearAttention attention backend (#17399) 2026-01-21 18:13:51 +08:00
blahblah
0a7a2017a0 [diffusion] refactor: refactor and simplify teacache for cachabledit and wanvideo (#16396) 
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: blahblah <blahblah>
 2026-01-21 15:42:45 +08:00
Xiaoyu Zhang
cc410a1088 [Diffusion] Apply qknorm to flux2 and apply lightx2v rms_norm_one_pass kernel(without residual) (#17305) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-19 21:25:33 +08:00
Xiaoyu Zhang
a3d9a21882 Revert "[Perf] fuse q, k norm for Flux2Attention (#17241)" (#17332) 2026-01-19 15:24:11 +08:00
Minglei Zhu
64946679b5 [Perf] fuse q, k norm for Flux2Attention (#17241) 
Co-authored-by: Minglei Zhu <zminglei@linkedin.com>
 2026-01-19 14:33:34 +08:00
Xiaoyu Zhang
330605cc88 [Diffusion] Apply jit qk_norm to flux1 (#17296) 2026-01-19 00:28:36 +08:00
Changyi Yang
8fd3399880 [diffusion] fix: set guidance_scale default to None (#17182) 2026-01-18 15:04:11 +08:00
Mick
09491a9bcd cli: support sglang version (#17250) 2026-01-18 13:20:24 +08:00