chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,452 Commits 1 Branch 0 Tags
ec2461bc16e59d8a5738340fb559ccf396cd9af7
Commit Graph

60 Commits

Author SHA1 Message Date
Mick
62004fd2be [diffusion] UX: improve logging (#18122) 2026-02-03 10:35:05 +08:00
Zhang Yiyang (SII)
09a9147f59 [diffusion] model: support MOVA (#17704) 
Co-authored-by: gaoyang07 <Gary1546308416AL@gmail.com>
Co-authored-by: cms42 <c@cms42.top>
Co-authored-by: cms42 <44895820+cms42@users.noreply.github.com>
Co-authored-by: Ruixiao Li <cgruixiao@outlook.com>
Co-authored-by: Li Ruixiao(SII) <80368770+Li-dongyang@users.noreply.github.com>
 2026-01-29 09:12:08 +08:00
Mick
88fcd8535f [diffusion] feat: add an arg for controlling the number of prefetched layers in layerwise-offload (#17693) 2026-01-28 09:34:27 +08:00
Mick
1507dc6cdf [diffusion] fix: fix suppressing error log on non-main ranks (#17712) 2026-01-28 09:29:19 +08:00
blahblah
0a7a2017a0 [diffusion] refactor: refactor and simplify teacache for cachabledit and wanvideo (#16396) 
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: blahblah <blahblah>
 2026-01-21 15:42:45 +08:00
Mick
7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
WenhaoZhang
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 20:17:35 +08:00
Xiaoyu Zhang
32a6540afc [Diffusion] Fix Ulysses/Ring process group construction under TP to enable correct Wan2.2 tensor parallelism (#16532) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-07 20:52:36 +08:00
Mick
ca922d4b05 [diffusion] feat: support warmup with resolutions (#16434) 2026-01-06 10:32:18 +08:00
Kangyan-Zhou
ca80c19b55 Revert "[diffusion] feat: support warmup with resolutions" (#16433) 2026-01-04 18:44:05 -08:00
Mick
9a8ba3c189 [diffusion] feat: support warmup with resolutions (#16330) 2026-01-05 10:16:26 +08:00
Xiaoyu Zhang
d0fb24ee7b [Diffusion] Flux2 tp support (#16219) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 17:02:27 +08:00
Alison Shao
5b4f790200 [diffusion] CI: add CI validation for diffusion model downloads (#16311) 2026-01-03 14:12:45 +08:00
sunxxuns
30cfb687fa fixed amd multimodal CI failures caused by refactor in #15812 #15813 (#16287) 2026-01-02 14:55:42 -08:00
Mick
5062537b67 [diffusion] feat: support lightweight e2e warmup for benchmarking (#16213) 2026-01-02 20:10:27 +08:00
Mick
5bf0d862dd [diffusion] CI: fix generate mode and add cli test (#16174) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-31 09:51:48 +08:00
Mick
3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) 2025-12-30 22:06:57 +08:00
Prozac614
f253f43c9d [diffusion] CI: fix LoRA downloading issues and respect offline flag (#15813) 2025-12-30 11:39:27 +08:00
Mick
1e45320198 [diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081) 2025-12-30 11:31:00 +08:00
Mick
8e08207c18 [diffusion] fix: fix serving with dit-layerwise-offload enabled (#16066) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2025-12-30 00:21:42 +08:00
Mick
d7a3336ebe [diffusion] fix: fix stages not logged when perf_dump_path is provided (#16016) 2025-12-28 23:17:43 +08:00
Mick
8dc6f0fc4d [diffusion] refactor: centralize hardware platform detection and streamline environment variable management (#15842) 2025-12-26 22:16:18 +08:00
Mick
2a8a785634 [diffusion] log: avoid logging in hot path if unnecessary (#15818) 2025-12-25 18:42:52 +08:00
Mick
2c5679f314 [diffusion] refactor: unify the profiling api for all executors (#15718) 2025-12-24 23:26:09 +08:00
Xiaoyu Zhang
42bff706df [diffusion] profiling: simplify --perf-dump-path JSON output (remove duplicate denoise steps) (#15537) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-21 12:56:46 +08:00
Mick
bc18cb8631 [diffusion] refactor: change zmq socket type to router for scheduler (#15479) 2025-12-21 00:39:54 +08:00
Mick
41bd76e18b [diffusion] log: fix wrong use of suppress_other_loggers (#15534) 2025-12-20 23:43:55 +08:00
Xiaoyu Zhang
8999ce754f [diffusion] perf: support zero-cost weight offload and overlap with compute for wan-series (#15511) 2025-12-20 22:52:40 +08:00
Mick
c0f9b51992 [diffusion] refactor: deprecate workloadtype (#15267) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-20 11:24:31 +08:00
ryang
1e58248808 [diffusion] multi-platform: add Sage Attention 3 Support for sm 120 (RTX5090) (#15382) 
Co-authored-by: Mengxi Li <marcyleemx@gmail.com>
 2025-12-19 21:27:02 +08:00
Yuzhen Zhou
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760) 
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
 2025-12-19 15:38:46 +08:00
Xiaoyu Zhang
9a7641d7bf [diffusion] profiling: include per-denoising-step timings in perf-dump-path (#15397) 2025-12-18 18:43:33 +08:00
Xiaoyu Zhang
6c4bf8a0be [diffusion] profiling: enhance trace export with gzip and integrity check (#15326) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-17 20:44:55 +08:00
R0CKSTAR
9f4ed93dd8 [diffusion] multi-platform: use current_platform.device_type to replace hard-coded cuda device (#15232) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-12-16 22:17:33 +08:00
Mick
1dedb63860 [diffusion] chore: minor code cleanups (#15190) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-15 23:57:02 +08:00
Xiaoyu Zhang
7bc8b1532e [diffusion] fix: fix AttributeError in _build_parallelism_config when accessing tp_group.device_group (#15196) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-15 23:41:06 +08:00
Lancer
abd3e048f2 [diffusion] fix: fix pytorch non-writable array warning (#15017) 2025-12-15 20:18:54 +08:00
Xiaoyu Zhang
92c29d43ac [diffusion] fix: cache dit with parallel (#15163) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-15 19:15:51 +08:00
Mick
82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
Mick
ca1144212a [diffusion] UX: suppress excessive loggers (#14900) 2025-12-11 22:10:22 +08:00
Mick
87dbdddc93 [diffusion] profile: early exit when enough steps are captured to reduce the size of the trace file (#14803) 2025-12-10 16:11:22 +08:00
AichenF
c8683ae305 [diffusion] cli: profiling utilities support (#14185) 
Co-authored-by: jianyingzhu <53300651@qq.com>
Co-authored-by: Jianying <53503712+jianyingzhu@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-08 00:59:45 +08:00
blahblah
66984a8b3d [diffusion] feat: support cache-dit integration (#14234) 
Co-authored-by: shuxiguo <shuxiguo@meituan.com>
Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-06 00:52:22 +08:00
Dongjie Zou
f764c6910d [diffusion] feat: support distilled vae generic (#14195) 
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-03 10:27:31 +08:00
Mick
0a362d653f [diffusion] log: unify generation performance logging (#14117) 2025-11-29 12:21:59 +08:00
Mick
951028968c [diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205) 2025-11-28 14:17:32 +08:00
Mick
dfd7ab9682 [diffusion] feat: support LoRA (#13859) 2025-11-26 00:21:33 +08:00
Mick
6f094deff0 [diffusion] CI: minor refactor CI for less code duplication (#13905) 2025-11-25 18:44:11 +08:00
Yuhao Yang
a22de641ef [diffusion] fix: fix hunyuanvideo and add 2-gpu ci test (#13720) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-11-22 20:54:51 +08:00
Mick
aa6e2c8aa0 [diffusion] log: minor improve logging (#13735) 2025-11-21 23:01:23 +08:00