chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

11116 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junhao Liu
7662b8b919 [diffusion] feat: implement upscaling (#19723) 2026-03-09 02:06:40 +08:00
xingsy97
b77dd41db0 [diffusion] fix: fix temporary resolution workaround (#20046) 2026-03-09 02:05:35 +08:00
hzh0425
0ac6c63ae4 [SpecV2-Mamba]: Refactor additional_ratio calculation when init mamba pool (#19660) 2026-03-09 00:39:26 +08:00
Ke Bao
07359efce9 Fix missing clone in hicache (#20130) 2026-03-08 23:21:18 +08:00
Junhao Liu
051427c0a3 [diffusion] benchmark: add SLO metric forinbench_serving (#18907) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-03-08 22:35:57 +08:00
liubiyongge
cc73355a1f [Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 21:30:55 +08:00
Mick
2c183350be [diffusion] fix: fix wrong dit config for qwen-image-edit-plus-2511 (#20123) 2026-03-08 20:08:36 +08:00
Glen Liu
1eed219f47 add mixed chunk unit test and make small refactors (#18776) 2026-03-08 19:56:09 +08:00
Ratish P
ab9de886c5 [diffusion] reduce LayerwiseOffloadManager reserved GPU memory (#20042) 2026-03-08 19:26:17 +08:00
Liangsheng Yin
29f3a5396e [Minor] Add SessionSlot.is_holding_kv property for readability (#20120) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-08 03:25:13 -07:00
sglang-bot
0f0c8b2f18 chore: bump sgl-kernel version to 0.3.21.post1 (#20087) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>\
 2026-03-08 03:03:58 -07:00
Liangsheng Yin
36b557d2c9 Fix streaming session with paged KV cache (SWA/MLA) (#20070) 
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
 2026-03-08 03:00:32 -07:00
yuyu5333
230fb55899 [Performance] Decode Offload improves the long texts performance 100% through dynamic block offload. (#17216) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 17:16:53 +08:00
Yuan Luo
97a2a9be0f [VLM] Replace conv3d proj with linear for GLM4V (#20033) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-07 22:50:47 -08:00
Fan Lin
7fb282a96f [diffusion] fix: fix bug of copy_if (#20094) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-08 14:27:58 +08:00
xingsy97
7f9f85d4c8 [diffusion] feat: make QwenImageLayered resolution configurable (#20044) 2026-03-08 14:26:05 +08:00
Lancer
a73369c39f [diffusion] chore: ensure CFG Zero Star numerical stability for Helios model (#20091) 
Signed-off-by: Lancer <maruixiang6688@gmail.com>
 2026-03-08 14:25:14 +08:00
shuwenn
72f6dfcc31 fix: add ModelScope cache lookup and speculative path support (#20098) 2026-03-07 22:23:16 -08:00
Liangsheng Yin
d02c515ee8 Decouple scheduler log printing from metrics collection (#20107) 2026-03-07 22:09:10 -08:00
Liangsheng Yin
69ec15ad74 [CI] Re-enable streaming session tests with correctness and stress coverage (#20084) 2026-03-07 18:18:11 -08:00
Baizhou Zhang
d28f35240a [V32/GLM5] Change default setting of V32 nvfp4 on TP4 (#20086) 2026-03-07 15:13:25 -08:00
Alison Shao
0f62da6953 [CI] Show test partition assignments after checkout (#20085) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 13:50:49 -08:00
shuwenn
7bd3dd9270 fix: image URL in notebook to use raw.githubusercontent.com (#20100) 2026-03-07 13:28:20 -08:00
VDV1985
45bd30e29d [NPU] make torch_native lora backend a little bit faster (#17228) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Egor Filimonov <44640852+ssshinigami@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-03-07 20:14:46 +03:00
Ke Bao
5867c3fa80 Support HiCache for MambaRadixCache (#19663) 
Co-authored-by: hzh0425 <hzh0425@apache.org>
 2026-03-08 00:36:25 +08:00
Bingxu Chen
17721b00fd [AMD] Fix Tensor Memory Aliasing (#19928) 2026-03-07 08:06:10 -08:00
Yuan Luo
7da590d4d0 [Qwen3.5] Support Qwen3.5 Pipeline Parallelism (#19670) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-07 23:34:08 +08:00
YeChang Guo
13bdc7bf4a [Feature][NPU]: add runtime support for AutoRound quantized models (#16699) 
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-03-07 18:03:55 +03:00
Xiaoyu Zhang
fd79cd8d9c [Skills] Refine jit_kernel and sgl-kernel skills (#20095) 2026-03-07 22:54:01 +08:00
Артем Савкин
5297b02c88 [Diffusion] [NPU] Wan2.2-T2V-A14B-Diffusers modelslim quantization support (#17996) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-03-07 17:26:44 +03:00
xingsy97
f8d4eb7022 [Docs] Add docstrings to JIT kernel include headers (#19770) 2026-03-07 20:48:00 +08:00
Ratish P
ef6540b439 [diffusion]: add width/height passthrough for OpenAI image API (#19970) 2026-03-07 20:43:46 +08:00
David Wang
19c51fe2fa fix(rope): restore K writeback in fused rope + kv store kernel (#19636) 2026-03-07 20:41:35 +08:00
kk
f016738f4c fix syntax error: "&&" unexpected (#20093) 2026-03-07 02:06:21 -08:00
kk
bd108a5971 Add workaround for aiter triton gemm config issue (#20090) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-03-07 01:21:31 -08:00
Alison Shao
1aa6ab41de [Nightly] Replace MiniMax-M2 with MiniMax-M2.5 (#20083) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 01:15:34 -08:00
Fan Yin
43d6a32045 [sgl-kernel] rebase FlashMLA 0217 (#18902) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-07 00:30:52 -08:00
YC Tseng
c267bdb805 [AMD] Fix AMD CI - stage-b-small-1-gpu-amd (partition 7) (#20028) 2026-03-06 23:49:14 -08:00
Alison Shao
011806c419 [Nightly] Add Kimi K2.5 nightly test (base + Eagle3 MTP), replace Kimi K2 (#19802) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 23:44:04 -08:00
danielafrimi
f8bbf56de7 Refactor NemotronHConfig to canonical layers_block_type and add MTP block-type support (#19950) 
Signed-off-by: dafrimi <dafrimi@nvidia.com>
 2026-03-06 23:22:03 -08:00
Lancer
b91fb8393e [diffusion] fix: fix multi-prompt generation and support multiple prompts in cli (#19960) 
Signed-off-by: Lancer <maruixiang6688@gmail.com>
 2026-03-07 13:01:59 +08:00
Eitan Turok
31e93e4486 [diffusion] fix: fix TeaCache silently fails with --enable-teacache (#19964) 2026-03-07 13:00:11 +08:00
Alison Shao
c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 20:34:45 -08:00
Qiaolin Yu
925185f9ec Fix flashinfer backend with pcg (#20061) 2026-03-06 20:01:43 -08:00
Feng Su
8a411a9a2a [Tracing] Remove the deprecated tracing code from mini_lb (#19409) 2026-03-07 11:19:23 +08:00
Mohammad Miadh Angkad
f88acf8780 [JIT Kernel] Reland NVFP4 kernels to JIT (#20012) 2026-03-07 10:31:08 +08:00
Yilong Zhao
6ffc74efd7 [Metrics] Add overlap bubble timing, full KV usage gauge, and prefill cuda graph tracking (#19982) 2026-03-06 17:41:27 -08:00
Alison Shao
50bbdcf8e9 Relax flaky test thresholds for MLA DeepSeek V3 and AutoRound (#20068) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 17:26:28 -08:00
shubham singhal
a0d085c16d Adding correct path for module not found error while collecting test (#19778) 
Co-authored-by: sys-lpot-val <sys_lpot_val@intel.com>
 2026-03-06 16:26:16 -08:00
R0CKSTAR
e818f8219a Fix none-comparison (E711) warnings (#19745) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2026-03-06 16:15:21 -08:00