chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,577 Commits 1 Branch 0 Tags
5ab2cfe9a899d1d2dffae932fb0f6371014d0d71
Commit Graph

10577 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Xiaoyu Zhang
5ab2cfe9a8 [Diffusion] Clean upstream fa3 in hopper (#20576) 2026-03-14 23:41:23 +08:00
Yuan Luo
22e67876d6 [Omni] Optimize AudioEncoder for Qwen3_Omni_Thinker (#18185) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-14 23:00:17 +08:00
Ratish P
574aa2d723 [diffusion]: remove stale offload-manager cleanup in denoising stage (#20587) 2026-03-14 22:56:57 +08:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Mohammad Miadh Angkad
75a7879fd4 [Model] Support Nemotron 3 Super NVFP4 (#20407) 2026-03-14 00:56:26 -07:00
SoluMilken
c95dc88f86 [CI] migrate ascend-gptq from test/srt to test/registered (#19628) 2026-03-14 00:28:57 -07:00
Xiaoyu Zhang
f9e4221b71 [Diffusion] add mova and hunyuanvideo to perf skills (#20563) 2026-03-14 13:49:50 +08:00
Shangming Cai
99a3b25c9b [PP] Fix recv tensor dict potential race condition (#20341) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-14 13:35:01 +08:00
Xinyuan Tong
c330b687a1 [Bugfix] Fix GLM-4.6V vision regression in glm4v_moe and glm_ocr (#20463) 2026-03-13 21:48:28 -07:00
ziruiliu
dfd0a77a9a [bugfix] Add prev_prefix_len parameter to HiMambaRadixCache's _insert_helper() (#20539) 2026-03-14 09:54:14 +08:00
Qiaolin Yu
4659b08fcf update CI_PERMISSIONS.json (#20551) 2026-03-13 14:52:06 -07:00
Duyi-Wang
0eea80bc00 [AMD][MORI] Fix MTP crash with FP4/FP8 dispatch and add NEXTN dispatch env vars. (#20453) 2026-03-13 14:03:17 -07:00
YC Tseng
c37ef7f18b [AMD] diffusion refactor: move ROCM VAE optimization to Platform abstraction (#20496) 2026-03-13 13:10:05 -07:00
billishyahao
d764f414a1 [AMD] fix mori unittest (#20524) 2026-03-13 09:37:45 -07:00
Simo Lin
a16f03c1e3 Revert "feat: add banner to sgl-model-gateway (#20471)" (#20536) 2026-03-13 09:20:32 -07:00
Simo Lin
654fc02cf1 [gRPC] Extract gRPC servicer into standalone package (#20478) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-03-13 09:13:29 -07:00
Xiaoyu Zhang
be7a0311a0 [Diffusion] Fix and validate diffusion skills benchmarking/profiling workflow (#20528) 2026-03-13 21:11:37 +08:00
Leon Gao
b1246c50f8 Fix chunked prefill and KV cache leaks for streaming sessions (#20476) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-13 02:36:55 -07:00
Ke Bao
287dc12b05 Fix hicache log metrics (#20504) 2026-03-13 16:29:58 +08:00
Baizhou Zhang
f8668d9e78 [Fix] Add fallback for flashinfer allreduce fusion (#20384) 2026-03-13 01:24:55 -07:00
Mick
b638b25b22 [diffusion] UX: suppress excessive logging from httpx and httpcore (#20452) 2026-03-13 14:43:09 +08:00
seungrokj
9c8777c80f [AMD][Qwen3.5] aiter a8w8 gemm configuration (#19826) 
Signed-off-by: seungrokj <seungrok.jung@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-12 23:23:58 -07:00
Chongchong Tian
70d4aabe42 Add CLI args to conveniently support tuning more models (#12922) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-12 23:10:55 -07:00
Antonin Vidon
63ecdcbb18 Expose async LoRA interface to Offline Engine (#18636) 2026-03-12 23:09:47 -07:00
StonyPort
d4e68ead1d [quant] Ignore FP8 quantization layers (#20340) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-13 13:59:39 +08:00
Xiaoyu Zhang
e00328d1e5 [Diffusion] Opt qwen-image-edit with fuse_residual_layernorm_scale_shift_gate_select01_kernel (#20395) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-13 13:15:22 +08:00
hzh0425
197f807134 [RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429) 2026-03-13 12:28:32 +08:00
Liangsheng Yin
f605612b87 [HTTP] Fix /GET HTTP route when ollama endpoint is not set. (#20494) 2026-03-12 20:54:32 -07:00
Mick
154af9e46c update CI_PERMISSIONS.json (#20405) 2026-03-12 19:50:35 -07:00
Yineng Zhang
3deaf61345 misc: update CODEOWNERS (#20488) 2026-03-12 19:36:17 -07:00
Xiaoyu Zhang
7ecf07b8f4 [jit_kernel] Temporarily Skip Flaky JIT Kernel GDN Test and Add PR Label (#20436) 2026-03-13 09:34:22 +08:00
Pai Liu
65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
LinyuanLi
9865f11421 [bugfix] fix bug when enable prefill delay and DP (#20134) 2026-03-13 08:51:09 +08:00
zzhpro
c21ddbc785 [Minor] fix type annotations and invalid method calls in constrained … (#20132) 2026-03-12 16:42:46 -07:00
YC Tseng
78a467c74a [AMD] [diffusion] feat: enable AITer GroupNorm for VAE decode on ROCm (#20170) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-12 16:38:19 -07:00
Kangyan-Zhou
f5a4a5429f Revert early HTTP port reservation (#17754, #19805) (#20468) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 16:17:33 -07:00
Qiaolin Yu
9c6f166600 tiny fix the usage of test_logprobs (#20473) 2026-03-12 15:37:45 -07:00
Simo Lin
b227e53ebf feat: add banner to sgl-model-gateway (#20471) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-03-12 14:25:27 -07:00
Ethan (Yusheng) Su
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
 2026-03-12 12:23:46 -07:00
Yuan Luo
e29305c120 [GDN] Add benchmark for sglang gdn prefill (#20428) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
 2026-03-12 22:25:02 +08:00
Yuhao Yang
a57a44739f [diffusion] deps: upgrade diffusers from 0.36.0 to 0.37.0 (#20318) 2026-03-12 19:17:28 +08:00
kk
318a40fdfb [Bug-fix] Fix gpu fault when run the test with dp-attention-enabled and max-concurrency is over 256 (#20399) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2026-03-12 02:32:03 -07:00
Ratish P
4e5ca92249 [diffusion]: clear file-path-only outputs on all ranks to prevent TP GPU memory skew (#20353) 2026-03-12 17:29:09 +08:00
Liangsheng Yin
5f1bfb0d28 [Security] Fix /rerun-ut bypassing run-ci gate for fork PRs (#20424) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-12 02:24:29 -07:00
jacky.cheng
1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
roikoren755
067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
0xNullPath
46b558445d Fix default_max_tokens compute error in responses api when mtp is opened (#18932) 2026-03-12 16:00:48 +08:00
Pai Liu
ac1310b300 Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403) 2026-03-12 00:23:46 -07:00
Pai Liu
2c03a5c6c7 Fix global server args not set error in test_triton_moe_wna16.py (#20412) 2026-03-12 00:22:59 -07:00
billishyahao
91f701e5f1 [AMD][Mori] Add unittest for mori ep low latency and tbo (#20374) 2026-03-11 22:38:26 -07:00