chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,553 Commits 1 Branch 0 Tags
d4e68ead1dc841cf5799c12de5cdce6f4e8eb2e7
Commit Graph

10553 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
StonyPort
d4e68ead1d [quant] Ignore FP8 quantization layers (#20340) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-03-13 13:59:39 +08:00
Xiaoyu Zhang
e00328d1e5 [Diffusion] Opt qwen-image-edit with fuse_residual_layernorm_scale_shift_gate_select01_kernel (#20395) 
Co-authored-by: Yihan Chen <yingluosanqian@gmail.com>
 2026-03-13 13:15:22 +08:00
hzh0425
197f807134 [RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429) 2026-03-13 12:28:32 +08:00
Liangsheng Yin
f605612b87 [HTTP] Fix /GET HTTP route when ollama endpoint is not set. (#20494) 2026-03-12 20:54:32 -07:00
Mick
154af9e46c update CI_PERMISSIONS.json (#20405) 2026-03-12 19:50:35 -07:00
Yineng Zhang
3deaf61345 misc: update CODEOWNERS (#20488) 2026-03-12 19:36:17 -07:00
Xiaoyu Zhang
7ecf07b8f4 [jit_kernel] Temporarily Skip Flaky JIT Kernel GDN Test and Add PR Label (#20436) 2026-03-13 09:34:22 +08:00
Pai Liu
65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
LinyuanLi
9865f11421 [bugfix] fix bug when enable prefill delay and DP (#20134) 2026-03-13 08:51:09 +08:00
zzhpro
c21ddbc785 [Minor] fix type annotations and invalid method calls in constrained … (#20132) 2026-03-12 16:42:46 -07:00
YC Tseng
78a467c74a [AMD] [diffusion] feat: enable AITer GroupNorm for VAE decode on ROCm (#20170) 
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-12 16:38:19 -07:00
Kangyan-Zhou
f5a4a5429f Revert early HTTP port reservation (#17754, #19805) (#20468) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 16:17:33 -07:00
Qiaolin Yu
9c6f166600 tiny fix the usage of test_logprobs (#20473) 2026-03-12 15:37:45 -07:00
Simo Lin
b227e53ebf feat: add banner to sgl-model-gateway (#20471) 
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
 2026-03-12 14:25:27 -07:00
Ethan (Yusheng) Su
af2807e146 [LoRA][I] Add MOE LoRA JIT alignment kernel and tests (#19710) 
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Jonah Bernard <96398205+Jonahcb@users.noreply.github.com>
 2026-03-12 12:23:46 -07:00
Yuan Luo
e29305c120 [GDN] Add benchmark for sglang gdn prefill (#20428) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
 2026-03-12 22:25:02 +08:00
Yuhao Yang
a57a44739f [diffusion] deps: upgrade diffusers from 0.36.0 to 0.37.0 (#20318) 2026-03-12 19:17:28 +08:00
kk
318a40fdfb [Bug-fix] Fix gpu fault when run the test with dp-attention-enabled and max-concurrency is over 256 (#20399) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2026-03-12 02:32:03 -07:00
Ratish P
4e5ca92249 [diffusion]: clear file-path-only outputs on all ranks to prevent TP GPU memory skew (#20353) 2026-03-12 17:29:09 +08:00
Liangsheng Yin
5f1bfb0d28 [Security] Fix /rerun-ut bypassing run-ci gate for fork PRs (#20424) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-12 02:24:29 -07:00
jacky.cheng
1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
roikoren755
067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
0xNullPath
46b558445d Fix default_max_tokens compute error in responses api when mtp is opened (#18932) 2026-03-12 16:00:48 +08:00
Pai Liu
ac1310b300 Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403) 2026-03-12 00:23:46 -07:00
Pai Liu
2c03a5c6c7 Fix global server args not set error in test_triton_moe_wna16.py (#20412) 2026-03-12 00:22:59 -07:00
billishyahao
91f701e5f1 [AMD][Mori] Add unittest for mori ep low latency and tbo (#20374) 2026-03-11 22:38:26 -07:00
Hexq0210
dd82678b2d [NPU] Support mamba cache transfer for NPU (#20364) 2026-03-12 12:49:21 +08:00
Mook
abc672e717 [Benchmark] use flashinfer bench_gpu_time instead of triton do_bench (#20305) 2026-03-12 04:04:30 +00:00
Ke Bao
ae7c2397b9 Fix FA3 swa spec pg_size > 1 (#20369) 2026-03-12 11:42:01 +08:00
Yuan Luo
649d6f2bc8 [GDN] Change Attention State Layout from [N, HV, K, V] to [N, HV, V, K] (#20283) 2026-03-12 10:53:12 +08:00
huangtingwei
8787cf4566 Fix the scope of io_backend in NSATokenToKVPoolHost (#20327) 2026-03-12 10:33:11 +08:00
Baizhou Zhang
7771fcd4b3 Update CodeOwners (#20329) 2026-03-11 19:11:09 -07:00
Vedant V Jhaveri
9b55a98a67 perf(qwen3_5): replace einops rearrange with torch.flatten in GatedDe… (#20386) 2026-03-12 09:51:27 +08:00
Vedant V Jhaveri
25bd83033d Enable Piecewise CUDA Graph for NemotronH Hybrid (Mamba+Attention) Models (#19903) 2026-03-12 09:16:38 +08:00
fy
677e446e51 [NPU] Convert cu_window_seqlens to CPU for npu_flush_attention_unpad operator (#20328) 2026-03-12 09:08:43 +08:00
Hubert Lu
67f02681c9 [AMD] Support speculative decoding v2 for aiter backend on ROCm/HIP (#17450) 
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-11 17:01:01 -07:00
shuwenn
acab24a76a fix: gracefully abort last request in retract_decode on OOM (#19881) 2026-03-11 15:13:03 -07:00
doujiang24
88d2fc19b1 feature: support X-Data-Parallel-Rank header to specific dp-rank. (#19832) 
Signed-off-by: doujiang24 <doujiang24@gmail.com>
 2026-03-11 14:53:33 -07:00
Shangming Cai
af4c28904d [PD] Fix the infinite loop in deocde resolve_pending_reqs (#20371) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-11 14:11:19 -07:00
Rain Jiang
ab4b863546 fix ci by removing nvidia-cutlass-dsl-libs-base and force reinstall n… (#20380) 2026-03-11 13:37:33 -07:00
Mook
2720ea2667 [Typo] Fix H200 doc links pointing to H20 section in deepseek_v3.md (#20383) 2026-03-11 13:35:20 -07:00
haNa-meister
252ef90fc2 [Generative Score API] Fix on prefill-only scheduler running batch loss track problem (#14320) 
Co-authored-by: Wenyan Yao <wenyao@linkedin.com>
Co-authored-by: Sundara Raman Ramachandran <sundar24295@gmail.com>
 2026-03-11 13:15:50 -07:00
satyamk7054
a54d71e967 [Benchmark] Add sglang-embedding backend to bench_serving (#20017) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2026-03-11 13:13:16 -07:00
Rain Jiang
61b228239e bump sgl-fa4 version to 4.0.5 to loose torch deps (#20378) 2026-03-11 13:08:09 -07:00
BingjiaWang
006bd44cf9 [deepseekv3.2] fix get_k_and_s_triton kenel for 128K seqlen case bug (#19319) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-03-11 12:56:33 -07:00
Kazami Michiru
e6a6cd1f0c [Fix] Reset output_ids for requests with input_embeds during retraction (#14110) 2026-03-11 12:42:21 -07:00
Alison Shao
7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Matt Van Horn
d093e70067 [Doc] Add DSA/NSA attention backend to support matrix (#20326) 
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-11 13:40:35 -04:00
R0CKSTAR
dae5c6cadf [diffusion] doc: add Moore Threads as a supported vendor (#20146) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-03-11 10:15:15 -07:00
Thomas
05e40922b3 [Doc] Fix wrong link and cmd description (#20365) 2026-03-11 11:30:45 -04:00