chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,614 Commits 1 Branch 0 Tags
223a4e485b6cd20e68af76d6432dc360f0748ed9
Commit Graph

476 Commits

Author SHA1 Message Date
Roopak Srivastava
223a4e485b [test] Fix bfloat16 tolerance in test_selective_state_update (#20345) 2026-03-15 21:02:01 -07:00
pansicheng
97b2a89334 [RadixTree][8/N Refactor]: unify lock interface (#20330) 2026-03-16 11:49:51 +08:00
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Javier Torres
afc71bae3a feat: Add 'none' reasoning effort to ChatCompletionRequest (#20556) 2026-03-15 20:25:48 -07:00
Mohammad Miadh Angkad
3879c466b4 [CI] Add Nemotron 3 Super 120B nightly 8-GPU tests (#20616) 2026-03-15 18:03:20 -07:00
Zhirui
35c249b4de [OpenAI] Log raw request payload for --log-requests (#20605) 2026-03-15 17:45:00 -07:00
Liangsheng Yin
d852f26cb6 Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643) 2026-03-15 17:17:23 -07:00
Liangsheng Yin
116aef8504 [Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642) 2026-03-15 14:48:43 -07:00
psaab
1145805e7d Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-15 14:29:10 -07:00
Ke Bao
c3483e8e97 [CI] Move existing unit tests into unit directory (#20631) 2026-03-15 23:25:18 +08:00
Ke Bao
e2be31824f [CI] Add ut coverage tool (#20628) 2026-03-15 21:13:45 +08:00
Ke Bao
0cff070828 [CI] Add READMEs for unit test directory structure (#20626) 2026-03-15 20:27:05 +08:00
hzh0425
7142a594f9 [CI]: Add CI For HiMambaRadixTree and qwen3.5 (#20540) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-03-15 20:16:12 +08:00
Shangming Cai
4f91b3069e Skip flaky test in CI for disaggregation decode offload (#20622) 2026-03-15 16:30:34 +08:00
Kit Fraser-Taliente
7c773ddb0a [Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376) 2026-03-15 00:07:05 -07:00
Liangsheng Yin
fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Mohammad Miadh Angkad
3e643967e6 [CI] Add Nemotron 3 Super 120B CI tests for BF16 and NVFP4 (#20575) 2026-03-14 12:30:27 -07:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Mohammad Miadh Angkad
75a7879fd4 [Model] Support Nemotron 3 Super NVFP4 (#20407) 2026-03-14 00:56:26 -07:00
SoluMilken
c95dc88f86 [CI] migrate ascend-gptq from test/srt to test/registered (#19628) 2026-03-14 00:28:57 -07:00
billishyahao
d764f414a1 [AMD] fix mori unittest (#20524) 2026-03-13 09:37:45 -07:00
Leon Gao
b1246c50f8 Fix chunked prefill and KV cache leaks for streaming sessions (#20476) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-13 02:36:55 -07:00
hzh0425
197f807134 [RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429) 2026-03-13 12:28:32 +08:00
Pai Liu
65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
jacky.cheng
1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
roikoren755
067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
billishyahao
91f701e5f1 [AMD][Mori] Add unittest for mori ep low latency and tbo (#20374) 2026-03-11 22:38:26 -07:00
Ke Bao
ae7c2397b9 Fix FA3 swa spec pg_size > 1 (#20369) 2026-03-12 11:42:01 +08:00
Yuan Luo
649d6f2bc8 [GDN] Change Attention State Layout from [N, HV, K, V] to [N, HV, V, K] (#20283) 2026-03-12 10:53:12 +08:00
Hubert Lu
67f02681c9 [AMD] Support speculative decoding v2 for aiter backend on ROCm/HIP (#17450) 
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-11 17:01:01 -07:00
doujiang24
88d2fc19b1 feature: support X-Data-Parallel-Rank header to specific dp-rank. (#19832) 
Signed-off-by: doujiang24 <doujiang24@gmail.com>
 2026-03-11 14:53:33 -07:00
Alison Shao
7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Артем Савкин
ed42af99a9 [NPU] [Quantization] w4a4 MoE layer support (#18924) 2026-03-11 16:52:35 +03:00
Liangsheng Yin
61cad15d28 [Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306) 2026-03-11 00:07:37 -07:00
Liangsheng Yin
50953aea8d [Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296) 2026-03-10 17:50:23 -07:00
Michael
7a1ca53805 [AMD] Fix JSON mode streaming test flake on AMD CI (#20293) 2026-03-10 17:24:11 -07:00
Michael
dc4380e33a [AMD] [DeepSeek-OCR-2 Day 0] Enable DeepSeek-OCR-2 on AMD GPUs and add nightly test (#19732) 2026-03-10 17:04:35 -07:00
Alison Shao
f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 15:40:52 -07:00
Qiaolin Yu
09a118fafe Support return_logprob for spec v2 (overlap safe) (#19801) 
Co-authored-by: Ratish1 <ratish1501@gmail.com>
Co-authored-by: Ratish1 <formula733@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-10 15:38:27 -07:00
Ziang Li
76ee4bb98c [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537) 2026-03-10 15:37:57 -07:00
Qiaolin Yu
a3d88a247b Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453) 2026-03-10 12:50:57 -07:00
Yuwei An
834795adb8 [CI] Refactor PCG related CI (#19994) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-03-10 14:49:25 +08:00
Baizhou Zhang
be63f982b7 [V32/GLM5] Control the threshold of applying dense attention with an environ (#20062) 2026-03-09 14:36:10 -07:00
Xinyuan Tong
4a757990a1 [VLM] Replace decord with torchcodec for video decoding (#20055) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: BakerBunker <17872844+BakerBunker@users.noreply.github.com>
 2026-03-09 19:23:49 +08:00
roikoren755
c76251f70c Return intermediate Mamba states (#19716) 2026-03-09 16:04:36 +08:00
Liangsheng Yin
7105bf3782 [Bug] Fix missing TTFT histogram for single-batch requests (#20122) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-08 15:18:51 -07:00
liubiyongge
cc73355a1f [Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 21:30:55 +08:00
Glen Liu
1eed219f47 add mixed chunk unit test and make small refactors (#18776) 2026-03-08 19:56:09 +08:00
Liangsheng Yin
36b557d2c9 Fix streaming session with paged KV cache (SWA/MLA) (#20070) 
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
 2026-03-08 03:00:32 -07:00
yuyu5333
230fb55899 [Performance] Decode Offload improves the long texts performance 100% through dynamic block offload. (#17216) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 17:16:53 +08:00