chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

703 Commits

Author SHA1 Message Date
Pai Liu
65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
jacky.cheng
1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
roikoren755
067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
billishyahao
91f701e5f1 [AMD][Mori] Add unittest for mori ep low latency and tbo (#20374) 2026-03-11 22:38:26 -07:00
Ke Bao
ae7c2397b9 Fix FA3 swa spec pg_size > 1 (#20369) 2026-03-12 11:42:01 +08:00
Yuan Luo
649d6f2bc8 [GDN] Change Attention State Layout from [N, HV, K, V] to [N, HV, V, K] (#20283) 2026-03-12 10:53:12 +08:00
Hubert Lu
67f02681c9 [AMD] Support speculative decoding v2 for aiter backend on ROCm/HIP (#17450) 
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-11 17:01:01 -07:00
doujiang24
88d2fc19b1 feature: support X-Data-Parallel-Rank header to specific dp-rank. (#19832) 
Signed-off-by: doujiang24 <doujiang24@gmail.com>
 2026-03-11 14:53:33 -07:00
Alison Shao
7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Артем Савкин
ed42af99a9 [NPU] [Quantization] w4a4 MoE layer support (#18924) 2026-03-11 16:52:35 +03:00
Liangsheng Yin
61cad15d28 [Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306) 2026-03-11 00:07:37 -07:00
Liangsheng Yin
50953aea8d [Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296) 2026-03-10 17:50:23 -07:00
Michael
7a1ca53805 [AMD] Fix JSON mode streaming test flake on AMD CI (#20293) 2026-03-10 17:24:11 -07:00
Michael
dc4380e33a [AMD] [DeepSeek-OCR-2 Day 0] Enable DeepSeek-OCR-2 on AMD GPUs and add nightly test (#19732) 2026-03-10 17:04:35 -07:00
Alison Shao
f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 15:40:52 -07:00
Qiaolin Yu
09a118fafe Support return_logprob for spec v2 (overlap safe) (#19801) 
Co-authored-by: Ratish1 <ratish1501@gmail.com>
Co-authored-by: Ratish1 <formula733@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-10 15:38:27 -07:00
Ziang Li
76ee4bb98c [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537) 2026-03-10 15:37:57 -07:00
Qiaolin Yu
a3d88a247b Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453) 2026-03-10 12:50:57 -07:00
Yuwei An
834795adb8 [CI] Refactor PCG related CI (#19994) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-03-10 14:49:25 +08:00
Baizhou Zhang
be63f982b7 [V32/GLM5] Control the threshold of applying dense attention with an environ (#20062) 2026-03-09 14:36:10 -07:00
Xinyuan Tong
4a757990a1 [VLM] Replace decord with torchcodec for video decoding (#20055) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: BakerBunker <17872844+BakerBunker@users.noreply.github.com>
 2026-03-09 19:23:49 +08:00
roikoren755
c76251f70c Return intermediate Mamba states (#19716) 2026-03-09 16:04:36 +08:00
Liangsheng Yin
7105bf3782 [Bug] Fix missing TTFT histogram for single-batch requests (#20122) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-03-08 15:18:51 -07:00
liubiyongge
cc73355a1f [Feature] Add SLRU eviction policy & fix RadixCache hit_count bug (#18843) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 21:30:55 +08:00
Glen Liu
1eed219f47 add mixed chunk unit test and make small refactors (#18776) 2026-03-08 19:56:09 +08:00
Liangsheng Yin
36b557d2c9 Fix streaming session with paged KV cache (SWA/MLA) (#20070) 
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
 2026-03-08 03:00:32 -07:00
yuyu5333
230fb55899 [Performance] Decode Offload improves the long texts performance 100% through dynamic block offload. (#17216) 
Co-authored-by: zhangheng <hzh0425@apache.org>
 2026-03-08 17:16:53 +08:00
Yuan Luo
97a2a9be0f [VLM] Replace conv3d proj with linear for GLM4V (#20033) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-07 22:50:47 -08:00
Liangsheng Yin
d02c515ee8 Decouple scheduler log printing from metrics collection (#20107) 2026-03-07 22:09:10 -08:00
Liangsheng Yin
69ec15ad74 [CI] Re-enable streaming session tests with correctness and stress coverage (#20084) 2026-03-07 18:18:11 -08:00
Yuan Luo
7da590d4d0 [Qwen3.5] Support Qwen3.5 Pipeline Parallelism (#19670) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-07 23:34:08 +08:00
Alison Shao
1aa6ab41de [Nightly] Replace MiniMax-M2 with MiniMax-M2.5 (#20083) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
 2026-03-07 01:15:34 -08:00
YC Tseng
c267bdb805 [AMD] Fix AMD CI - stage-b-small-1-gpu-amd (partition 7) (#20028) 2026-03-06 23:49:14 -08:00
Alison Shao
011806c419 [Nightly] Add Kimi K2.5 nightly test (base + Eagle3 MTP), replace Kimi K2 (#19802) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 23:44:04 -08:00
Alison Shao
c584158135 [CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 20:34:45 -08:00
Alison Shao
50bbdcf8e9 Relax flaky test thresholds for MLA DeepSeek V3 and AutoRound (#20068) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 17:26:28 -08:00
Alison Shao
ac453b253f Add Qwen3.5-397B-A17B nightly test (8-GPU) (#19906) 
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-06 13:49:28 -08:00
Mohammad Miadh Angkad
8cdb7e1fd4 [CI] Add GPT-OSS test for SM120 (#20056) 2026-03-06 11:43:04 -08:00
Baizhou Zhang
04e364d538 [V32] Enhance deepseek v32 related tests (#19985) 2026-03-05 20:12:49 -08:00
kpham-sgl
346a4131cf [Spec] Refactor NaN/OOB checks to async maybe_detect_* with env-var control (#19899) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-05 13:51:05 -08:00
sglang-bot
ebb66cc1de [misc] Priority scheduling metrics cleanup (#19927) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-05 12:42:42 -08:00
Michael
203cd8eb02 [AMD] [Z-Image-Turbo Day 0] Add Z-Image-Turbo nightly test for AMD GPUs (#19733) 2026-03-05 08:36:17 -08:00
YC Tseng
b5edab57f2 [AMD] CI - Add MI35x nightly/PR tests for kv-cache-fp8 and allreduce-fusion (DeepSeek) (#19834) 
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-03-05 07:09:57 -08:00
Tiwei Bie
727face6c2 [DLLM] Add initial radix cache support (#18724) 2026-03-04 23:24:09 -08:00
Baizhou Zhang
10c65df48a [Bug] Fix lora tp bug on H200 (#19769) 2026-03-04 20:11:02 -08:00
Bruce Changlong Xu
feda2b11c4 [AMD] Add AWQ AMD CI coverage and quantization platform compatibility docs (#19550) 2026-03-04 19:50:55 -08:00
Kangyan-Zhou
198381d9ce Add SSL/TLS support for HTTP and gRPC servers (#18973) 
Co-authored-by: guys@spotify.com
 2026-03-04 19:27:16 -08:00
Ethan (Yusheng) Su
e555a6c171 [feat] Enhance lora_update_weight_from_tensor for RL training (#19314) 2026-03-04 18:10:42 -08:00
Liangsheng Yin
861d78635f [CI] remove itl testing due to unstable networking (#19904) 2026-03-04 16:32:17 -08:00
zhuxinjie-nz
28c931e1a5 feat: Priority-based scheduling optimization (including default priority, preemption toggle, priority-based metrics, etc.) (#17026) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-04 14:52:08 -08:00