chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
10,659 Commits 1 Branch 0 Tags
cfead25bbf695b577fcb8ef6d5cb4ab63e2901f6
Commit Graph

2033 Commits

Author SHA1 Message Date
YC Yen-Ching Tseng
18dd5c972d [AMD] Fix AMD CI : stage-c-large-8-gpu-amd-mi35x (#20521) 
Co-authored-by: billisyahao <bill.he@amd.com>
 2026-03-16 23:53:33 -07:00
Jay Shaik
e4d06b3db2 Fix /generate JSON serialization for non-finite top_logprobs (#20714) 2026-03-16 20:07:12 -07:00
psaab
9f56b471aa [Network] Use NetworkAddress for dist_init_method and loopback fallbacks (#20657) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-16 19:59:49 -07:00
roikoren755
5ef5806160 [Nemotron] Small reasoning parser fix (#20284) 2026-03-16 13:29:40 -07:00
Bruce Wu
70a6fb53af Enable embedding lookup/lora_a logic for chunked backend (#17692) 
Co-authored-by: Bruce Wu <mogicianwu@fb.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
 2026-03-16 11:37:58 -07:00
Shangming Cai
a4528a5737 [CI] Bring back CI test for Mamba PD Disaggregation (#20675) 2026-03-17 01:04:21 +08:00
Sugar920
895e56097c Add NPU basic function testcases (#19382) 
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: Cherry_ming <136634645@qq.com>
 2026-03-16 15:09:56 +08:00
Zheng Wengang
135af6dc92 [EPD][VLM] support video/audio input (#17824) 
Co-authored-by: siyu <liusy58@linux.alibaba.com>
 2026-03-16 14:18:21 +08:00
Roopak Srivastava
223a4e485b [test] Fix bfloat16 tolerance in test_selective_state_update (#20345) 2026-03-15 21:02:01 -07:00
pansicheng
97b2a89334 [RadixTree][8/N Refactor]: unify lock interface (#20330) 2026-03-16 11:49:51 +08:00
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Javier Torres
afc71bae3a feat: Add 'none' reasoning effort to ChatCompletionRequest (#20556) 2026-03-15 20:25:48 -07:00
Mohammad Miadh Angkad
3879c466b4 [CI] Add Nemotron 3 Super 120B nightly 8-GPU tests (#20616) 2026-03-15 18:03:20 -07:00
Zhirui
35c249b4de [OpenAI] Log raw request payload for --log-requests (#20605) 2026-03-15 17:45:00 -07:00
Liangsheng Yin
d852f26cb6 Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643) 2026-03-15 17:17:23 -07:00
Liangsheng Yin
116aef8504 [Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642) 2026-03-15 14:48:43 -07:00
psaab
1145805e7d Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-15 14:29:10 -07:00
Ke Bao
c3483e8e97 [CI] Move existing unit tests into unit directory (#20631) 2026-03-15 23:25:18 +08:00
Ke Bao
e2be31824f [CI] Add ut coverage tool (#20628) 2026-03-15 21:13:45 +08:00
Ke Bao
0cff070828 [CI] Add READMEs for unit test directory structure (#20626) 2026-03-15 20:27:05 +08:00
hzh0425
7142a594f9 [CI]: Add CI For HiMambaRadixTree and qwen3.5 (#20540) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-03-15 20:16:12 +08:00
Yuhao Yang
1c456a0af5 VLM: add Conv2dLayer/Conv3dLayer to fix PyTorch 2.9.1 CuDNN Conv3d (#20282) 
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
 2026-03-15 19:17:44 +08:00
Shangming Cai
4f91b3069e Skip flaky test in CI for disaggregation decode offload (#20622) 2026-03-15 16:30:34 +08:00
Kit Fraser-Taliente
7c773ddb0a [Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376) 2026-03-15 00:07:05 -07:00
Juan Muneton
7458407437 Fix InternVL and vision attention for non-CUDA backends (e.g. XPU) (#19997) 
Co-authored-by: Yang Wang <mr.yang.wang@outlook.com>
 2026-03-14 23:24:41 -07:00
Liangsheng Yin
fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Mohammad Miadh Angkad
3e643967e6 [CI] Add Nemotron 3 Super 120B CI tests for BF16 and NVFP4 (#20575) 2026-03-14 12:30:27 -07:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Mohammad Miadh Angkad
75a7879fd4 [Model] Support Nemotron 3 Super NVFP4 (#20407) 2026-03-14 00:56:26 -07:00
SoluMilken
c95dc88f86 [CI] migrate ascend-gptq from test/srt to test/registered (#19628) 2026-03-14 00:28:57 -07:00
billishyahao
d764f414a1 [AMD] fix mori unittest (#20524) 2026-03-13 09:37:45 -07:00
Leon Gao
b1246c50f8 Fix chunked prefill and KV cache leaks for streaming sessions (#20476) 
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-13 02:36:55 -07:00
hzh0425
197f807134 [RadixTree][7/N Refactor]: Refactor mamba radix tree, release dup kvcache in insert func (#19429) 2026-03-13 12:28:32 +08:00
Pai Liu
65dd08153d Fix Test* mixin classes being collected as standalone pytest tests (#20417) 2026-03-12 18:18:45 -07:00
Qiaolin Yu
9c6f166600 tiny fix the usage of test_logprobs (#20473) 2026-03-12 15:37:45 -07:00
jacky.cheng
1e2983c98e [AMD] Fix FP8 assertion failure in aiter MLA decode by falling back to self.k_scale (#19935) 2026-03-12 01:48:51 -07:00
roikoren755
067353f67b [Test] Refactor KL divergence and prefix cache branching to kits (#19715) 2026-03-12 16:11:59 +08:00
Pai Liu
ac1310b300 Fix wrong BaseKVCacheMethod import in test_modelopt_fp8kvcache.py (#20403) 2026-03-12 00:23:46 -07:00
Pai Liu
2c03a5c6c7 Fix global server args not set error in test_triton_moe_wna16.py (#20412) 2026-03-12 00:22:59 -07:00
billishyahao
91f701e5f1 [AMD][Mori] Add unittest for mori ep low latency and tbo (#20374) 2026-03-11 22:38:26 -07:00
Ke Bao
ae7c2397b9 Fix FA3 swa spec pg_size > 1 (#20369) 2026-03-12 11:42:01 +08:00
Yuan Luo
649d6f2bc8 [GDN] Change Attention State Layout from [N, HV, K, V] to [N, HV, V, K] (#20283) 2026-03-12 10:53:12 +08:00
Hubert Lu
67f02681c9 [AMD] Support speculative decoding v2 for aiter backend on ROCm/HIP (#17450) 
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-03-11 17:01:01 -07:00
doujiang24
88d2fc19b1 feature: support X-Data-Parallel-Rank header to specific dp-rank. (#19832) 
Signed-off-by: doujiang24 <doujiang24@gmail.com>
 2026-03-11 14:53:33 -07:00
BingjiaWang
006bd44cf9 [deepseekv3.2] fix get_k_and_s_triton kenel for 128K seqlen case bug (#19319) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-03-11 12:56:33 -07:00
Alison Shao
7b44bc923e Relax flaky B200 GSM8K accuracy thresholds (#20304) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-11 12:35:21 -07:00
Артем Савкин
ed42af99a9 [NPU] [Quantization] w4a4 MoE layer support (#18924) 2026-03-11 16:52:35 +03:00
Yoray Zack
9991debde3 [Feature] Integrate Elastic NIXL-EP into SGLang (#19248) 
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
 2026-03-11 17:37:43 +08:00
Liangsheng Yin
61cad15d28 [Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306) 2026-03-11 00:07:37 -07:00
Liangsheng Yin
50953aea8d [Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296) 2026-03-10 17:50:23 -07:00