chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,758 Commits 1 Branch 0 Tags
2b53e660de89c142adab497c97edf4e98e1de621
Commit Graph

2054 Commits

Author SHA1 Message Date
Leon Gao
63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) 2026-03-19 15:37:27 -07:00
Brayden Zhong
b42b9f6e1a Support CuteDSL mm_fp4 backend (#18801) 2026-03-19 14:20:01 -07:00
AlfredYong
c562e0d13b [feat] Enhance Kimi-K2/K2.5 function call and reasoning detection (#19552) 
Co-authored-by: alfredyyang <alfredyyang@tencent.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-03-19 12:57:57 -07:00
billishyahao
2ee7f41e25 [AMD] add mori ep normal tbo unittest (#20941) 2026-03-19 11:52:25 -07:00
YC Yen-Ching Tseng
9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
Cao E
274581fb77 Add support for more batch sizes in cpu_graph_runner (#13881) 2026-03-19 09:50:56 -07:00
Shangming Cai
4c52b7fcc6 [CI] Improve PP consistency check success rate (#20838) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-03-19 19:12:50 +08:00
blzheng
cd22aa27a9 [CPU] Add FP8 Bmm support (#9744) 
Co-authored-by: Fan Yin <1106310035@qq.com>
 2026-03-18 22:19:48 -07:00
blzheng
c2b01bd2fc [CPU] fix bug in AVX512 implementation of flash_attn_softmax (#20220) 
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
 2026-03-18 22:18:47 -07:00
Zaili Wang
2f4babe32b [CPU] support LayerNorm with 3D shape (#15075) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-03-18 22:15:24 -07:00
blzheng
dc6aa26ce9 [CPU] Add mrope kernel for Qwen3-vl (#12531) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2026-03-18 22:12:48 -07:00
Juan Muneton
4052b53227 fix scheduler for non-cuda devices and disable piecewise cuda graph f… (#19992) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-03-18 21:54:19 -07:00
Ethan (Yusheng) Su
7f6f1a3ab1 [LoRA][II] Add fused MOE LoRA Triton kernel and tests (#19711) 2026-03-18 19:58:14 -07:00
Liangsheng Yin
8b9482e665 fix(dp-attn): consistent overlap disable decision across DP ranks (#20853) 2026-03-18 15:16:39 -07:00
Xinyuan Tong
d1e95af282 Upgrade transformers==5.3.0 (#17784) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Alison Shao <alisonshao@mac.lan>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-18 13:50:43 -07:00
Артем Савкин
6cca5b9b97 [NPU] [BUGFIX] Test ascend memory consumption.py fix (#17995) 2026-03-18 22:47:43 +03:00
Viacheslav
30a35ecd90 Add gigachat3.1 parser (#19886) 
Signed-off-by: Viacheslav Barinov <vvadbarinov@sberbank.ru>
Signed-off-by: Viacheslav Bv <viacheslav.teh@gmail.com>
Co-authored-by: Viacheslav Barinov <vvadbarinov@sberbank.ru>
 2026-03-17 22:45:01 -07:00
Kaixi Hou
4cc19862ef [NVIDIA] Integrate FlashInfer decode kernel (Blackwell) for Qwen3.5 (#19150) 
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-18 13:11:18 +08:00
Liangsheng Yin
4d3976b6c5 [HiCache] Check in-flight async ops in is_fully_idle() before attach/detach (#20746) 2026-03-17 17:28:26 -07:00
Yongfei Xu
17031120b8 [DeepSeek v3.2][Bugfix] get_index_k_scale_buffer support cp (#18280) 2026-03-17 09:54:54 -07:00
Ke Bao
7f99319c56 Add evict policy ut (#20787) 2026-03-17 22:06:14 +08:00
YC Yen-Ching Tseng
18dd5c972d [AMD] Fix AMD CI : stage-c-large-8-gpu-amd-mi35x (#20521) 
Co-authored-by: billisyahao <bill.he@amd.com>
 2026-03-16 23:53:33 -07:00
Jay Shaik
e4d06b3db2 Fix /generate JSON serialization for non-finite top_logprobs (#20714) 2026-03-16 20:07:12 -07:00
psaab
9f56b471aa [Network] Use NetworkAddress for dist_init_method and loopback fallbacks (#20657) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-16 19:59:49 -07:00
roikoren755
5ef5806160 [Nemotron] Small reasoning parser fix (#20284) 2026-03-16 13:29:40 -07:00
Bruce Wu
70a6fb53af Enable embedding lookup/lora_a logic for chunked backend (#17692) 
Co-authored-by: Bruce Wu <mogicianwu@fb.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
 2026-03-16 11:37:58 -07:00
Shangming Cai
a4528a5737 [CI] Bring back CI test for Mamba PD Disaggregation (#20675) 2026-03-17 01:04:21 +08:00
Sugar920
895e56097c Add NPU basic function testcases (#19382) 
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: Cherry_ming <136634645@qq.com>
 2026-03-16 15:09:56 +08:00
Zheng Wengang
135af6dc92 [EPD][VLM] support video/audio input (#17824) 
Co-authored-by: siyu <liusy58@linux.alibaba.com>
 2026-03-16 14:18:21 +08:00
Roopak Srivastava
223a4e485b [test] Fix bfloat16 tolerance in test_selective_state_update (#20345) 2026-03-15 21:02:01 -07:00
pansicheng
97b2a89334 [RadixTree][8/N Refactor]: unify lock interface (#20330) 2026-03-16 11:49:51 +08:00
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Javier Torres
afc71bae3a feat: Add 'none' reasoning effort to ChatCompletionRequest (#20556) 2026-03-15 20:25:48 -07:00
Mohammad Miadh Angkad
3879c466b4 [CI] Add Nemotron 3 Super 120B nightly 8-GPU tests (#20616) 2026-03-15 18:03:20 -07:00
Zhirui
35c249b4de [OpenAI] Log raw request payload for --log-requests (#20605) 2026-03-15 17:45:00 -07:00
Liangsheng Yin
d852f26cb6 Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643) 2026-03-15 17:17:23 -07:00
Liangsheng Yin
116aef8504 [Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642) 2026-03-15 14:48:43 -07:00
psaab
1145805e7d Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-15 14:29:10 -07:00
Ke Bao
c3483e8e97 [CI] Move existing unit tests into unit directory (#20631) 2026-03-15 23:25:18 +08:00
Ke Bao
e2be31824f [CI] Add ut coverage tool (#20628) 2026-03-15 21:13:45 +08:00
Ke Bao
0cff070828 [CI] Add READMEs for unit test directory structure (#20626) 2026-03-15 20:27:05 +08:00
hzh0425
7142a594f9 [CI]: Add CI For HiMambaRadixTree and qwen3.5 (#20540) 
Co-authored-by: ispobock <ispobaoke@gmail.com>
 2026-03-15 20:16:12 +08:00
Yuhao Yang
1c456a0af5 VLM: add Conv2dLayer/Conv3dLayer to fix PyTorch 2.9.1 CuDNN Conv3d (#20282) 
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
 2026-03-15 19:17:44 +08:00
Shangming Cai
4f91b3069e Skip flaky test in CI for disaggregation decode offload (#20622) 2026-03-15 16:30:34 +08:00
Kit Fraser-Taliente
7c773ddb0a [Fix] Slice input_embeds to extend_input_len in prepare_for_extend (#20376) 2026-03-15 00:07:05 -07:00
Juan Muneton
7458407437 Fix InternVL and vision attention for non-CUDA backends (e.g. XPU) (#19997) 
Co-authored-by: Yang Wang <mr.yang.wang@outlook.com>
 2026-03-14 23:24:41 -07:00
Liangsheng Yin
fc7f9c1de7 Rename --stream-output to --incremental-streaming-output (#20614) 2026-03-14 23:22:33 -07:00
Mohammad Miadh Angkad
3e643967e6 [CI] Add Nemotron 3 Super 120B CI tests for BF16 and NVFP4 (#20575) 2026-03-14 12:30:27 -07:00
Xiaoyu Zhang
25e38216b6 [kernel slimming] Clean many useless sgl-kernel deprecated kernels (#20277) 2026-03-14 16:45:54 +08:00
Mohammad Miadh Angkad
75a7879fd4 [Model] Support Nemotron 3 Super NVFP4 (#20407) 2026-03-14 00:56:26 -07:00