chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
8,086 Commits 1 Branch 0 Tags
8fe3e3746832f4a449f22da00a780d77ddb32d64
Commit Graph

1456 Commits

Author SHA1 Message Date
Ke Bao
8fe3e37468 Support piecewise cuda graph for dsv3 fp4 (#15531) 2025-12-21 14:50:32 +08:00
Douglas Yang
96740d6983 feature: revamp nightly tests with combined runner (#15324) 2025-12-20 19:25:22 -08:00
Alison Shao
9a3bdf2c95 [CI] Migrate CUDA Graph tests to test/registered/cuda_graph/ (#15436) 2025-12-20 18:55:39 -08:00
Yuan Luo
019517a356 [VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-20 21:00:07 +08:00
mlmz
1f1f05a85e vlm: refactor engine vlm params and support processor output as input (#14091) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: BenYao21 <cyao22@asu.edu>
Co-authored-by: minleminzui <minleminzui@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2025-12-20 18:31:24 +08:00
Yuxuan Zhang
b82c7a0ae7 [GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333) 2025-12-19 20:30:44 -08:00
michael-amd
2ee6c810b8 [AMD] Add TP=8 models to nightly test and make TP=2 test stable (#15296) 2025-12-19 13:15:19 -08:00
Yuwei An
9d0347b33a EP Support for Piecewise Cuda Graph (#14164) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-12-20 01:59:27 +08:00
yctseng0211
af780c59f3 [AMD] add unit-test-backend-8-gpu-amd back (#15253) 
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
 2025-12-19 00:59:28 -08:00
Yingchun Lai
160a06cab2 [Feature] Xiaomi MiMo-V2-Flash day0 support (#15207) 
Co-authored-by: 谢学扬 <xiexueyang@xiaomi.com>
Co-authored-by: tz <tangzhen3@xiaomi.com>
Co-authored-by: 李家乐 <lijiale10@xiaomi.com>
Co-authored-by: 张晨 <zhangchen50@xiaomi.com>
Co-authored-by: Shaohui Liu <liushaohui3@xiaomi.com>
Co-authored-by: 王晨 <wangchen77@xiaomi.com>
Co-authored-by: jiangzihan <jiangzihan@xiaomi.com>
Co-authored-by: xiexueyang <xyxie_wangyi@163.com>
Co-authored-by: Linghao Zhang <zhanglinghao@xiaomi.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: JoyFuture <35593546+JoyFuture@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: root <root@bj9-ml-g8h20e-k8s-slave106-20251106.alicn.idc.xiaomi.com>
 2025-12-19 11:40:07 +08:00
Zehuan Li
f6c9db4bc4 [DLLM] Fix dLLM regression (#15371) 2025-12-19 10:55:46 +08:00
Zehuan Li
b2803ff207 [DLLM] Add CI for diffusion LLMs (#14723) 2025-12-19 08:54:03 +08:00
sunxxuns
e0963a6cb1 [AMD] Clear pre-built AITER kernels and warmup to prevent segfaults and test timeouts (#15318) 2025-12-18 14:00:09 -08:00
Shangming Cai
17e81c750a [PP] Add dynamic chunking PP test (#15395) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-12-19 01:09:40 +08:00
Lianmin Zheng
d1f0063262 Clean up __init__ function of the scheduler and event loop for PD (#15298) 2025-12-18 01:35:14 -08:00
Alison Shao
58c840db6b Split test_piecewise_cuda_graph.py to optimize CI resource usage (#15290) 2025-12-17 21:20:21 -08:00
Douglas Yang
9e7656be80 fix: adjust time for test_epd_disaggregation.py (#15354) 2025-12-17 18:30:52 -08:00
Xinyuan Tong
41683536d3 feat: DeepSeek-V3.2 Streaming tool call output (#15278) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: momaek <momaek17@gmail.com>
Co-authored-by: Muqi Li <muqi1029@gmail.com>
 2025-12-17 17:43:58 -08:00
Alison Shao
4128d4f5cb [CI] Migrate LoRA tests to test/registered/lora/ (#15176) 2025-12-17 13:19:42 -08:00
Kangyan-Zhou
011d8d8970 Reserve more memory for DeepSeekOCR model and adjust server start timeout for DeepGEMM to reduce flakiness (#15277) 2025-12-17 13:13:05 -08:00
Baizhou Zhang
8451e22758 [DeepSeek-V32]Update nightly performance benchmark (#15308) 2025-12-17 11:25:31 -08:00
Liangsheng Yin
0c00220795 tiny unify environ usage (#15335) 2025-12-17 23:31:43 +08:00
b8zhong
ffa7e03506 [Piecewise CUDA Graph] Support INT8 (#14918) 2025-12-17 18:20:57 +08:00
Xuchun Shang
45a959d3e9 [PP] Add pp support for Qwen3-VL (#12333) 
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Kun(llfl) <llfl@linux.alibaba.com>
Co-authored-by: kun-llfl <i@imux.top>
Co-authored-by: Kun(llfl) <llfl@linux.alibaba.com>
 2025-12-17 16:03:58 +08:00
elvischenv
435d1c83c1 [Perf] Enable Flashinfer autotune by default (#14357) 2025-12-16 23:01:39 -08:00
Ashton Chew
2bdbaef18e [DeepSeekV3.2] Add pure TP+MTP test (#15088) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-12-16 21:48:12 -08:00
Alison Shao
7ec678eb09 [Test] Update LoRA eviction policy tests to match current behavior (#15283) 2025-12-16 17:55:15 -08:00
Douglas Yang
46ad4b986d fix: moving decorator to header (#15297) 2025-12-16 17:05:45 -08:00
Douglas Yang
da58df6b3d fix: skipping TestEPDDisaggregationOneEncoder test (#15292) 2025-12-16 16:31:20 -08:00
Alison Shao
49237e26fb Fix test_pp_single_node.py estimated time from 800s to 500s (#15291) 2025-12-16 16:27:09 -08:00
amysaq2023
ccc8f3b266 support non disturbing remote instance weight loader v2 (#14997) 
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
 2025-12-16 14:39:56 -08:00
Shangming Cai
6682475124 [CI] Improve flaky 4 GPU test success rate (#15234) 2025-12-17 00:02:26 +08:00
Liangsheng Yin
ecb401ed42 Enhance runtime memory check in CI (#15192) 2025-12-16 21:40:38 +08:00
Ke Bao
b399e3ac4f Support piecewise cuda graph for fused marlin moe (#15100) 2025-12-16 20:05:32 +08:00
blzheng
e27635a02d [CPU] Add 4D input support for ROPE in sgl-kernel (#9337) 2025-12-16 17:27:39 +08:00
Kangyan-Zhou
272c5fe43e Increase timeout for TestDeepseekV3MTP for potential DeepGEMM cold start (#15239) 2025-12-16 00:26:10 -08:00
Shangming Cai
36fcf71fff [Qwen3-next] Add PD disaggregation support for mamba with extra_buffer (#15180) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
 2025-12-16 14:36:00 +08:00
Baizhou Zhang
c843419562 Remove duplicate bs=1 in nightly benchmark (#15162) 2025-12-15 22:09:22 -08:00
XDaoHong
4733fcff1f [Feature] npu support enable_torch_compile for torchair backend (#13410) 
Co-authored-by: ZhengdQin <zhengdqin@gmail.com>
 2025-12-16 09:23:51 +08:00
blzheng
d16ff357db [CPU] Add Gemma3RMSNorm kernel in sgl-kernel and add ut (#9324) 2025-12-15 00:24:02 -08:00
Lianmin Zheng
702426b06a Fix import warnings (#15144) 2025-12-14 21:25:18 -08:00
Douglas Yang
9e9a61691e ci: adding errors to Github summary (#14778) 2025-12-14 21:08:16 -08:00
Hanming Lu
e61dabf5e4 [Qwen3-next] support mamba radix cache for overlap scheduler (#14792) 2025-12-14 18:54:16 -08:00
Hudson Xing
99cb2ed988 [refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044) 2025-12-14 15:22:37 -08:00
Ziming Huang
997ea57eaf Fix tensor mismatch error in sepc + topk > 1 + page_size > 1 (#14874) 2025-12-15 01:10:58 +08:00
Shangming Cai
d277a86dea [CI] Add disaggregation decode PP test (#15114) 2025-12-14 23:54:25 +08:00
Tianyu Guo
9acb21ae27 feat: support EPD disaggregation (#12263) 
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
 2025-12-14 22:30:08 +08:00
zyl_keep_moving
a9ce1623cd [kernel][moe] add moe topk fast (#13969) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2025-12-14 22:26:40 +08:00
Qiaolin Yu
729529190d [ci] Move dpsk-r1-fp4 b200 test to stage b (#15084) 2025-12-13 23:14:08 -08:00
Baizhou Zhang
ab3ffd1c8e Add nightly accuracy test for DeepSeek V3.2 (#14935) 2025-12-13 12:11:16 -08:00