chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
8,254 Commits 1 Branch 0 Tags
acddb8e0ec191bba1bf78e99bc4eb5faf2d2c882
Commit Graph

1488 Commits

Author SHA1 Message Date
Muqi Li
01bd0d3e8b [Tool Call][DSV32] Streamline function call parameters (#14750) 
Signed-off-by: Muqi Li <muqi1029@gmail.com>
 2025-12-26 11:35:30 -08:00
Liangsheng Yin
f4e835af2f Cleanup ModelRunner (#15802) 2025-12-25 18:13:30 +08:00
Alison Shao
72a980c6d5 ci: migrate MLA tests to test/registered/mla/ (#15798) 2025-12-24 23:29:30 -08:00
satyamk7054
38dd4fbb66 Add overlap scheduling for embeddings code path (#14032) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2025-12-24 18:24:18 -08:00
Lianmin Zheng
ecd2d09a6c Fix code sync scripts (#15787) 2025-12-24 16:13:23 -08:00
Douglas Yang
17e65466de fix: nightly fix b200 gpqa (#15745) 2025-12-24 10:29:45 -08:00
fzyzcjy
8196998a03 Tiny add num retracted tokens metric (#15653) 2025-12-24 22:15:23 +08:00
fzyzcjy
fd4a558e71 Add metrics for having prefill and decode in different ranks (#15752) 2025-12-24 21:35:35 +08:00
fzyzcjy
e245cac0c5 Support JSON format request logging for easier parsing (#15743) 2025-12-24 19:52:43 +08:00
fzyzcjy
c6a6ba4368 Tiny refactor request logger (#15740) 2025-12-24 19:51:26 +08:00
Yuwei An
e254cdf326 [CI] Remove pcg-omni-ci (#15656) 2025-12-24 13:28:05 +08:00
Liangsheng Yin
6292c24437 Tiny fix test eagle infer b. (#15716) 2025-12-24 11:57:15 +08:00
Liangsheng Yin
5f5a567768 Tiny add flush in the suite partition status print. (#15719) 2025-12-24 11:55:59 +08:00
michael-amd
e7b09efc0a [AMD] Add AMD Nightly Performance & VLMs Accuracy Tests (#15500) 2025-12-23 19:03:27 -08:00
Qiaolin Yu
aef7ca7cf2 Raise the accept length bar in dpsk-r1-fp4 spec decoding tests (#15705) 2025-12-23 18:38:02 -08:00
Liangsheng Yin
0d0367e9d0 Tiny fix CI (#15696) 2025-12-24 01:51:08 +08:00
Liangsheng Yin
bd572360f3 Tiny apply gsm8k mixin to ngram test (#15606) 2025-12-24 01:30:26 +08:00
Yubo Wang
762846531f Fix Illegal Memory Access when fa3 + spec + topk + page_size > 1 (#15469) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-24 00:13:57 +08:00
fzyzcjy
6a5764a719 Super tiny add test_soft_watchdog to nightly (#15692) 2025-12-23 22:46:15 +08:00
shuwenn
758b9067a0 [CI] fix UT assert error in test_tokenizer_manager.py (#15646) 2025-12-23 22:24:33 +08:00
Douglas Yang
f9dd90ac35 fix: increasing H200 test timeout (#15600) 2025-12-23 01:00:37 -08:00
Alison Shao
ac42797cf7 [CI] Enable retry logic for flaky CI tests (#14983) 2025-12-22 22:23:42 -08:00
Alison Shao
883747ced1 [CI] Migrate Attention Backend tests to test/registered/attention/ (#15563) 2025-12-22 22:17:52 -08:00
Alison Shao
989d4b3012 [CI] Migrate nightly tests to test/registered/ (#15582) 2025-12-22 22:16:32 -08:00
SeanWeiSean
7759716786 bugfix[schedule]: Refactor sort method and add related UT (#13576) 
Co-authored-by: Yuxuan Wei <w1300012920@pku.edu.cn>
Co-authored-by: Yuxuan Wei <w1300012920@gmail.com>
Co-authored-by: Yuxuan Wei🚚 <yuxwei@microsoft.com>
 2025-12-23 03:13:57 +08:00
fzyzcjy
d5431ff894 Tiny add stuck simulation (#15613) 2025-12-22 17:00:18 +08:00
Qiaolin Yu
677930c276 Add glm-4.6-fp8 with/without mtp in nightly ci (#15566) 2025-12-21 22:27:02 -08:00
Liangsheng Yin
beae3f961c Adapt fixture-kit to gsm8k mixin (#15599) 2025-12-22 14:19:35 +08:00
Baizhou Zhang
468931b572 [Tiny]Move deepseek fp4 cutlass moe test to per-commit test (#15565) 2025-12-21 18:08:07 -08:00
Qiaolin Yu
a92de891b8 Split dpsk fp4 4 gpu tests and move the mtp part to real stage b (#15553) 2025-12-21 15:51:43 -08:00
Jincong Chen
350fbbf4dc fix ds3.2 nsa backend prefill TBO (#14901) 2025-12-21 13:16:46 -08:00
Junrong Lin
bed301a5ac [Feature] Enable return routed experts (#12162) 
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-21 15:16:43 +08:00
Ke Bao
8fe3e37468 Support piecewise cuda graph for dsv3 fp4 (#15531) 2025-12-21 14:50:32 +08:00
Douglas Yang
96740d6983 feature: revamp nightly tests with combined runner (#15324) 2025-12-20 19:25:22 -08:00
Alison Shao
9a3bdf2c95 [CI] Migrate CUDA Graph tests to test/registered/cuda_graph/ (#15436) 2025-12-20 18:55:39 -08:00
Yuan Luo
019517a356 [VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-20 21:00:07 +08:00
mlmz
1f1f05a85e vlm: refactor engine vlm params and support processor output as input (#14091) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: BenYao21 <cyao22@asu.edu>
Co-authored-by: minleminzui <minleminzui@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2025-12-20 18:31:24 +08:00
Yuxuan Zhang
b82c7a0ae7 [GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333) 2025-12-19 20:30:44 -08:00
michael-amd
2ee6c810b8 [AMD] Add TP=8 models to nightly test and make TP=2 test stable (#15296) 2025-12-19 13:15:19 -08:00
Yuwei An
9d0347b33a EP Support for Piecewise Cuda Graph (#14164) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2025-12-20 01:59:27 +08:00
yctseng0211
af780c59f3 [AMD] add unit-test-backend-8-gpu-amd back (#15253) 
Co-authored-by: Sai Enduri <saimanas.enduri@amd.com>
 2025-12-19 00:59:28 -08:00
Yingchun Lai
160a06cab2 [Feature] Xiaomi MiMo-V2-Flash day0 support (#15207) 
Co-authored-by: 谢学扬 <xiexueyang@xiaomi.com>
Co-authored-by: tz <tangzhen3@xiaomi.com>
Co-authored-by: 李家乐 <lijiale10@xiaomi.com>
Co-authored-by: 张晨 <zhangchen50@xiaomi.com>
Co-authored-by: Shaohui Liu <liushaohui3@xiaomi.com>
Co-authored-by: 王晨 <wangchen77@xiaomi.com>
Co-authored-by: jiangzihan <jiangzihan@xiaomi.com>
Co-authored-by: xiexueyang <xyxie_wangyi@163.com>
Co-authored-by: Linghao Zhang <zhanglinghao@xiaomi.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: JoyFuture <35593546+JoyFuture@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: root <root@bj9-ml-g8h20e-k8s-slave106-20251106.alicn.idc.xiaomi.com>
 2025-12-19 11:40:07 +08:00
Zehuan Li
f6c9db4bc4 [DLLM] Fix dLLM regression (#15371) 2025-12-19 10:55:46 +08:00
Zehuan Li
b2803ff207 [DLLM] Add CI for diffusion LLMs (#14723) 2025-12-19 08:54:03 +08:00
sunxxuns
e0963a6cb1 [AMD] Clear pre-built AITER kernels and warmup to prevent segfaults and test timeouts (#15318) 2025-12-18 14:00:09 -08:00
Shangming Cai
17e81c750a [PP] Add dynamic chunking PP test (#15395) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-12-19 01:09:40 +08:00
Lianmin Zheng
d1f0063262 Clean up __init__ function of the scheduler and event loop for PD (#15298) 2025-12-18 01:35:14 -08:00
Alison Shao
58c840db6b Split test_piecewise_cuda_graph.py to optimize CI resource usage (#15290) 2025-12-17 21:20:21 -08:00
Douglas Yang
9e7656be80 fix: adjust time for test_epd_disaggregation.py (#15354) 2025-12-17 18:30:52 -08:00
Xinyuan Tong
41683536d3 feat: DeepSeek-V3.2 Streaming tool call output (#15278) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: momaek <momaek17@gmail.com>
Co-authored-by: Muqi Li <muqi1029@gmail.com>
 2025-12-17 17:43:58 -08:00