chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
8,535 Commits 1 Branch 0 Tags
f84487af591ba514b726a2daf72e438a41f417c0
Commit Graph

1543 Commits

Author SHA1 Message Date
fzyzcjy
c63e9cb29e Super tiny fix CI (#16437) 2026-01-04 20:34:49 -08:00
Alison Shao
f8411ded6e ci: migrate 1-GPU model tests to test/registered/models/ (#16414) 2026-01-04 18:08:01 -08:00
fzyzcjy
12df16607b Tiny speed up kimi detokenizer by 10x (#16427) 2026-01-05 09:12:05 +08:00
Douglas Yang
55d112dc79 fix: enable multi-threading for h200 tests (#16413) 2026-01-04 14:43:53 -08:00
Alison Shao
52c604342c chore: print test list at beginning and end of run_suite.py (#16334) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-04 11:52:52 -08:00
Alison Shao
ff0f370f85 ci: migrate MoE tests to test/registered/moe/ (#16127) 2026-01-04 11:51:12 -08:00
Alison Shao
26f9e20755 ci: migrate quantization kernel tests to test/registered/quant/ (#16323) 2026-01-04 11:49:29 -08:00
Ke Bao
76bc07a335 Move swa memory pool to a seperate file (#16347) 2026-01-04 22:39:30 +08:00
fzyzcjy
d7aa0ce72f Support multiple engines for router simulation in schedule simulator (#16368) 2026-01-04 11:46:05 +08:00
fzyzcjy
e797f0c570 Support offline generation scenario for prefill delayer (#16363) 2026-01-04 11:05:10 +08:00
fzyzcjy
5d4b7c78bf Fix memory leak in prefill delayer (#16358) 2026-01-04 10:11:18 +08:00
fzyzcjy
24e116ef6a Enhance schedule simulator and add several e2e scenarios (#16357) 2026-01-04 10:02:38 +08:00
fzyzcjy
8ca9597057 Tiny support sticky routing algorithm in schedule simulator (#16355) 2026-01-04 08:36:52 +08:00
fzyzcjy
ef5ac6f01e Support shared prefix (gsp) in schedule simulator (#16353) 2026-01-04 08:03:16 +08:00
fzyzcjy
e139d2aa76 Super tiny fix CI (#16351) 2026-01-04 07:24:46 +08:00
fzyzcjy
2337b1bbb0 Refactor and fix prefill delayer (scheduler enhancer) (#16269) 2026-01-04 07:15:06 +08:00
fzyzcjy
87ef05e2e1 Support simple schedule simulator (#16344) 2026-01-03 22:05:40 +08:00
fzyzcjy
c7c0d97fc6 Tiny support whitelisted headers in request logging (#16342) 2026-01-03 20:10:58 +08:00
fzyzcjy
7f2fa2167b Tiny add --log-requests-target (#16338) 2026-01-03 17:28:27 +08:00
sunxxuns
8b869e326c [AMD] feat: add DLLM support for AMD GPUs with LLaDA2 testing (#15560) 2026-01-03 10:41:11 +08:00
Ke Bao
7c1b4b1c4c Support swa allocator page size > 1 (#16296) 2026-01-03 08:49:47 +08:00
Baizhou Zhang
f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Yongfei Xu
0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
fzyzcjy
749736ba95 Tiny fix single-gpu dumper and add tests for dumper (#16285) 2026-01-02 13:30:09 +08:00
Hudson Xing
d7a8257ba5 docs: remove outdated TODO in GLM-4.7 MoE detector test (#16265) 2026-01-01 10:25:23 -08:00
1874.
e0e5084802 Fix parse args from file(#13911) (#14085) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-01-01 11:37:33 +08:00
Yineng Zhang
417e75a60f fix: use 2-gpu-runner for pp 2 NemotronH ut (#16239) 2025-12-31 14:51:33 -08:00
Huaixin Chang
c1dfbc777b deprecate prefill-round-robin-balance (#16195) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-31 22:25:33 +08:00
Even Zhou
3b3c5a05c1 [CI/NPU] fix multiple NPU CI issue (#16111) 2025-12-31 21:14:04 +08:00
Ethan (Yusheng) Su
5ed384d07b [CI/CD] re-enable lora test (#16187) 2025-12-31 16:32:20 +08:00
Bingxu Chen
1c360bf753 [AMD CI] add testcases to unit-test-backend-1-gpu (#16117) 2025-12-30 23:08:45 -08:00
roikoren755
47a660d5b9 [NemotronH] PP support (#16172) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2025-12-31 11:16:15 +08:00
Leoyzen
bc8b526eda Fix: Handle empty func_name and None values in GLM MoE detectors (#15754) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-12-30 14:32:35 -08:00
Liangsheng Yin
ba67e006a7 Refactor speculative algorithm registry. (#16168) 2025-12-31 01:24:22 +08:00
Baizhou Zhang
f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) 2025-12-31 00:09:24 +08:00
Mufeez Amjad
cbff7ad985 dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110) 2025-12-30 22:33:06 +08:00
Gaoji Liu
7518dc3532 feat(SpecEagleV2): add standalone_worker_v2 (#12625) 
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
 2025-12-30 17:55:04 +08:00
Qiaolin Yu
6a3e709253 Tiny rename test_deepseek_v3_fp4_mtp_stage_b.py (#16141) 2025-12-30 15:55:07 +08:00
Vitaly Tuzov
1048803c1f Reworked fast_pos_embed_interpolate() using torch (#10959) 2025-12-30 14:45:34 +08:00
Bingxu Chen
5e20e7a60d [AMD CI] Organize AMD nightly perf test files (#16114) 2025-12-29 22:09:46 -08:00
Cheng Wan
60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) 2025-12-30 12:38:33 +08:00
Vladimir Serov
9e263c2162 [LoRA] Torch native backend: rework implementation and updated tests (#15187) 2025-12-30 11:48:51 +08:00
Alison Shao
f4ec6f8e17 ci: migrate remaining spec/eagle tests to test/registered/spec/ (#15800) 2025-12-29 14:00:00 -08:00
Cheng Wan
6f9d0a89a0 [scheduler] fix: correcting extend_logprob_start_len calculation (#15922) 2025-12-28 14:57:04 -08:00
lif
5969be2f06 Apply fixture-kit mode to MMMUVLMMixin (#15615) 2025-12-28 17:22:05 +08:00
Cheng Wan
c457aad54a Update test parameters for deepep_large test (#16001) 2025-12-28 00:58:19 -08:00
Liangsheng Yin
c7e7bfa32c Add EAGLE3 test with MMLU dataset. (#15945) 2025-12-28 16:07:58 +08:00
Liangsheng Yin
bf90ea9c5b Unify spec v2's naming manner. (#15990) 2025-12-28 14:14:52 +08:00
Alison Shao
0e536600e8 Refactor: separate CI-specific weight validation into dedicated module (#15216) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2025-12-27 20:50:39 -08:00
Hudson Xing
474a4699c5 Add correctness validation for decode_attention test (#15806) 2025-12-28 11:46:17 +08:00