chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
8,535 Commits 1 Branch 0 Tags
f84487af591ba514b726a2daf72e438a41f417c0
Commit Graph

1414 Commits

Author SHA1 Message Date
fzyzcjy
c63e9cb29e Super tiny fix CI (#16437) 2026-01-04 20:34:49 -08:00
Alison Shao
f8411ded6e ci: migrate 1-GPU model tests to test/registered/models/ (#16414) 2026-01-04 18:08:01 -08:00
fzyzcjy
12df16607b Tiny speed up kimi detokenizer by 10x (#16427) 2026-01-05 09:12:05 +08:00
Douglas Yang
55d112dc79 fix: enable multi-threading for h200 tests (#16413) 2026-01-04 14:43:53 -08:00
Alison Shao
52c604342c chore: print test list at beginning and end of run_suite.py (#16334) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-04 11:52:52 -08:00
Alison Shao
ff0f370f85 ci: migrate MoE tests to test/registered/moe/ (#16127) 2026-01-04 11:51:12 -08:00
Alison Shao
26f9e20755 ci: migrate quantization kernel tests to test/registered/quant/ (#16323) 2026-01-04 11:49:29 -08:00
Ke Bao
76bc07a335 Move swa memory pool to a seperate file (#16347) 2026-01-04 22:39:30 +08:00
fzyzcjy
e797f0c570 Support offline generation scenario for prefill delayer (#16363) 2026-01-04 11:05:10 +08:00
fzyzcjy
5d4b7c78bf Fix memory leak in prefill delayer (#16358) 2026-01-04 10:11:18 +08:00
fzyzcjy
2337b1bbb0 Refactor and fix prefill delayer (scheduler enhancer) (#16269) 2026-01-04 07:15:06 +08:00
sunxxuns
8b869e326c [AMD] feat: add DLLM support for AMD GPUs with LLaDA2 testing (#15560) 2026-01-03 10:41:11 +08:00
Ke Bao
7c1b4b1c4c Support swa allocator page size > 1 (#16296) 2026-01-03 08:49:47 +08:00
Baizhou Zhang
f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Yongfei Xu
0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
Yineng Zhang
417e75a60f fix: use 2-gpu-runner for pp 2 NemotronH ut (#16239) 2025-12-31 14:51:33 -08:00
Huaixin Chang
c1dfbc777b deprecate prefill-round-robin-balance (#16195) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-31 22:25:33 +08:00
Even Zhou
3b3c5a05c1 [CI/NPU] fix multiple NPU CI issue (#16111) 2025-12-31 21:14:04 +08:00
Bingxu Chen
1c360bf753 [AMD CI] add testcases to unit-test-backend-1-gpu (#16117) 2025-12-30 23:08:45 -08:00
roikoren755
47a660d5b9 [NemotronH] PP support (#16172) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2025-12-31 11:16:15 +08:00
Mufeez Amjad
cbff7ad985 dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110) 2025-12-30 22:33:06 +08:00
Vitaly Tuzov
1048803c1f Reworked fast_pos_embed_interpolate() using torch (#10959) 2025-12-30 14:45:34 +08:00
Bingxu Chen
5e20e7a60d [AMD CI] Organize AMD nightly perf test files (#16114) 2025-12-29 22:09:46 -08:00
Cheng Wan
60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) 2025-12-30 12:38:33 +08:00
Alison Shao
f4ec6f8e17 ci: migrate remaining spec/eagle tests to test/registered/spec/ (#15800) 2025-12-29 14:00:00 -08:00
Cheng Wan
6f9d0a89a0 [scheduler] fix: correcting extend_logprob_start_len calculation (#15922) 2025-12-28 14:57:04 -08:00
lif
5969be2f06 Apply fixture-kit mode to MMMUVLMMixin (#15615) 2025-12-28 17:22:05 +08:00
Cheng Wan
c457aad54a Update test parameters for deepep_large test (#16001) 2025-12-28 00:58:19 -08:00
Liangsheng Yin
c7e7bfa32c Add EAGLE3 test with MMLU dataset. (#15945) 2025-12-28 16:07:58 +08:00
Liangsheng Yin
bf90ea9c5b Unify spec v2's naming manner. (#15990) 2025-12-28 14:14:52 +08:00
Lianmin Zheng
183b65190a Clean up logging (#15919) 2025-12-27 15:27:12 -08:00
Ke Bao
faecd37ed4 Add Mimo-v2-flash model to ci test (#15887) 2025-12-27 14:18:08 +08:00
Liangsheng Yin
9ad546d7e8 Tiny cleanup the models' name in test_utils (#15920) 2025-12-27 14:13:23 +08:00
Alison Shao
72a980c6d5 ci: migrate MLA tests to test/registered/mla/ (#15798) 2025-12-24 23:29:30 -08:00
satyamk7054
38dd4fbb66 Add overlap scheduling for embeddings code path (#14032) 
Co-authored-by: Satyam Kumar <satyamk@linkedin.com>
 2025-12-24 18:24:18 -08:00
fzyzcjy
8196998a03 Tiny add num retracted tokens metric (#15653) 2025-12-24 22:15:23 +08:00
fzyzcjy
fd4a558e71 Add metrics for having prefill and decode in different ranks (#15752) 2025-12-24 21:35:35 +08:00
michael-amd
e7b09efc0a [AMD] Add AMD Nightly Performance & VLMs Accuracy Tests (#15500) 2025-12-23 19:03:27 -08:00
Liangsheng Yin
0d0367e9d0 Tiny fix CI (#15696) 2025-12-24 01:51:08 +08:00
Liangsheng Yin
bd572360f3 Tiny apply gsm8k mixin to ngram test (#15606) 2025-12-24 01:30:26 +08:00
fzyzcjy
6a5764a719 Super tiny add test_soft_watchdog to nightly (#15692) 2025-12-23 22:46:15 +08:00
Alison Shao
ac42797cf7 [CI] Enable retry logic for flaky CI tests (#14983) 2025-12-22 22:23:42 -08:00
Alison Shao
883747ced1 [CI] Migrate Attention Backend tests to test/registered/attention/ (#15563) 2025-12-22 22:17:52 -08:00
SeanWeiSean
7759716786 bugfix[schedule]: Refactor sort method and add related UT (#13576) 
Co-authored-by: Yuxuan Wei <w1300012920@pku.edu.cn>
Co-authored-by: Yuxuan Wei <w1300012920@gmail.com>
Co-authored-by: Yuxuan Wei🚚 <yuxwei@microsoft.com>
 2025-12-23 03:13:57 +08:00
fzyzcjy
d5431ff894 Tiny add stuck simulation (#15613) 2025-12-22 17:00:18 +08:00
Liangsheng Yin
beae3f961c Adapt fixture-kit to gsm8k mixin (#15599) 2025-12-22 14:19:35 +08:00
Baizhou Zhang
468931b572 [Tiny]Move deepseek fp4 cutlass moe test to per-commit test (#15565) 2025-12-21 18:08:07 -08:00
Qiaolin Yu
a92de891b8 Split dpsk fp4 4 gpu tests and move the mtp part to real stage b (#15553) 2025-12-21 15:51:43 -08:00
Jincong Chen
350fbbf4dc fix ds3.2 nsa backend prefill TBO (#14901) 2025-12-21 13:16:46 -08:00
Junrong Lin
bed301a5ac [Feature] Enable return routed experts (#12162) 
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-21 15:16:43 +08:00