chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

1815 Commits

Author SHA1 Message Date
Glen Liu
6327dff242 enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333) 2026-01-10 16:49:00 +08:00
Yuan Luo
ad20127359 [CI] Remove duplicate code in test_mamba_ut (#16854) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-10 16:16:56 +08:00
Shangming Cai
4b14f622e1 [CI] Add PD Disaggregation aarch64 test (#16572) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-10 14:44:54 +08:00
fzyzcjy
c89949bbaf Tiny let soft watchdog cover initialization phase (#16853) 2026-01-10 13:20:08 +08:00
fzyzcjy
32a569fb77 Tiny add CPU resource monitoring for overload diagnosis (#16852) 2026-01-10 12:48:18 +08:00
fzyzcjy
3ed3b7ef7c Tiny add routing key distribution metrics (#16847) 2026-01-10 12:06:40 +08:00
fzyzcjy
1f9d4795a9 Tiny add gauge histogram abstraction for engine and router (#16848) 2026-01-10 11:45:25 +08:00
Liangsheng Yin
e6d40bff81 Revert "feat: reduce constrained-decoding overhead in TP" (#16845) 2026-01-10 11:39:38 +08:00
fzyzcjy
1f0ea4f958 Add routing key based schedule policy (#16840) 2026-01-10 10:16:23 +08:00
fzyzcjy
cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) 2026-01-10 07:54:25 +08:00
Alison Shao
ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) 2026-01-09 15:24:26 -08:00
Yuan Luo
08636f72b5 [Fix CI] Fix test_mamba_unittest.py (#16810) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-09 15:03:47 -08:00
Liangsheng Yin
7066711529 [ci hot fix] fix global server args init for mamba ut (#16821) 2026-01-10 02:03:32 +08:00
Leoyzen
8ef5b90528 Fix GLM-4.7 MoE Detector complex JSON Schema type parsing (#15753) 2026-01-10 01:21:10 +08:00
Raayan Dhar
76b3c698d6 feat: reduce constrained-decoding overhead in TP (#13947) 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
 2026-01-10 00:38:32 +08:00
fzyzcjy
8eeffbe9aa Support token low usage watermark in prefill delayer (#16814) 2026-01-09 23:07:18 +08:00
fzyzcjy
71e9c31cb8 Tiny add and enhance tests for prefill delayer (#16813) 2026-01-09 22:58:38 +08:00
Alison Shao
e46f79431b Fix external_models import path and migrate model loading tests (#16458) 2026-01-08 23:43:49 -08:00
Hanming Lu
41609b52fe support page size large than 64 for mamba radix cache with fix (#16768) 2026-01-09 13:28:37 +08:00
Michael
fcec35dc4a [AMD] Add MI35x nightly CI tests (#16588) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-01-08 19:29:15 -08:00
Alison Shao
a979927727 Skip causal_conv1d test with padded batches due to Triton kernel bug (#16715) 2026-01-08 15:13:13 -08:00
YC Tseng
4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-08 10:16:27 -08:00
fzyzcjy
b6e8a0d851 Add file size hints in bitwise model file verifier (#16735) 2026-01-08 22:28:52 +08:00
fzyzcjy
83abecd0c2 Support pre-generating and using expected checksums (#16730) 2026-01-08 20:26:13 +08:00
fzyzcjy
d54f0a10b4 Support bitwise weight checksum verifier (#16729) 2026-01-08 20:19:25 +08:00
Bingxu Chen
f9c0426692 [AMD CI] re-enable testcases missed when migrating ci test files (#16535) 
Co-authored-by: michael-amd <michael.zhang@amd.com>
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-01-07 22:43:48 -08:00
Alison Shao
63cc97f4ef ci: migrate 2-GPU tests to test/registered/ (#16529) 2026-01-07 20:28:16 -08:00
Yuwei An
154740bd4d Disable PCG TP Unittest (#16693) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-07 19:59:47 -08:00
Harish
156d97b219 Fix KeyError when logprobs=false in completions endpoint (#16095) 2026-01-07 15:49:02 -08:00
Alison Shao
3a4767daa3 Fix pytest tests to exit with proper exit code (#16681) 2026-01-07 15:20:46 -08:00
Alison Shao
0241e0460f Migrate tokenizer tests to test/registered/tokenizer/ (#16457) 2026-01-07 13:21:16 -08:00
Alison Shao
0c474273c5 Fix gpt_oss_common import path and migrate core tests (#16426) 2026-01-07 12:58:32 -08:00
Baizhou Zhang
153c69f63d [CI] Enable dpsk v31 test on nightly H200 (#16660) 2026-01-07 23:21:19 +08:00
Douglas Yang
2ff872311b ci: adding llama4 placeholder test to nightly (#16599) 2026-01-07 21:51:30 +08:00
Hubert Lu
b86bbf841e [AMD] Add 8-GPU MX35X test running DSR1-MXFP4 model for AMD CI (#13602) 2026-01-07 01:43:11 -08:00
YC Tseng
8bce085321 [AMD] CI - add 2 pp test cases to performance-test-2-gpu-amd (#16514) 2026-01-06 23:52:46 -08:00
Alison Shao
6b8a9d7058 fix: update AMD CI estimated time for test_torch_compile (#16631) 2026-01-06 23:42:18 -08:00
Douglas Yang
5c04088b3a fix: remove performance testing from nightly dpsk v32 cp single node (#16582) 2026-01-07 13:38:31 +08:00
Alison Shao
52de807dd7 Migrate profiling tests to test/registered/profiling/ (#16459) 2026-01-06 21:04:48 -08:00
Alison Shao
70933f34f1 Migrate attention unit tests to test/registered/attention/ (#16465) 2026-01-06 20:50:54 -08:00
Alison Shao
ce453fa43b Migrate backends tests to CI registration system (#16468) 2026-01-06 20:31:52 -08:00
Douglas Yang
951d16c890 fix: adjusting vlm accuracy thresholds (#16593) 2026-01-06 19:41:05 -08:00
Yuwei An
2a8d5493f3 PCG Unit Test Adjustment (#16609) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-07 10:57:15 +08:00
Alison Shao
90eac38a12 Migrate FP8/TorchAO tests to test/registered/quant/ (#16453) 2026-01-06 18:27:43 -08:00
fzyzcjy
d874c8bba4 Tiny support http headers in bench serving (#16606) 2026-01-07 10:15:17 +08:00
fzyzcjy
9a21d89c5b Tiny add metrics for prefill delayer (#16603) 2026-01-07 09:53:52 +08:00
Alison Shao
399d5283f8 ci: migrate scheduler tests to test/registered/scheduler/ (#16442) 2026-01-06 14:55:52 -08:00
Alison Shao
2e0527dd74 ci: migrate Debug Utils, Ops, and Rotary Embedding tests to test/registered/ (#16422) 2026-01-06 14:35:57 -08:00
Douglas Yang
5349764298 fix: kimi k2 thinking accuracy threshold change (#16585) 2026-01-06 13:18:43 -08:00
Alison Shao
0cbd8f3247 ci(test): migrate OpenAI server tests to registered CI system (#16326) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-06 11:09:37 -08:00