chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
7,565 Commits 1 Branch 0 Tags
a4ffd665c00a2ac9818803737d634a5a656d8113
Commit Graph

428 Commits

Author SHA1 Message Date
Baizhou Zhang
6799847ebf [CI]Unblock and split spec v2+dp test (#14551) 2025-12-07 17:39:25 -08:00
b8zhong
3b47973af8 [CI] Tiny speed up VLM CI (#14517) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-07 13:30:41 -08:00
khalilzhk
948b6acee8 [BugFix] fix prefixcache performance and accuracy on ascend (#13573) 2025-12-08 02:16:20 +08:00
Hanming Lu
e592ee6545 [Qwen3-next] remove heuristics and add radix cache kl test (#14520) 2025-12-06 12:11:40 -08:00
Alison Shao
16e8463a90 Add Mistral Large 3 basic test to PR CI (#14460) 2025-12-05 10:38:52 -08:00
Xinyuan Tong
6d37e70883 ministral3 (#14251) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
 2025-12-04 14:31:26 -08:00
Ma Mingfei
f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
blzheng
974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Cheng Wan
96cc10834a [CI] update estimated elapsed time of some unittests (#14347) 2025-12-03 01:21:40 -08:00
Xuan Liao
c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Yuan Luo
26aebf83d3 [VLM] Support Piecewise CUDA Graph for Qwen3-Omni-MOE (#14222) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-02 10:12:10 +08:00
liupeng374
2e8f54e61e [spec-overlap] bugfix for pd disaggregation and npu (#14088) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-12-01 22:58:20 +08:00
Liangsheng Yin
0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
fzyzcjy
36b729c2b8 Implement profiler v2 and fix stage mixture bug (#14148) 2025-11-30 16:59:52 +08:00
Cheng Wan
0fe74af563 Remove incorrect deep_gemm assertions from server_args.py (#14113) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
 2025-11-28 20:25:39 -08:00
Kangyan-Zhou
a102a0507a Disable Deepep 2 GPU tests (#14111) 2025-11-28 13:56:34 -08:00
Kangyan-Zhou
4c9f7c97d3 Temporarily disabled test (#14069) 2025-11-27 14:58:46 -08:00
Yixin Dong
6350042696 feat: Naive support Spec V2 + Constrained Decoding (#13425) 
Signed-off-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-11-27 20:31:46 +08:00
Netanel Haber
082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
alisonshao
5b7da0f58e Temporarily disable test_update_weights_from_disk.py in CI (#14021) 2025-11-26 13:56:28 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-25 14:47:34 -08:00
alisonshao
dbab5d50a3 Add test_dummy_grok_models.py to not_in_ci section (#13908) 2025-11-25 16:51:25 +08:00
Even Zhou
db0ffc09ef [NPU] Fix NPU CI (#13834) 
Co-authored-by: c30031083 <chenxu140@huawei.com>
 2025-11-25 10:09:36 +08:00
Yuan Luo
5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-11-22 22:45:32 +08:00
Kangyan-Zhou
59b4d7f8d6 Fix B200 Nightly tests and move one manual test back to unit test to prevent the same issue (#13746) 2025-11-21 17:41:12 -08:00
Cheng Wan
6d0e0b9bfc [11/N] MoE Refactor: Simplifying SBO Implementation with Dispatcher Hooks (#13327) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-21 01:11:37 -08:00
Yuan Luo
475962a139 [VLM] Support Piecewise CUDA Graph for InternVL (#13640) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-11-21 13:21:51 +08:00
Kaixi Hou
db2d362d04 [NVIDIA] Add cutedsl e2e test to GB200 CI (#12672) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-20 18:30:12 -08:00
alisonshao
81e86992cd [CI] Move nightly tests to test/nightly/ (#13683) 2025-11-20 18:00:02 -08:00
alisonshao
6b262ac839 Test reorganization: Move tests to manual/ (#13610) 2025-11-20 13:41:58 -08:00
StonyPort
48ca9f7518 feat: support external custom models (#13429) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-11-20 11:16:58 +08:00
Yuan Luo
af6bcadcf7 [VLM] Support Piecewise CUDA Graph for Qwen2.5-VL (#13055) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Yuhao Yang <yhyang201@gmail.com>
 2025-11-20 10:23:44 +08:00
Liangsheng Yin
196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Liangsheng Yin
a1e1e533b9 Tiny enhance test suites sanity check (#13589) 2025-11-19 22:43:58 +08:00
Even Zhou
d4a4dcdfb3 [NPU] Adapt pr-gate for pr-test workflow & workflows refresh (#13567) 2025-11-19 21:55:17 +08:00
Sai Enduri
9a1a9a4209 [AMD CI] Local cache fallback. (#13452) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-18 19:23:45 -08:00
Chen Haozhe
6c2e5fcd91 [feat][Ascend][Mindspore]: support model-impl of mindspore (#9234) 2025-11-19 09:17:47 +08:00
Nicholas
ac81db66c2 [VLM][feat] Support encoder DP for Qwen2.5-VL (#13126) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
 2025-11-18 16:13:18 +08:00
b8zhong
f33860777c [Piecewise CUDA Graph] Support ModelOpt FP8 (#13094) 2025-11-18 12:46:24 +08:00
Yuhao Yang
7119d188f6 [CI] re-enable test_vision_openai_server_a ci (#13444) 2025-11-17 18:32:59 -08:00
Kaixi Hou
e389f91dec [NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2025-11-17 16:13:28 -08:00
Liangsheng Yin
6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) 2025-11-18 02:08:19 +08:00
Carlo Mussolini
df56139226 Adding user defined hooks support (#13217) 2025-11-17 23:07:37 +08:00
Liangsheng Yin
ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
lixiaolx
d368c7451a (1/n)support context parallel with deepseekv3.2-DSA (#12065) 2025-11-16 20:12:25 -08:00
Baizhou Zhang
d64dd3e18e [Tiny]Fix 1-gpu nightly test bugs (#13389) 2025-11-16 15:54:17 -08:00
Baizhou Zhang
3ccd7fa669 [CI] Fix B200 CI (#13387) 2025-11-16 15:13:57 -08:00
Lifu Huang
254f62d879 Support spec decoding when LoRA is applied to target model (#12903) 2025-11-16 13:20:23 -08:00
Liangsheng Yin
1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) 2025-11-16 23:15:36 +08:00
kyleliang-nv
597d416070 [feature] Add layerwise NVTX support (#11870) 2025-11-15 19:20:56 -08:00