Commit Graph

1222 Commits

Author SHA1 Message Date
Liangsheng Yin
daf494b681 tiny fix lint (#13337) 2025-11-15 23:05:08 +08:00
xlzheng
37e8724ef3 perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001) 2025-11-15 22:02:42 +08:00
Zhihao Lyu
10592e9c08 [Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-11-15 21:59:58 +08:00
Even Zhou
2aec8b6e1b [Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443) 2025-11-15 21:51:07 +08:00
Ke Bao
0d41ddfbd0 Temporarily disable test_vision_openai_server_a CI (#13331) 2025-11-15 19:46:49 +08:00
fzyzcjy
8e6083bfcf Support inverse transform ue8m0 scale (#13285) 2025-11-15 16:34:32 +08:00
alisonshao
67e6f1438d Consolidate similar tests to reduce duplication (#12871) 2025-11-15 14:29:44 +08:00
Minglei Zhu
a5be6ef98e [Deterministic] Support Qwen3-Next model deterministic inference (#13100) 2025-11-14 18:01:18 -08:00
Kangyan-Zhou
b223669136 Remove nightly b200 tests and revert a change for test file (#13305) 2025-11-14 16:30:22 -08:00
alisonshao
dcc47a56c9 Implement nightly test workflow naming conventions (#13170) 2025-11-14 16:14:53 -08:00
Johnsonms
6448b4cd2c Fix NSA indexer nightly test failed issues (#13298) 2025-11-14 13:14:57 -08:00
hlu1
a7002e614b [Deepseek V3.2] Clean up MTP (#13236) 2025-11-14 11:01:37 -08:00
fzyzcjy
15264232ee Super tiny fix CI (#13283) 2025-11-14 21:45:10 +08:00
fzyzcjy
3701f34dab Tiny add utility to parse server logs (#12605) 2025-11-14 17:34:22 +08:00
Kangyan-Zhou
49141df94a Extend lint test to test/ directory (#13247) 2025-11-14 00:01:48 -08:00
b8zhong
7b79cc4fe2 ci: speed up b200 ci (#13237) 2025-11-13 23:57:33 -08:00
Binyao Jiang
7cdaedb8fb Remove glm41v from CI to speed up CI (#13257) 2025-11-13 21:14:04 -08:00
Binyao Jiang
9b41f31a66 Use 32x32 black image for VLM server warmup and bring glm4.1v back to UT (#13222) 2025-11-13 14:21:43 -08:00
Sam
e7e89349c9 Enable Flashinfer TRTLLM-GEN-MoE FP8 blockwise kernel for Qwen3-Next on Blackwell (#12543) 2025-11-13 19:44:44 +08:00
Shu Wang
6664083522 Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376) 2025-11-13 00:26:00 -08:00
Kangyan-Zhou
2bb0317e19 Remove enable_dp_attention in deepseek nightly tests (#13190) 2025-11-12 22:58:57 -08:00
Hubert Lu
e4b2937017 [AMD] Add AITER Custom All-Reduce (#13102)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2025-11-12 21:53:44 -08:00
Tejesh Anand
e42df37df0 Remove EBNF Composer (#13163) 2025-11-12 17:55:30 -08:00
khalilzhk
2d531946db [Ascend][feature] support L1+ L2 radixcache on ascend (#12214)
Co-authored-by: khalilzhk <zhangkaikai12@huawei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
2025-11-12 20:45:24 +08:00
Ke Bao
a7cc02e36e Fix run suite sanity check (#13133) 2025-11-12 15:29:10 +08:00
Baizhou Zhang
8ece99a9dc [CI] Update job dependency and move dpsk v3.2 tests to 8-gpu suite (#12942) 2025-11-11 23:16:47 -08:00
yctseng0211
28b8c5792d Upgrade to ROCm 7.0 image (#13105) 2025-11-11 19:14:28 -08:00
hlu1
0d4a418424 [Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-11 16:15:26 -08:00
cctry
e0e6a6efb2 Fix CPP Radix Cache and add test to CI (#11645) 2025-11-11 11:51:37 -08:00
vikram singh shekhawat
14a339fcc8 [Test] Handle streaming chunks with null content in case of stream end. (#10862)
Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>
2025-11-12 02:03:50 +08:00
Liangsheng Yin
5f662e786f Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
2025-11-12 01:23:55 +08:00
Liangsheng Yin
f09eee036d Tiny simplify evcition metrics collector (#12983) 2025-11-11 23:23:48 +08:00
yctseng0211
4a78031a71 [ROCM] Optimized deepseek-r1 model with rmsnorm + fp8 quant fusion (#12689)
should be clean after https://github.com/sgl-project/sglang/pull/13017 landed
2025-11-11 02:59:10 -08:00
haoyangli-amd
ea10a9d165 [bug][rocm]fix qr when variable inp (#11609)
Signed-off-by: Haoyang Li <lihaoyang0109@gmail.com>
2025-11-11 01:43:48 -08:00
michael-amd
39b1d048a0 [AMD] Add PD test for AMD CI (#11938) 2025-11-11 16:49:44 +08:00
Sam
3594815a8b Re-enable Flashinfer TRTLLM GEN MHA and Add Unit Test (#12885) 2025-11-10 20:17:43 -08:00
Xiaoyu Zhang
9caca6a45c [PieceWise CUDA Graph] Support awq/gptq model in piecewise cudagraph (#12518) 2025-11-11 11:56:15 +08:00
Peng Zhang
012bfc4fdc [9/n] decouple quantization impl from vllm dependency - adjust ci (#12753) 2025-11-10 14:55:19 -08:00
Lianmin Zheng
40b26b456b Simplify the BatchMultimodalOutput in io_struct.py (#12993) 2025-11-10 13:54:56 -08:00
Liangsheng Yin
1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
Liangsheng Yin
665416f6dd Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224) 2025-11-11 02:56:22 +08:00
fzyzcjy
b0ee99dd03 Super tiny fix typo (#13001) 2025-11-11 00:47:45 +08:00
Yuhao Yang
1240ac13b8 vlm: fix tiny multimodal cache bug (#12984) 2025-11-10 21:30:19 +08:00
Ke Bao
db24d34603 Support piecewise cuda graph for MLA (#11812) 2025-11-10 09:13:48 +08:00
Liangsheng Yin
4f65a64666 Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
2025-11-10 00:42:50 +08:00
Mick
f5b3ccd9a5 feat: basic support for server-level multimodal cache (#10775) 2025-11-10 00:27:50 +08:00
Ke Bao
bb00e24f87 Adjust server launch time in ci (#12917) 2025-11-09 20:41:29 +08:00
Liangsheng Yin
877cb52840 [CI] increase ut buckets & adjust estimation time. (#12919) 2025-11-09 18:17:50 +08:00
Kangyan-Zhou
93cf60fc64 Fix Deepseek nightly tests (#12906) 2025-11-09 00:26:06 -08:00
Ke Bao
b5e0417392 Add kimi k2 thinking to ci (#12907) 2025-11-09 16:10:32 +08:00