Commit Graph

1178 Commits

Author SHA1 Message Date
Liangsheng Yin
4f65a64666 Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
2025-11-10 00:42:50 +08:00
Mick
f5b3ccd9a5 feat: basic support for server-level multimodal cache (#10775) 2025-11-10 00:27:50 +08:00
Ke Bao
bb00e24f87 Adjust server launch time in ci (#12917) 2025-11-09 20:41:29 +08:00
Liangsheng Yin
877cb52840 [CI] increase ut buckets & adjust estimation time. (#12919) 2025-11-09 18:17:50 +08:00
Kangyan-Zhou
93cf60fc64 Fix Deepseek nightly tests (#12906) 2025-11-09 00:26:06 -08:00
Ke Bao
b5e0417392 Add kimi k2 thinking to ci (#12907) 2025-11-09 16:10:32 +08:00
Kangyan-Zhou
d134096319 Add Deepseek models into nightly tests (#12865) 2025-11-09 13:17:49 +08:00
alisonshao
d3a03aeef8 Refs/heads/add nightly test multi gpu configs (#12870) 2025-11-08 15:14:50 -08:00
Liangsheng Yin
6fee2c535c [CI] Tiny adjust CI esitmation time (#12886) 2025-11-08 23:02:19 +08:00
Baizhou Zhang
e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
alisonshao
0b88d520a0 Add nightly performance test for GPT-OSS 4GPU models (#12805) 2025-11-07 16:54:07 -08:00
Ke Bao
0fe9c1f70b Fix piecewise cuda graph ci test (#12836) 2025-11-08 00:25:00 +08:00
Jonah Bernard
bc25ea6762 [MoE] Add Comprehensive MoE Integration Tests (#12090) 2025-11-07 00:34:46 -08:00
Johnsonms
125f76ea44 [Test] Add DeepSeekV3.2 NSA Indexer Test Suite (#12520) 2025-11-06 21:28:43 -08:00
Kalyan Kumar
3b1cc466c0 fixes hardcoded "cuda" device references in unit tests to use a dynamic device selection (#12761) 2025-11-07 11:38:35 +08:00
alisonshao
149dc9aab1 Add nightly test multi gpu configs (#12721) 2025-11-05 19:30:19 -08:00
Lianmin Zheng
c7d57d5bb3 Fix CI and style (#12658) 2025-11-05 15:08:15 -08:00
Kaixi Hou
141278048e [NVIDIA] Fix unit test of MoE and add it to nightly ci (#12709) 2025-11-05 14:33:18 -08:00
Baizhou Zhang
7c45b8b4bb [CI] Fix qwen3-vl lora nightly ci (#12708) 2025-11-05 11:00:13 -08:00
Yuhong Guo
4d84f886e7 Refactor --debug-tensor-dump-layers to list (#12691) 2025-11-05 03:30:01 -08:00
Hubert Lu
3694266051 Expand and update test coverage for AMD CI (#10044) 2025-11-04 22:15:13 -08:00
Kangyan-Zhou
6dade6c3b5 Fix VLLM dependency test (#12670) 2025-11-04 20:49:58 -08:00
Liangsheng Yin
44b1b394a4 [PD-Disagg] Check finish after pop tranferred (#12638) 2025-11-05 11:18:09 +08:00
Kaixi Hou
0711d1509b [NVIDIA] Fix cutedsl backend of MoE (#12353) 2025-11-04 18:54:55 -08:00
soaringk
44da737770 [fix] Handle escaped characters in GLM tool call parser to prevent double serialization (#12456) 2025-11-04 16:48:14 -08:00
Baizhou Zhang
d22d044734 Revert "Enable memory saver for hybrid model" (#12648) 2025-11-04 16:22:06 -08:00
Liangsheng Yin
30b26ee9d0 Add io struct naming check back (#12634) 2025-11-05 01:15:01 +08:00
Liangsheng Yin
aa797d013d [Test] Merge all constrained decoding tests. (#12633) 2025-11-05 00:43:06 +08:00
fzyzcjy
b7d7041190 Add sanity checks when a test file is not added to CI (reland) (#12594) 2025-11-04 18:04:26 +08:00
Minglei Zhu
c14cc47e39 [Deterministic] Optimize bmm_batch_invariant op (#12522) 2025-11-04 00:33:31 -08:00
Zhao Chen
d5fa019c36 feat: limit peak memory usage when computing logprobs (#6318)
Signed-off-by: Zhao Chen <zhaochen.zju@gmail.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
2025-11-03 23:53:20 -08:00
Junrong Lin
173e0f704f Enable memory saver for hybrid model (#11974) 2025-11-04 14:55:26 +08:00
Jonah Bernard
a209fb05c1 [Qwen3 VL] Add LoRA support for Qwen 3 VL (#12165) 2025-11-03 20:32:54 -08:00
kousakawang
7efd8b3d1f [FEAT] Shared mem pool based cuda ipc for multi-modal data transport (#11917)
Co-authored-by: kousakawang <wanghanpei@bytedance.com>
Co-authored-by: Yuan Luo <4908075+yuan-luo@users.noreply.github.com>
2025-11-02 16:46:37 +08:00
Baizhou Zhang
9a512cf95b [CI] Move some Lora/Deterministic CI tests to nightly (#12507) 2025-11-01 19:54:22 -07:00
Binyao Jiang
3451fc3280 [Feature] Qwen3-Next & FLA: Support MTP topk>1; Up to 6% faster (#11133)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-01 19:47:56 -07:00
Minglei Zhu
229256c505 [Deterministic] add deepseek v3 deterministic inference CI test (#12412) 2025-11-01 18:10:32 -07:00
Surya-Gunukula
795e98f8a6 Forward unknown tool calls instead of dropping (#12226) 2025-11-01 02:10:35 +00:00
Ke Bao
a4bf5c6ad2 Support Kimi Linear (#12469)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-10-31 14:03:35 -07:00
Yuan Luo
c30ebb9300 [VLM] Optimize async mm data process mechanism (#12066)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-01 01:24:53 +08:00
Neelabh Sinha
b57dc169eb [Test] Add Functional Tests for Penalty Parameters (#11931) 2025-11-01 00:10:17 +08:00
Yuhong Guo
ab95d35fcb feat: Add Non-intrusive Tensor Dumping for Model Inference (#10566) 2025-10-31 12:04:48 +08:00
Liangsheng Yin
d4a09ec9dc [CI] fix tests' time estimation (#12401) 2025-10-30 19:20:35 -07:00
Kaixi Hou
c0d02cf4d1 [NVIDIA] Add CI workloads for GB200 (#12242) 2025-10-30 14:32:03 -07:00
Even Zhou
ce6b17c0f9 [Feature] Support DeepSeek MTP on NPU (#11897)
Co-authored-by: liupeng374 <liupeng374@huawei.com>
2025-10-30 21:56:56 +08:00
Liangsheng Yin
73dfd2dfb1 [Test] Enhance radix cache test for spec cases (#12394) 2025-10-30 18:46:28 +08:00
Kangyan-Zhou
7e28c67d19 Fix DeepSeek chat templates to handle tool call arguments type checking (#11700) (#12123) 2025-10-30 16:39:25 +08:00
Baizhou Zhang
621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
b8zhong
7ed8ba05cb [CI] Add Llama 3.1 8B FP4 to B200 CI (#12182) 2025-10-29 14:56:41 -07:00
Minglei Zhu
e39628fd07 [2/2] Deepseek deterministic: support deepseek v3 deterministic inference on 8 x H200 (#12095) 2025-10-29 11:49:04 -07:00