Commit Graph
1317 Commits
Author SHA1 Message Date
YAMY decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
Liangsheng Yin 0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
fzyzcjy 36b729c2b8 Implement profiler v2 and fix stage mixture bug (#14148) 2025-11-30 16:59:52 +08:00
Kangyan-Zhou 1d3d8b3418 Fix Minimax M2 loading issue (#13956) 2025-11-29 17:07:19 -05:00
Lianmin ZhengChang Su <chang.s.su\n@oracle.com>Xinyuan TongXinyuan Tong
155a9e7237 Fix condition for streaming output_ids in tokenizer manager (#13759)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Chang Su <chang.s.su\n@oracle.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2025-11-29 13:56:15 -08:00
Shangming Cai c6d34a0688 Move piecewise cuda graph test to manual dir to fix CI (#14121)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-29 00:52:01 -08:00
Cheng WanandKangyan Zhou 0fe74af563 Remove incorrect deep_gemm assertions from server_args.py (#14113)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
2025-11-28 20:25:39 -08:00
fjybiocsandserverance.fu 143b57b805 enable piecewise cuda graph for prefill server (#13377)
Co-authored-by: serverance.fu <serverance.fu@temu.com>
2025-11-29 12:09:26 +08:00
f446b51c41 fix: malformed KV events for NVIDIA Dynamo (#13488)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-11-28 14:55:20 -08:00
Kangyan-Zhou a102a0507a Disable Deepep 2 GPU tests (#14111) 2025-11-28 13:56:34 -08:00
Lzhang-hub ea1e9f6b3c feat: support qwen3_vl vision model dp (#13724) 2025-11-28 17:29:07 +08:00
Raayan Dhar 91d249cd9b fix: small changes to enable test_mrope.py (#14082)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
2025-11-27 22:58:17 -08:00
alisonshao bce40fa217 Fix utils import issue for nightly tests (#13944) 2025-11-27 15:24:27 -08:00
Kangyan-Zhou 4c9f7c97d3 Temporarily disabled test (#14069) 2025-11-27 14:58:46 -08:00
Yixin DongandLiangsheng Yin 6350042696 feat: Naive support Spec V2 + Constrained Decoding (#13425)
Signed-off-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-11-27 20:31:46 +08:00
alisonshao d941a3befa Fix nightly test failure: NSA indexer dtype (#14017) 2025-11-26 21:27:51 -05:00
SamandKaixi Hou 91e8dc371a [Feat][NVFP4] Enable NVFP4 MoE for Qwen series models (eg. Qwen3-Next) #13761 (#13761)
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
2025-11-26 17:53:45 -07:00
ShawnY112358andStefan He 5155016b56 [feat] update bucketed weights from distributed (#13824)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-26 15:30:45 -08:00
Netanel Haber 082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
alisonshao a8ef4d1804 Add nightly test support to unified run_suite.py (#13941) 2025-11-26 15:16:12 -08:00
alisonshao 5b7da0f58e Temporarily disable test_update_weights_from_disk.py in CI (#14021) 2025-11-26 13:56:28 -08:00
Douglas YangandLiangsheng Yin 697a77bf73 Add stress test workflow (#13937)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2025-11-26 13:24:39 -08:00
Liangsheng Yin 6c190cbda0 Rename: --hooks to --forward-hooks (#13994) 2025-11-26 22:26:28 +08:00
StonyPortandqiuxuan.lzw 540d6fee20 Support piecewise CUDA graph for embedding models (#13852)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
2025-11-26 15:29:46 +08:00
ShawnY112358and赵晨阳 007c3e234c [feat] support in-flight weight update (#10071)
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
2025-11-25 22:03:13 -08:00
Yubo Wang 18fb51583f Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725) 2025-11-26 11:44:41 +08:00
Yuan Luoandluoyuan.luo ca5c8b16f6 [VLM] Support InternVL Vision Encoder Data Parallelism (#13925)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-26 11:43:05 +08:00
Fan YinandBaizhou Zhang 36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
Lianmin Zheng 1ab6ce0e62 [Auto Sync] Improve profilers and simplify bench_one_batch_server.py (#13866) 2025-11-25 12:13:31 -08:00
Liangsheng Yin 3421d049aa [CI] rename: per_commit -> registered (#13928) 2025-11-25 23:05:06 +08:00
Liangsheng Yinandalisonshao d3d404d3d7 [CI] CI registry update (#13927)
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
2025-11-25 22:43:19 +08:00
Chen1022 d64bf6c6ce Support piecewise cuda graph for Qwen3-next (#13081) 2025-11-25 21:01:27 +08:00
alisonshao dbab5d50a3 Add test_dummy_grok_models.py to not_in_ci section (#13908) 2025-11-25 16:51:25 +08:00
Xiaoyu Zhangandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> 407cb3ce1e [CI tiny fix] Enhance robustness of vision chunked prefill test with ROUGE-L metric (#13793)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-25 15:41:14 +08:00
alisonshao 7cc43bd453 Move test_dummy_grok_models.py from manual to srt (temporary) (#13901) 2025-11-24 23:36:53 -08:00
Zaili WangandFan Yin cce2d748ef remove RoPE CPU fp32 tests (#13827)
Co-authored-by: Fan Yin <1106310035@qq.com>
2025-11-24 23:22:35 -08:00
Douglas Yang ed8786b0b9 Adding nightly tests for Kimi-K2-thinking, Qwen3, minimax-m2, GLM4.6 (#13890) 2025-11-24 22:47:46 -08:00
alisonshao 173e73fa1e Fix nightly test job to fail when any test fails (#13871) 2025-11-24 19:33:46 -08:00
Even Zhouandc30031083 db0ffc09ef [NPU] Fix NPU CI (#13834)
Co-authored-by: c30031083 <chenxu140@huawei.com>
2025-11-25 10:09:36 +08:00
Zhi Yiliuandlzy a95a38078b [Fix] Fix uvloop get_event_loop() is not suitable for 0.22.x (#13612)
Signed-off-by: lzy <tomlzy213@gmail.com>
Co-authored-by: lzy <tomlzy213@gmail.com>
2025-11-25 01:20:00 +08:00
ant-yy a146f833f1 [Fix]: Adjust FutureMap's token_id_bufs Size to Prevent ChunkedPrefill's next_token_ids from Overwriting Previous Prefill Requests' next_token_id (#13713)
Signed-off-by: vito.yy <vito.yy@antgroup.com>
2025-11-25 01:08:52 +08:00
StonyPortandqiuxuan.lzw 1dd9a6ae4d Fix TorchAO quant in VLM (#13508)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
2025-11-24 22:15:40 +08:00
Liangsheng Yin 981ca8313f [misc] Rename minilb install env & remove files & fix lint (#13831) 2025-11-24 13:50:00 +08:00
Liangsheng Yin b2f7b08c49 Refactor cache init logic (#13800) 2025-11-24 11:41:46 +08:00
liuhuijiayou dbf22152d6 Fix bug: Incorrect variable used in rem_total_token_offset calculatio… (#13201) 2025-11-24 11:04:34 +08:00
Yuan Luoandluoyuan.luo 5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-22 22:45:32 +08:00
Liangsheng Yin ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Netanel Haber 3805243245 modularize gsm8k and mmmu test classes (#13506) 2025-11-22 16:06:53 +08:00
Baizhou Zhang 8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Glen Liu 53620a1b1a fix test_lora_update.py starvation message check (#13702) 2025-11-21 19:33:04 -08:00