Commit Graph

1286 Commits

Author SHA1 Message Date
Chen1022
d64bf6c6ce Support piecewise cuda graph for Qwen3-next (#13081) 2025-11-25 21:01:27 +08:00
alisonshao
dbab5d50a3 Add test_dummy_grok_models.py to not_in_ci section (#13908) 2025-11-25 16:51:25 +08:00
Xiaoyu Zhang
407cb3ce1e [CI tiny fix] Enhance robustness of vision chunked prefill test with ROUGE-L metric (#13793)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-11-25 15:41:14 +08:00
alisonshao
7cc43bd453 Move test_dummy_grok_models.py from manual to srt (temporary) (#13901) 2025-11-24 23:36:53 -08:00
Zaili Wang
cce2d748ef remove RoPE CPU fp32 tests (#13827)
Co-authored-by: Fan Yin <1106310035@qq.com>
2025-11-24 23:22:35 -08:00
Douglas Yang
ed8786b0b9 Adding nightly tests for Kimi-K2-thinking, Qwen3, minimax-m2, GLM4.6 (#13890) 2025-11-24 22:47:46 -08:00
alisonshao
173e73fa1e Fix nightly test job to fail when any test fails (#13871) 2025-11-24 19:33:46 -08:00
Even Zhou
db0ffc09ef [NPU] Fix NPU CI (#13834)
Co-authored-by: c30031083 <chenxu140@huawei.com>
2025-11-25 10:09:36 +08:00
Zhi Yiliu
a95a38078b [Fix] Fix uvloop get_event_loop() is not suitable for 0.22.x (#13612)
Signed-off-by: lzy <tomlzy213@gmail.com>
Co-authored-by: lzy <tomlzy213@gmail.com>
2025-11-25 01:20:00 +08:00
ant-yy
a146f833f1 [Fix]: Adjust FutureMap's token_id_bufs Size to Prevent ChunkedPrefill's next_token_ids from Overwriting Previous Prefill Requests' next_token_id (#13713)
Signed-off-by: vito.yy <vito.yy@antgroup.com>
2025-11-25 01:08:52 +08:00
StonyPort
1dd9a6ae4d Fix TorchAO quant in VLM (#13508)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
2025-11-24 22:15:40 +08:00
Liangsheng Yin
981ca8313f [misc] Rename minilb install env & remove files & fix lint (#13831) 2025-11-24 13:50:00 +08:00
Liangsheng Yin
b2f7b08c49 Refactor cache init logic (#13800) 2025-11-24 11:41:46 +08:00
liuhuijiayou
dbf22152d6 Fix bug: Incorrect variable used in rem_total_token_offset calculatio… (#13201) 2025-11-24 11:04:34 +08:00
Yuan Luo
5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-22 22:45:32 +08:00
Liangsheng Yin
ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Netanel Haber
3805243245 modularize gsm8k and mmmu test classes (#13506) 2025-11-22 16:06:53 +08:00
Baizhou Zhang
8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Glen Liu
53620a1b1a fix test_lora_update.py starvation message check (#13702) 2025-11-21 19:33:04 -08:00
Kangyan-Zhou
59b4d7f8d6 Fix B200 Nightly tests and move one manual test back to unit test to prevent the same issue (#13746) 2025-11-21 17:41:12 -08:00
fzyzcjy
1776dce557 Super tiny delete unused files (#13734) 2025-11-21 22:26:39 +08:00
Cheng Wan
6d0e0b9bfc [11/N] MoE Refactor: Simplifying SBO Implementation with Dispatcher Hooks (#13327)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-21 01:11:37 -08:00
Yuan Luo
475962a139 [VLM] Support Piecewise CUDA Graph for InternVL (#13640)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-21 13:21:51 +08:00
Kaixi Hou
db2d362d04 [NVIDIA] Add cutedsl e2e test to GB200 CI (#12672)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-20 18:30:12 -08:00
alisonshao
81e86992cd [CI] Move nightly tests to test/nightly/ (#13683) 2025-11-20 18:00:02 -08:00
alisonshao
6b262ac839 Test reorganization: Move tests to manual/ (#13610) 2025-11-20 13:41:58 -08:00
Glen Liu
ada8ce1fd0 allow loras to be implicitly evicted and loaded based on max_loaded_loras (#11526) 2025-11-20 13:34:32 -08:00
YanbingJiang
acde21d8d5 Add fused_rmsnorm_gated_cpu kernel for CPU to support Qwen3-Next (#11577) 2025-11-21 01:33:31 +08:00
iLeGend
10e0b83a4c Add FP32 dtype support for RoPE - Part2 (#13328) 2025-11-19 21:19:53 -08:00
Zeyu Li
21370ef7b5 [UT] Destroy process group after broadcast to resolve port occupation issues in multi-server tests (#12379) 2025-11-19 20:51:58 -08:00
Xiaoyu Zhang
dc69462456 [CI fix] Fix image download failures in VLM CI tests (#13613) 2025-11-20 11:18:06 +08:00
StonyPort
48ca9f7518 feat: support external custom models (#13429)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-20 11:16:58 +08:00
Yuan Luo
af6bcadcf7 [VLM] Support Piecewise CUDA Graph for Qwen2.5-VL (#13055)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Yuhao Yang <yhyang201@gmail.com>
2025-11-20 10:23:44 +08:00
Liangsheng Yin
196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Liangsheng Yin
a1e1e533b9 Tiny enhance test suites sanity check (#13589) 2025-11-19 22:43:58 +08:00
Even Zhou
d4a4dcdfb3 [NPU] Adapt pr-gate for pr-test workflow & workflows refresh (#13567) 2025-11-19 21:55:17 +08:00
Minglei Zhu
3798055929 purge unnecessary env variable set in deterministic test (#13481) 2025-11-18 20:43:51 -08:00
Liangsheng Yin
f7be98e113 [CI] fix amd 1 gpu basic test (#13551) 2025-11-19 11:47:41 +08:00
Sai Enduri
9a1a9a4209 [AMD CI] Local cache fallback. (#13452)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-18 19:23:45 -08:00
Chen Haozhe
6c2e5fcd91 [feat][Ascend][Mindspore]: support model-impl of mindspore (#9234) 2025-11-19 09:17:47 +08:00
gongwei-130
a9d22b751d fix lora test (#13537) 2025-11-18 12:40:35 -08:00
Junrong Lin
518467be64 [Feature] Re:Enable hybrid mem saver (#12962) 2025-11-18 21:29:15 +08:00
Nicholas
ac81db66c2 [VLM][feat] Support encoder DP for Qwen2.5-VL (#13126)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-18 16:13:18 +08:00
b8zhong
f33860777c [Piecewise CUDA Graph] Support ModelOpt FP8 (#13094) 2025-11-18 12:46:24 +08:00
Binyao Jiang
90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
Yuhao Yang
7119d188f6 [CI] re-enable test_vision_openai_server_a ci (#13444) 2025-11-17 18:32:59 -08:00
Kaixi Hou
e389f91dec [NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-17 16:13:28 -08:00
Vedant V Jhaveri
aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) 2025-11-17 15:35:18 -08:00
Kangyan-Zhou
2bc7c5ebef Fix 8-gpu B200 nightly tests (#13457) 2025-11-17 13:26:56 -08:00
Liangsheng Yin
e486308c99 Temporarily disable model hooks CI (#13450) 2025-11-18 02:35:13 +08:00