Commit Graph
454 Commits
Author SHA1 Message Date
Yuwei An 9d0347b33a EP Support for Piecewise Cuda Graph (#14164)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-12-20 01:59:27 +08:00
Zehuan Li b2803ff207 [DLLM] Add CI for diffusion LLMs (#14723) 2025-12-19 08:54:03 +08:00
Shangming Cai 17e81c750a [PP] Add dynamic chunking PP test (#15395)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-12-19 01:09:40 +08:00
Alison Shao 58c840db6b Split test_piecewise_cuda_graph.py to optimize CI resource usage (#15290) 2025-12-17 21:20:21 -08:00
Douglas Yang 9e7656be80 fix: adjust time for test_epd_disaggregation.py (#15354) 2025-12-17 18:30:52 -08:00
Alison Shao 4128d4f5cb [CI] Migrate LoRA tests to test/registered/lora/ (#15176) 2025-12-17 13:19:42 -08:00
b8zhong ffa7e03506 [Piecewise CUDA Graph] Support INT8 (#14918) 2025-12-17 18:20:57 +08:00
Alison Shao 49237e26fb Fix test_pp_single_node.py estimated time from 800s to 500s (#15291) 2025-12-16 16:27:09 -08:00
Shangming Cai 6682475124 [CI] Improve flaky 4 GPU test success rate (#15234) 2025-12-17 00:02:26 +08:00
Shangming Caiandybyang 36fcf71fff [Qwen3-next] Add PD disaggregation support for mamba with extra_buffer (#15180)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
2025-12-16 14:36:00 +08:00
XDaoHongandZhengdQin 4733fcff1f [Feature] npu support enable_torch_compile for torchair backend (#13410)
Co-authored-by: ZhengdQin <zhengdqin@gmail.com>
2025-12-16 09:23:51 +08:00
Hanming Lu e61dabf5e4 [Qwen3-next] support mamba radix cache for overlap scheduler (#14792) 2025-12-14 18:54:16 -08:00
9acb21ae27 feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
2025-12-14 22:30:08 +08:00
Qiaolin Yu 729529190d [ci] Move dpsk-r1-fp4 b200 test to stage b (#15084) 2025-12-13 23:14:08 -08:00
Kangyan-Zhou b243154614 Fix CI by reverting incorrect metric check logic (#15004) 2025-12-12 10:07:38 -08:00
Alison Shao e59435c34b Add retry logic for scheduled CI tests (#14771) 2025-12-11 16:59:58 -08:00
Vladimir221andronnie_zheng 27032cecd9 [Ascend]Support of piecewise graph compilation for prefill on NPU (#12287)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-12-11 21:10:07 +08:00
Yuan Luoandluoyuan.luo 03836d85d2 [GLM-4.6V] Support Pipeline Parallelism for GLM-4.6V & GLM-4.1V (#14720)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-10 16:40:12 +08:00
b8zhong 56e5c07424 fix b200 fa4 ci (#14788) 2025-12-10 00:03:43 -08:00
b8zhong b0a25d0913 fix b200 ci (#14786) 2025-12-09 23:08:41 -08:00
0c63fb9420 [Feature] Add LoRA support for embedding layers (#14177)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Beichen-Ma <bm685@cornell.edu>
2025-12-09 15:53:33 -08:00
b8zhong 55504df2f7 Add FP8 Blockwise GEMM Backend Flag --fp8-gemm-backend (#14379) 2025-12-09 12:05:56 -08:00
Xiaoyu Zhang 53d170883a Add fuse_marlin_moe test to ci and add new ep test (#14686) 2025-12-09 20:17:38 +08:00
Alison Shao 9a426fc5ef [CI] Move mistral large 3 basic to nightly (#14622) 2025-12-09 00:28:44 -08:00
Alison Shao e6f0ddda44 [CI] Migrate Eagle 1-GPU tests to test/registered/ (#14529) 2025-12-09 12:56:36 +09:00
Baizhou Zhang e5201bda34 [CI] Unblock gb200 cutedsl test (#14469) 2025-12-08 17:58:25 -08:00
Baizhou Zhang 6799847ebf [CI]Unblock and split spec v2+dp test (#14551) 2025-12-07 17:39:25 -08:00
b8zhongandBrayden Zhong 3b47973af8 [CI] Tiny speed up VLM CI (#14517)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-12-07 13:30:41 -08:00
khalilzhk 948b6acee8 [BugFix] fix prefixcache performance and accuracy on ascend (#13573) 2025-12-08 02:16:20 +08:00
Hanming Lu e592ee6545 [Qwen3-next] remove heuristics and add radix cache kl test (#14520) 2025-12-06 12:11:40 -08:00
Alison Shao 16e8463a90 Add Mistral Large 3 basic test to PR CI (#14460) 2025-12-05 10:38:52 -08:00
Xinyuan TongandYueming Yuan 6d37e70883 ministral3 (#14251)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
2025-12-04 14:31:26 -08:00
Ma Mingfei f90b400431 [CPU] add support for mamba causal conv1d for qwen3-next (#12309) 2025-12-04 13:41:42 +08:00
blzheng 974c562a25 [CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330) 2025-12-03 23:46:08 +08:00
Cheng Wan 96cc10834a [CI] update estimated elapsed time of some unittests (#14347) 2025-12-03 01:21:40 -08:00
Xuan Liao c233e9d7a9 [CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441) 2025-12-03 17:03:48 +08:00
Yuan Luoandluoyuan.luo 26aebf83d3 [VLM] Support Piecewise CUDA Graph for Qwen3-Omni-MOE (#14222)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-02 10:12:10 +08:00
liupeng374andEven Zhou 2e8f54e61e [spec-overlap] bugfix for pd disaggregation and npu (#14088)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
2025-12-01 22:58:20 +08:00
Liangsheng Yin 0a9d64530d Support grammar + spec + reasoning (#14163) 2025-11-30 21:19:57 +08:00
fzyzcjy 36b729c2b8 Implement profiler v2 and fix stage mixture bug (#14148) 2025-11-30 16:59:52 +08:00
Cheng WanandKangyan Zhou 0fe74af563 Remove incorrect deep_gemm assertions from server_args.py (#14113)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
2025-11-28 20:25:39 -08:00
Kangyan-Zhou a102a0507a Disable Deepep 2 GPU tests (#14111) 2025-11-28 13:56:34 -08:00
Kangyan-Zhou 4c9f7c97d3 Temporarily disabled test (#14069) 2025-11-27 14:58:46 -08:00
Yixin DongandLiangsheng Yin 6350042696 feat: Naive support Spec V2 + Constrained Decoding (#13425)
Signed-off-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-11-27 20:31:46 +08:00
Netanel Haber 082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
alisonshao 5b7da0f58e Temporarily disable test_update_weights_from_disk.py in CI (#14021) 2025-11-26 13:56:28 -08:00
Fan YinandBaizhou Zhang 36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
alisonshao dbab5d50a3 Add test_dummy_grok_models.py to not_in_ci section (#13908) 2025-11-25 16:51:25 +08:00
Even Zhouandc30031083 db0ffc09ef [NPU] Fix NPU CI (#13834)
Co-authored-by: c30031083 <chenxu140@huawei.com>
2025-11-25 10:09:36 +08:00
Yuan Luoandluoyuan.luo 5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-22 22:45:32 +08:00