Commit Graph

30 Commits

Author SHA1 Message Date
Hudson Xing
99cb2ed988 [refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044) 2025-12-14 15:22:37 -08:00
Yuan Luo
3b8a824b8b [VLM] Support VLM ViT Piecewise CUDA Graph (#14422)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: kousakawang <wanghanpei@bytedance.com>
2025-12-13 20:49:40 +08:00
Liangsheng Yin
543d62d11a Introduce server_fixtures in sglang.test (#14899) 2025-12-11 22:30:33 +09:00
Alison Shao
f85460fb19 Avoid deleting entire cache for missing shards (#14754 follow-up) (#14853) 2025-12-11 01:17:04 -08:00
Shangming Cai
a076d75e98 [Fix] Remove unused import from test_disaggregation_hicache.py (#14880) 2025-12-11 15:50:47 +08:00
shicanwei.scw
8348725d9e [CI][BUG] fix ib setup for disaggregation hicache test (#14877)
Signed-off-by: lukotong-7 <shicanwei.scw@alibaba-inc.com>
2025-12-11 15:40:48 +08:00
Baizhou Zhang
6799847ebf [CI]Unblock and split spec v2+dp test (#14551) 2025-12-07 17:39:25 -08:00
Hudson Xing
84efe54bc4 Fix FP8 KV Triton type issue and add regression test (#14553) 2025-12-07 10:51:46 -08:00
Vladimir Serov
f124539a01 [NPU]LoRA: Adding Torch Native backend (#14132) 2025-12-08 02:16:07 +08:00
Liangsheng Yin
125e17efd5 Add small model test for spec v2 + dp + trtllm_mla (#14576) 2025-12-07 23:55:00 +08:00
Baizhou Zhang
42fcf5438f Revert "tiny remove deprecated endpoint call" (#14533) 2025-12-05 23:48:54 -08:00
b8zhong
ec7b2c16d9 tiny remove deprecated endpoint call (#13607) 2025-12-05 09:54:49 -08:00
Hudson Xing
38daa29466 Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
2025-12-06 00:53:55 +08:00
Liangsheng Yin
441420e149 Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-04 22:35:00 +08:00
Lianmin Zheng
46d7b35ec7 Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326) 2025-12-03 10:33:37 -08:00
Johnsonms
043f13171f [Performance] Optimize NSA Indexer K/S Buffer Access with Fused Triton Kernels (#13812)
Co-authored-by: Johnsonms <johnson@together.ai>
2025-12-02 18:53:06 -08:00
liupeng374
2e8f54e61e [spec-overlap] bugfix for pd disaggregation and npu (#14088)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
2025-12-01 22:58:20 +08:00
YAMY
decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
Shangming Cai
c6d34a0688 Move piecewise cuda graph test to manual dir to fix CI (#14121)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-29 00:52:01 -08:00
Yan Ru Pei
f446b51c41 fix: malformed KV events for NVIDIA Dynamo (#13488)
Signed-off-by: PeaBrane <yanrpei@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-11-28 14:55:20 -08:00
alisonshao
bce40fa217 Fix utils import issue for nightly tests (#13944) 2025-11-27 15:24:27 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
alisonshao
7cc43bd453 Move test_dummy_grok_models.py from manual to srt (temporary) (#13901) 2025-11-24 23:36:53 -08:00
Even Zhou
db0ffc09ef [NPU] Fix NPU CI (#13834)
Co-authored-by: c30031083 <chenxu140@huawei.com>
2025-11-25 10:09:36 +08:00
Liangsheng Yin
b2f7b08c49 Refactor cache init logic (#13800) 2025-11-24 11:41:46 +08:00
Kangyan-Zhou
59b4d7f8d6 Fix B200 Nightly tests and move one manual test back to unit test to prevent the same issue (#13746) 2025-11-21 17:41:12 -08:00
fzyzcjy
1776dce557 Super tiny delete unused files (#13734) 2025-11-21 22:26:39 +08:00
Kaixi Hou
db2d362d04 [NVIDIA] Add cutedsl e2e test to GB200 CI (#12672)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-20 18:30:12 -08:00
alisonshao
6b262ac839 Test reorganization: Move tests to manual/ (#13610) 2025-11-20 13:41:58 -08:00
Liangsheng Yin
196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00