Commit Graph

11116 Commits

Author SHA1 Message Date
huangtingwei
a5e5088dfb Fix errors of page head kernels in sgl-kernel for ROCm (#12604) 2025-11-10 15:15:50 +08:00
Xuchun Shang
ac19ce7efb [PP] put pp assert in model runner (#12934)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-11-10 14:58:19 +08:00
Mick
95876d75cb chore: include a minimum image for vlms when warming-up (#9528) 2025-11-10 14:56:59 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00
Liangsheng Yin
dc8a5a1ce7 [Refactor / Style] Unify all event loops (except for PP) (#12959) 2025-11-10 14:49:12 +08:00
Mick
e123648b36 diffusion: fix wan-2.2-TI2V and support sp (#12926) 2025-11-10 14:37:57 +08:00
kk
90401cf7d2 Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-11-09 21:48:36 -08:00
Atream
9cfe78dd30 clean redundant code in previous PR (#12957) 2025-11-09 21:40:32 -08:00
Mick
307e7a6128 diffusion: fix detected file changes rule in CI (#12943) 2025-11-10 13:37:16 +08:00
Atream
ddd1440d0f Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
Co-authored-by: skqliao <skqliao@gmail.com>
Co-authored-by: ovowei <1913953267@qq.com>
2025-11-09 21:06:32 -08:00
Edwin Gao
d1be60c3c5 [Refactor] rename set_index_k_and_scale_buffer to set_index_k_scale_b… (#12956) 2025-11-09 20:35:19 -08:00
Adarsh Shirawalmath
583bb1804e [Docs] Add docs for Qwen3-VL image and video support (#12554)
Co-authored-by: Ubuntu <azureuser@athena.w2cgneqjjboeneyk2w5mje3jyf.bx.internal.cloudapp.net>
2025-11-10 12:16:04 +08:00
MMuzzammil1
1f2a6c691b Bugfix: LMCache Connector with Sglang (#12946)
Signed-off-by: Mohd Muzzammil <me.muzzammil@samsung.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-10 12:13:37 +08:00
Liangsheng Yin
61c7fe7aed Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948) 2025-11-10 11:59:54 +08:00
Mick
83f89cc615 diffusion: skip full CI suite for multimodal_gen changes (#12940) 2025-11-10 10:46:24 +08:00
Ke Bao
db24d34603 Support piecewise cuda graph for MLA (#11812) 2025-11-10 09:13:48 +08:00
ishandhanani
885cfca273 ci: try to fix gpg error during kernel build (#12928) 2025-11-09 11:45:29 -08:00
Liangsheng Yin
4e916f9840 [lint] tiny fix unimported packages. (#12927) 2025-11-10 00:59:10 +08:00
Liangsheng Yin
4f65a64666 Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
2025-11-10 00:42:50 +08:00
Mick
f5b3ccd9a5 feat: basic support for server-level multimodal cache (#10775) 2025-11-10 00:27:50 +08:00
Ke Bao
bb00e24f87 Adjust server launch time in ci (#12917) 2025-11-09 20:41:29 +08:00
Liangsheng Yin
210a9cab6d [CI] Fix matrix.part in pr-test. (#12920) 2025-11-09 18:53:18 +08:00
Teng Ma
b8ac4fcb51 [PD] feat: refactor custom mem pool and add barex pd support (#12332) 2025-11-09 18:51:34 +08:00
Liangsheng Yin
877cb52840 [CI] increase ut buckets & adjust estimation time. (#12919) 2025-11-09 18:17:50 +08:00
Zijian Zhang
3633f8b0cf Add Jet-Nemotron (#12448) 2025-11-09 01:32:47 -08:00
Kangyan-Zhou
93cf60fc64 Fix Deepseek nightly tests (#12906) 2025-11-09 00:26:06 -08:00
Ke Bao
b5e0417392 Add kimi k2 thinking to ci (#12907) 2025-11-09 16:10:32 +08:00
Minglei Zhu
8a821af793 fallback to triton mm_persistent kernel when deepGemm fail (#12911) 2025-11-08 23:42:26 -08:00
Kangyan-Zhou
4b1d163bfd Add HF cleanup logic in ci_install_dependency.sh (#12895) 2025-11-08 22:56:25 -08:00
Kangyan-Zhou
c21a3ec299 Fix duplicate nightly test name (#12905) 2025-11-08 21:38:48 -08:00
Ke Bao
b142831a26 Fix empty server args in marlin moe test (#12904) 2025-11-09 13:30:47 +08:00
Kangyan-Zhou
d134096319 Add Deepseek models into nightly tests (#12865) 2025-11-09 13:17:49 +08:00
Qiaolin Yu
f290e8016e Revert "Fix spec decoding acc length for dpsk-r1-fp4 tp8" (#12900) 2025-11-08 20:42:42 -08:00
Qiaolin Yu
9299a62fcb Fix spec decoding acc length for dpsk-r1-fp4 tp8 (#12896) 2025-11-08 19:55:45 -08:00
Liangsheng Yin
49543be9da Tiny simplify can_run_dp_cuda_graph gather logic (#12891) 2025-11-09 11:15:36 +08:00
Ke Bao
5236290399 Update CODEOWNERS (#12897) 2025-11-09 09:37:11 +08:00
sglang-bot
b2b26d4324 chore: bump sgl-kernel version to 0.3.16.post6 (#12889) 2025-11-09 09:16:28 +08:00
alisonshao
d3a03aeef8 Refs/heads/add nightly test multi gpu configs (#12870) 2025-11-08 15:14:50 -08:00
Baizhou Zhang
5f02b918ec [Fix] Fix trtllm-mla backend when chunked prefix cache is disabled (#12361) 2025-11-08 15:10:25 -08:00
b8zhong
49653c8896 use fast stream instead of torch.cuda.current_stream in llama 4 shared experts overlap (#12811) 2025-11-08 15:04:37 -08:00
Ke Bao
44f594d832 Apply moe_reduce_sum kernel for fused_marlin_moe (#12888) 2025-11-09 01:31:05 +08:00
fzyzcjy
2b6c4257a0 Fix sending all requests to the first rank in DP attention (#12832) 2025-11-09 00:18:53 +08:00
Liangsheng Yin
243ea585fc [DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843) 2025-11-08 23:23:14 +08:00
Liangsheng Yin
6fee2c535c [CI] Tiny adjust CI esitmation time (#12886) 2025-11-08 23:02:19 +08:00
Charles Chen
f1a9c72de3 Support capturing aux_hidden_states for minimax m2. (#12798) 2025-11-08 01:54:22 -08:00
YAMY
190002c613 [Docs][DeepseekV3.2] Update deepseekv3.2 docs for mha short seq prefill (#12868) 2025-11-08 00:11:02 -08:00
Lianmin Zheng
0296f1cdad [Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-07 22:07:51 -08:00
Baizhou Zhang
e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
hlu1
b8ddc296f4 [sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-07 18:33:27 -08:00
alisonshao
0b88d520a0 Add nightly performance test for GPT-OSS 4GPU models (#12805) 2025-11-07 16:54:07 -08:00