Commit Graph

9885 Commits

Author SHA1 Message Date
Sai Enduri
b51d46d092 [AMD CI] Remove SRT docker build. (#11850)
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
2025-11-10 11:25:37 -08:00
Liangsheng Yin
1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
Liangsheng Yin
665416f6dd Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224) 2025-11-11 02:56:22 +08:00
Chang Su
838bcb0d93 [misc][ci] Add run-ci after auto-labeler (#13013) 2025-11-10 10:41:54 -08:00
Liangsheng Yin
f1f4c451ab Add process_prefill_chunk back to fix PP event loop (#13009) 2025-11-11 00:51:36 +08:00
fzyzcjy
b0ee99dd03 Super tiny fix typo (#13001) 2025-11-11 00:47:45 +08:00
Mick
ddfcb7c8ab minor: fix notebook bug with new model_info fields added for warmup (#13005) 2025-11-11 00:46:12 +08:00
Ke Bao
58b12ccb46 Support piecewise cuda graph for deepseek v3 (#12996) 2025-11-10 23:18:03 +08:00
Xiaoyu Zhang
547de8c774 [1 / 2] register weak_ref_tensor in sgl-kernel (#12999) 2025-11-10 22:12:59 +08:00
sglang-bot
37c40a87a8 chore: bump sgl-kernel version to 0.3.17 (#12966) 2025-11-10 21:50:58 +08:00
Yuhao Yang
1240ac13b8 vlm: fix tiny multimodal cache bug (#12984) 2025-11-10 21:30:19 +08:00
Mick
5639145fac diffusion: reduce effort of supporting new model (#12982) 2025-11-10 21:20:33 +08:00
ShawnKung
afee2843d5 feat(metrics): add scheduler and hiradix cache metrics (#10218) (#10225)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-11-10 18:14:47 +08:00
Zhihao Zhang
6f08488042 fix missing output_token_logprobs when using ngram speculative decoding (#10702)
Co-authored-by: a4zhangfei <a4zhangfei@qq.com>
2025-11-10 02:04:42 -08:00
syy-hw
611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
Lianmin Zheng
9ea2c686c7 [Auto Sync] Update batch_invariant_ops.py (20251109) (#12916)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-10 01:51:39 -08:00
PiteXChen
e2a784ecda [RadixTree] Reduce Syscalls, Optimize Collection Filtering and Align with cpp (#12239)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
2025-11-10 17:47:59 +08:00
Xiaoyu Zhang
05559a4a90 Support hidden_dim % 4 == 0 in per_token_quant_fp8 (#12883) 2025-11-10 17:13:14 +08:00
Neelabh Sinha
7bffc5dc25 [Fix] Add validation for served model name to reserve : for LoRA adapter syntax (#12912)
Co-authored-by: neelabhsinha <neelabhsinha97@gmail.com>
2025-11-09 23:42:02 -08:00
huangtingwei
a5e5088dfb Fix errors of page head kernels in sgl-kernel for ROCm (#12604) 2025-11-10 15:15:50 +08:00
Xuchun Shang
ac19ce7efb [PP] put pp assert in model runner (#12934)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
2025-11-10 14:58:19 +08:00
Mick
95876d75cb chore: include a minimum image for vlms when warming-up (#9528) 2025-11-10 14:56:59 +08:00
sglang-bot
a30f190762 chore: bump sgl-kernel version to 0.3.17 (#12931) 2025-11-10 14:54:02 +08:00
Liangsheng Yin
dc8a5a1ce7 [Refactor / Style] Unify all event loops (except for PP) (#12959) 2025-11-10 14:49:12 +08:00
Mick
e123648b36 diffusion: fix wan-2.2-TI2V and support sp (#12926) 2025-11-10 14:37:57 +08:00
kk
90401cf7d2 Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803)
Co-authored-by: wunhuang <wunhuang@amd.com>
2025-11-09 21:48:36 -08:00
Atream
9cfe78dd30 clean redundant code in previous PR (#12957) 2025-11-09 21:40:32 -08:00
Mick
307e7a6128 diffusion: fix detected file changes rule in CI (#12943) 2025-11-10 13:37:16 +08:00
Atream
ddd1440d0f Refactor KTransformers heterogeneous compute with unified GPU-quantization backend (#12834)
Co-authored-by: Chen Hongtao <56470055+chenht2022@users.noreply.github.com>
Co-authored-by: chenht2022 <cht22@mails.tsinghua.edu.cn>
Co-authored-by: skqliao <skqliao@gmail.com>
Co-authored-by: ovowei <1913953267@qq.com>
2025-11-09 21:06:32 -08:00
Edwin Gao
d1be60c3c5 [Refactor] rename set_index_k_and_scale_buffer to set_index_k_scale_b… (#12956) 2025-11-09 20:35:19 -08:00
Adarsh Shirawalmath
583bb1804e [Docs] Add docs for Qwen3-VL image and video support (#12554)
Co-authored-by: Ubuntu <azureuser@athena.w2cgneqjjboeneyk2w5mje3jyf.bx.internal.cloudapp.net>
2025-11-10 12:16:04 +08:00
MMuzzammil1
1f2a6c691b Bugfix: LMCache Connector with Sglang (#12946)
Signed-off-by: Mohd Muzzammil <me.muzzammil@samsung.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-10 12:13:37 +08:00
Liangsheng Yin
61c7fe7aed Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948) 2025-11-10 11:59:54 +08:00
Mick
83f89cc615 diffusion: skip full CI suite for multimodal_gen changes (#12940) 2025-11-10 10:46:24 +08:00
Ke Bao
db24d34603 Support piecewise cuda graph for MLA (#11812) 2025-11-10 09:13:48 +08:00
ishandhanani
885cfca273 ci: try to fix gpg error during kernel build (#12928) 2025-11-09 11:45:29 -08:00
Liangsheng Yin
4e916f9840 [lint] tiny fix unimported packages. (#12927) 2025-11-10 00:59:10 +08:00
Liangsheng Yin
4f65a64666 Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
2025-11-10 00:42:50 +08:00
Mick
f5b3ccd9a5 feat: basic support for server-level multimodal cache (#10775) 2025-11-10 00:27:50 +08:00
Ke Bao
bb00e24f87 Adjust server launch time in ci (#12917) 2025-11-09 20:41:29 +08:00
Liangsheng Yin
210a9cab6d [CI] Fix matrix.part in pr-test. (#12920) 2025-11-09 18:53:18 +08:00
Teng Ma
b8ac4fcb51 [PD] feat: refactor custom mem pool and add barex pd support (#12332) 2025-11-09 18:51:34 +08:00
Liangsheng Yin
877cb52840 [CI] increase ut buckets & adjust estimation time. (#12919) 2025-11-09 18:17:50 +08:00
Zijian Zhang
3633f8b0cf Add Jet-Nemotron (#12448) 2025-11-09 01:32:47 -08:00
Kangyan-Zhou
93cf60fc64 Fix Deepseek nightly tests (#12906) 2025-11-09 00:26:06 -08:00
Ke Bao
b5e0417392 Add kimi k2 thinking to ci (#12907) 2025-11-09 16:10:32 +08:00
Minglei Zhu
8a821af793 fallback to triton mm_persistent kernel when deepGemm fail (#12911) 2025-11-08 23:42:26 -08:00
Kangyan-Zhou
4b1d163bfd Add HF cleanup logic in ci_install_dependency.sh (#12895) 2025-11-08 22:56:25 -08:00
Kangyan-Zhou
c21a3ec299 Fix duplicate nightly test name (#12905) 2025-11-08 21:38:48 -08:00
Ke Bao
b142831a26 Fix empty server args in marlin moe test (#12904) 2025-11-09 13:30:47 +08:00