Commit Graph

9494 Commits

Author SHA1 Message Date
ishandhanani
8f8c1724ae docker: add patch to increase GPU deepep timeout (#18298) 2026-02-05 18:26:15 +08:00
Shangming Cai
afae4c7178 [PD] Minor code cleanup for mooncake backend (#18279)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-02-05 17:38:09 +08:00
zhangheng
079fc8f3c5 [piecewise graph]: support MiniMax-M2 (#18217) 2026-02-04 23:24:38 -08:00
danielafrimi
3f1df322f9 [FIX] Always support TP > 4 for FP4 Gemm (#17300) 2026-02-05 15:10:26 +08:00
Meng, Hengyu
368936a62b [XPU] Integrate MoE and minor improvements in XPU attention backend (#13561) 2026-02-04 23:09:59 -08:00
Xiaoyu Zhang
dff3ba202a [Diffusion] Support layerwise offload for mova (#18272) 2026-02-05 13:16:07 +08:00
Alison Shao
c910829708 Fix test_return_routed_experts to use response-level sglext (#18274) 2026-02-04 20:16:01 -08:00
Kun Lin
e616d35847 Support Markdown/Notebook-Friendly Documentation Export for Downstream Integration(convert rat files to md files and save) (#18278) 2026-02-04 19:59:40 -08:00
rinbaro
de6a03260f [docs] fix misspellings & typos (#18276) 2026-02-05 03:35:29 +00:00
Teng Ma
c8212b9fac [PD] doc: Document SGLANG_MOONCAKE_CUSTOM_MEM_POOL and supported values (#18259)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-02-05 03:03:33 +00:00
Ch3ngY1
f730c18679 [PD] improve kv offset calculation for MHA model with different tp size (#18163)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-02-05 10:43:23 +08:00
Mick
f218234e4f [diffusion] chore: prohibit Chinese characters usage (#18249) 2026-02-05 09:22:26 +08:00
yinghui
599c5f4922 fix kimi k2.5's moe gemm config init (#18064) 2026-02-04 16:59:01 -08:00
zwang86
bdaf3de9b3 fix: add SGLANG_IS_IN_CI env var to release-docs workflow (#18225)
Co-authored-by: Zeyu Wang <zeyu.wang@yahooinc.com>
Co-authored-by: edwingao28 <edwingao28@users.noreply.github.com>
2026-02-04 15:49:41 -08:00
linhaifeng
c1d5cc3b24 [Bugfix] fix a obvious logic error (#18254) 2026-02-04 13:59:58 -08:00
Mohammad Miadh Angkad
efbf39583e Add MoE fused config for Qwen3-Coder-Next-FP8 on H100 TP=2 (#18195) 2026-02-04 13:36:35 -08:00
Zack Yu
2e87c2bd5e fix: fix MockModelRunner in attention tests (#18240) 2026-02-04 13:18:02 -08:00
Michael
6fd878b41d [AMD] Add kimi mi35x nightly test, folder organization and several stability fixes (#17895) 2026-02-04 12:03:57 -08:00
Mick
36a3e78af9 [diffusion] refactor: move model_stages into stages folder (#18248) 2026-02-05 00:23:31 +08:00
RunningLeon
3e7ecb78a6 model: support interns1-pro (#18145)
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
2026-02-05 00:22:44 +08:00
RunningLeon
a6f53cc5e3 entrypoint: support passing spaces_between_special_tokens per request (#17939) 2026-02-04 22:18:36 +08:00
wxy
4c403045ec [diffusion] fix: fix the bug of redundant memory usage on GPU-0 (#18221) 2026-02-04 21:25:23 +08:00
Zhang Yiyang (SII)
0c9a0adc53 [diffusion] chore: clean MOVA codes (#18107) 2026-02-04 21:23:41 +08:00
BingjiaWang
760ae933bb optimize get_topk_ragged by fusing get k and k_scale triton kernel (#16043)
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
2026-02-04 19:59:41 +08:00
Nicolas Castet
315306d8a9 Make sure we always disable symm memory without dp padding (#18129) 2026-02-04 19:58:28 +08:00
Jincong Chen
a72f4f839c Tiny fix for fp8 moe backend flashinfer_trtllm naming (#18243) 2026-02-04 19:58:04 +08:00
Evrard-Nil
ce02df8592 [diffusion] logging: downgrade default prompt log from info to debug (#17813)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-02-04 19:19:02 +08:00
Xiaoyu Zhang
2e9d0442e2 [diffusion] update code owner (#18247) 2026-02-04 19:12:32 +08:00
Cheng Wan
84c09913eb Moving _alloc_extend_naive out of npu allocator (#18200) 2026-02-04 02:09:55 -08:00
zhangheng
be557cbc5f [RadixTree][5/N Refactor]: Introduce pre and post-processing methods for key matching (#18147) 2026-02-04 17:10:46 +08:00
Baizhou Zhang
d279520ba5 [DeepGemm] Add a flag for fast warmup (#18111) 2026-02-04 14:12:13 +08:00
Jianying
4739f2e8d5 [diffusion] kernel: gated residual layernorm scale shift and layernorm scale shift kernel fusion for Qwen-Image, WAN and HunyuanVideo (#14717)
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <joeyzhu@nvidia.com>
Co-authored-by: root <root@a4u8g-0120.ipp2a2.colossus.nvidia.com>
Co-authored-by: Yihan Chen <yingluosanqian@example.com>
Co-authored-by: 陈一涵 <yingluosanqian@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-02-04 13:46:20 +08:00
Kun Lin
669a9bd180 Support Markdown/Notebook-Friendly Documentation Export for Downstream Integration (copy all markdown and rst files) (#18223) 2026-02-03 20:53:17 -08:00
Douglas Yang
b7c1dfc602 fix: bumping nightly whl version (#18212) 2026-02-03 20:43:38 -08:00
strgrb
37c33cc0aa fuse qkvbfg linear into one gemm and f_b g_b into batched gemm. (#17801) 2026-02-04 11:41:26 +08:00
Aurick Qiao
c1d529c196 Fix Session for multimodal and expose it through Engine (#18152) 2026-02-04 10:33:27 +08:00
Qi Jia
1f72f66c6d [Docs] fix readme typo (#18207) 2026-02-03 17:37:28 -08:00
wxy
da758ed601 [diffusion] fix: fix server cache-dit bug under continuous dynamic requests (#17140) 2026-02-04 09:03:37 +08:00
Douglas Yang
ae004e15c9 fix: ensuring nightly whls are tagged with latest commit (#18204) 2026-02-03 15:54:41 -08:00
satyamk7054
793bf9fc06 Update weight rename check for Qwen3 Embeddings (#17535) 2026-02-03 13:55:11 -08:00
Hudson Xing
e867040fc6 add streaming parallel tool call test case (#18097) 2026-02-03 12:46:01 -08:00
R0CKSTAR
7de650c83c [diffusion] hardware: support diffusion models on MTGPU (doc, 6/N) (#17346)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:44:57 -08:00
R0CKSTAR
ec2461bc16 [diffusion] hardware: support diffusion models on MTGPU (multi-GPU, 5/N) (#17318)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:44:22 -08:00
R0CKSTAR
acf724b036 [Diffusion] Only import sgl_kernel in custom op cuda path (SiluAndMul and RMSNorm) (#15592)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-02-03 12:42:58 -08:00
Vladislav Nosivskoy
e166ca8758 [HiCache] feat: Add detailed cache hit breakdown for HiCache in sglext and Prometheus metrics (#17648)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
2026-02-03 11:45:35 -08:00
Even Zhou
d48bbe3bed [CI][NPU] Bugfix import sgl-kernel error (#18173) 2026-02-03 11:39:38 -08:00
DiweiSun
495290aefd enable ut test for xpu devices (#11712)
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
2026-02-03 11:15:14 -08:00
ishandhanani
0a6925639b ci: improve docker for cu13 builds (#18194) 2026-02-03 11:09:38 -08:00
Kangyan-Zhou
0db6fd4dbe Revert broken sgl_kernel exclusion patterns in paths-filter (#18193) 2026-02-03 10:56:44 -08:00
ishandhanani
820df545f2 fix: add cu13 dev container to our release (#18192) 2026-02-03 10:42:05 -08:00