chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
JiaruiChang5268
a95c9f5b81 [NPU] Remove paged attention & Change fia to default attention (#17394) 
Co-authored-by: Liwansi <62291011+Liwansi@users.noreply.github.com>
Co-authored-by: chenxu214 <justin_cc2025@163.com>
Co-authored-by: chenyang08056032 <chenyang08056032@163.com>
 2026-01-21 23:58:25 +08:00
Xiaoyu Zhang
19089aa431 [Diffusion] Refactor diffusion is_cuda check (#17498) 2026-01-21 23:02:24 +08:00
Qiaolin Yu
4f6f5d25c8 Support fa4 decoding (#16034) 2026-01-21 22:54:02 +08:00
Yi Zhong
458fe5a337 [docs] Show user the fastAPI docs available (#17510) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-01-21 14:26:25 +00:00
b8zhong
2ff0880a0e [Fix] GLM 4.7 + NVFP4 + MTP (#17166) 2026-01-21 21:34:18 +08:00
Zhu Yuhua
2c1b164a92 [diffusion] improve: skip negative prompt encoding when guidance_scale <= 1.0 or negative_prompt is None (#16919) 
Signed-off-by: zhuyuhua-v <yuhzhu@amd.com>
 2026-01-21 20:01:55 +08:00
strgrb
bcc6d84f93 Use fused_sigmoid_gating_delta_rule_update_kernel for KDA (#17108) 2026-01-21 19:24:29 +08:00
Ke Bao
a618202fc7 Tiny refine swa kv cache free (#17417) 2026-01-21 19:20:05 +08:00
siyu
7520b92927 Support EPD error handling (#16670) 
Co-authored-by: ZhengWG <zwg0606@gmail.com>
 2026-01-21 18:47:00 +08:00
Fan Lin
e7224e9681 [diffusion] fix: fix the LoRA weights mismatch caused by weights packing (#17355) 2026-01-21 18:17:16 +08:00
HuangJi
e776239afd [diffusion] feat: support SageSparseLinearAttention attention backend (#17399) 2026-01-21 18:13:51 +08:00
Yi Zhang
1b97fa769b [BUGFIX] fix value oom in radix tree (#17400) 2026-01-21 17:12:57 +08:00
Yi Zhang
236772c0e1 [RadixTree][2/N Refactor]: swa cache init tiny refactor (#17397) 2026-01-21 15:48:30 +08:00
Sam Shleifer
0d49b13fdd Fix circular import in quantization modules (#17372) 2026-01-21 15:47:09 +08:00
blahblah
0a7a2017a0 [diffusion] refactor: refactor and simplify teacache for cachabledit and wanvideo (#16396) 
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: blahblah <blahblah>
 2026-01-21 15:42:45 +08:00
amote-i
0a9099e137 update ascend docs (#17457) 2026-01-21 15:36:26 +08:00
Alison Shao
0050c476fd Add job-level timeout for weekly test workflow (#17462) 2026-01-20 22:45:39 -08:00
Baizhou Zhang
8251a74d5f [Tiny] Backward compatibility for fp4 gemm flags (#17466) 2026-01-21 14:34:40 +08:00
Baizhou Zhang
a54d75bf2e [Fix] Set fa3 as default MHA backend on Hopper (#17425) 2026-01-21 13:54:09 +08:00
Alison Shao
3321eb4efa Fix pr-test-finish to fail when wait-for-stage jobs fail (#17465) 2026-01-20 20:50:27 -08:00
Kangyan-Zhou
be5121b452 Fix NSA indexer in the nightly test (#17452) 2026-01-20 19:58:13 -08:00
Baizhou Zhang
c3f9c30f99 [Minor] Change lora_target_modules to "all" in CI tests (#17386) 2026-01-21 11:46:36 +08:00
Fan Lin
54a821794e [diffusion] fix: fix the bug of output_path not taking effect when generate (#17293) 2026-01-21 11:39:51 +08:00
khalilzhk
aca354bcb3 [NPU] remove features supported on Ascend NPU (#17455) 2026-01-21 11:00:04 +08:00
Yinghai Lu
aea57b33c6 [scheduler] Clear MM data of finished batch (#17251) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-20 17:45:38 -08:00
Alison Shao
823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
Alison Shao
648aab0ce3 Fix wait-for-stage jobs running when call-gate fails (#17443) 2026-01-20 17:40:05 -08:00
ishandhanani
1e309030e3 update urllib3 and gpgv Dockerfile (#17439) 2026-01-20 14:47:20 -08:00
Binyao Jiang
6092721594 [Piecewise] Fix PCG issue for multimodal and embedding model that wraps language_model (#17290) 2026-01-20 14:06:06 -08:00
Binyao Jiang
38c233fd04 [Piecewise] Support PCG weak_ref_tensor cuda kernel on AMD (#17291) 2026-01-20 14:05:32 -08:00
Lianmin Zheng
20ed3822bb [Auto Sync] Update piecewise_cuda_graph_runner.py (20260119) (#17313) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2026-01-20 14:05:05 -08:00
zijiexia
4ecd9afde9 [Docs] Rename SGLang Router to SGLang Model Gateway (#17436) 2026-01-20 12:31:10 -08:00
Ruihuan He
eb38d64413 [Docs] Explain CUDA attention backend choices and aiter FP8 KV cache support (#17428) 2026-01-20 11:10:36 -08:00
Baizhou Zhang
6ea491e439 Overlap shared experts with deepep dispatch for single batch overlap on Blackwell (#17289) 2026-01-21 02:56:55 +08:00
GuoweiWangU
16802fb6b2 [FIX] fix mambaish model pp kv cache compute (#17334) 2026-01-20 23:59:05 +08:00
Ke Bao
d97066d209 Use attn_tp_group for all reduce in token embedding (#17403) 2026-01-20 23:56:21 +08:00
Ke Bao
ce2d686e94 Disable swa memory for trtllm-mha backend (#17429) 2026-01-20 23:55:00 +08:00
Qiaolin Yu
76b06bee03 [New Model] GLM4.7-Flash (#17247) 
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: JustinTong0323 <justinning0323@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-01-20 23:44:16 +08:00
BingjiaWang
612026ad2c [OPT] DeepSeekV3.2: optimize indexer weight_proj-mma performance (#17205) 2026-01-20 23:09:44 +08:00
Baizhou Zhang
55c616427d Add flag that enables NCCL mlp sync batch for overlap scheduler (#17288) 2026-01-20 23:06:55 +08:00
Ke Bao
91a4cd8648 Update default attn backend to fa3 for mimo model (#17419) 2026-01-20 21:22:27 +08:00
Shangming Cai
23d765d1f2 [Doc] Update pipeline parallelism documentation (#17414) 2026-01-20 20:10:56 +08:00
Julian Huang
db2425a00b [Fix]: correctly fetch ds32 config in tuning_fused_moe_triton (#17409) 
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
 2026-01-20 20:08:28 +08:00
amote-i
603f386c6b update docs of Ascend plateform (#17358) 2026-01-20 19:31:23 +08:00
ympcMark
f7a5e425c3 [3/N] Achieve fault tolerance at the DP level (#11657) 
Co-authored-by: UNIDY <unidy2002@outlook.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
 2026-01-20 18:47:08 +08:00
Douglas Yang
d50dcd9b61 fix: Release pr pypi fix (#17382) 2026-01-19 23:00:54 -08:00
Yuan Luo
e6b7c04947 [Kimi-Linear] Refactor kimi-linear gate calculation to avoid duplicated code (#17160) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-20 14:29:24 +08:00
Michael
a3addd6203 [AMD] Add DeepSeek-V3.2 and VLMs model in nightly tests (#17179) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-19 20:31:56 -08:00
Thomas Wang
6988a0f570 Disable mla persistent kernel when not using fp8 kv_cache (#17327) 2026-01-19 20:29:54 -08:00
Hexq0210
1b192cf198 [NPU] Update NPU doc for model and features supported (#17385) 2026-01-20 12:28:06 +08:00