chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,060 Commits 1 Branch 0 Tags
823a046e8f4242bf2eaaab5e2cb1589f7bfdb564
Commit Graph

9060 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Alison Shao
823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
Alison Shao
648aab0ce3 Fix wait-for-stage jobs running when call-gate fails (#17443) 2026-01-20 17:40:05 -08:00
ishandhanani
1e309030e3 update urllib3 and gpgv Dockerfile (#17439) 2026-01-20 14:47:20 -08:00
Binyao Jiang
6092721594 [Piecewise] Fix PCG issue for multimodal and embedding model that wraps language_model (#17290) 2026-01-20 14:06:06 -08:00
Binyao Jiang
38c233fd04 [Piecewise] Support PCG weak_ref_tensor cuda kernel on AMD (#17291) 2026-01-20 14:05:32 -08:00
Lianmin Zheng
20ed3822bb [Auto Sync] Update piecewise_cuda_graph_runner.py (20260119) (#17313) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2026-01-20 14:05:05 -08:00
zijiexia
4ecd9afde9 [Docs] Rename SGLang Router to SGLang Model Gateway (#17436) 2026-01-20 12:31:10 -08:00
Ruihuan He
eb38d64413 [Docs] Explain CUDA attention backend choices and aiter FP8 KV cache support (#17428) 2026-01-20 11:10:36 -08:00
Baizhou Zhang
6ea491e439 Overlap shared experts with deepep dispatch for single batch overlap on Blackwell (#17289) 2026-01-21 02:56:55 +08:00
GuoweiWangU
16802fb6b2 [FIX] fix mambaish model pp kv cache compute (#17334) 2026-01-20 23:59:05 +08:00
Ke Bao
d97066d209 Use attn_tp_group for all reduce in token embedding (#17403) 2026-01-20 23:56:21 +08:00
Ke Bao
ce2d686e94 Disable swa memory for trtllm-mha backend (#17429) 2026-01-20 23:55:00 +08:00
Qiaolin Yu
76b06bee03 [New Model] GLM4.7-Flash (#17247) 
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: JustinTong0323 <justinning0323@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-01-20 23:44:16 +08:00
BingjiaWang
612026ad2c [OPT] DeepSeekV3.2: optimize indexer weight_proj-mma performance (#17205) 2026-01-20 23:09:44 +08:00
Baizhou Zhang
55c616427d Add flag that enables NCCL mlp sync batch for overlap scheduler (#17288) 2026-01-20 23:06:55 +08:00
Ke Bao
91a4cd8648 Update default attn backend to fa3 for mimo model (#17419) 2026-01-20 21:22:27 +08:00
Shangming Cai
23d765d1f2 [Doc] Update pipeline parallelism documentation (#17414) 2026-01-20 20:10:56 +08:00
Julian Huang
db2425a00b [Fix]: correctly fetch ds32 config in tuning_fused_moe_triton (#17409) 
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
 2026-01-20 20:08:28 +08:00
amote-i
603f386c6b update docs of Ascend plateform (#17358) 2026-01-20 19:31:23 +08:00
ympcMark
f7a5e425c3 [3/N] Achieve fault tolerance at the DP level (#11657) 
Co-authored-by: UNIDY <unidy2002@outlook.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
 2026-01-20 18:47:08 +08:00
Douglas Yang
d50dcd9b61 fix: Release pr pypi fix (#17382) 2026-01-19 23:00:54 -08:00
Yuan Luo
e6b7c04947 [Kimi-Linear] Refactor kimi-linear gate calculation to avoid duplicated code (#17160) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-20 14:29:24 +08:00
Michael
a3addd6203 [AMD] Add DeepSeek-V3.2 and VLMs model in nightly tests (#17179) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-19 20:31:56 -08:00
Thomas Wang
6988a0f570 Disable mla persistent kernel when not using fp8 kv_cache (#17327) 2026-01-19 20:29:54 -08:00
Hexq0210
1b192cf198 [NPU] Update NPU doc for model and features supported (#17385) 2026-01-20 12:28:06 +08:00
Ratish P
c560e14216 [diffusion] fix: enforce 16-pixel alignment for flux2 to prevent shape mismatch crash (#17302) 2026-01-20 12:03:33 +08:00
Shangming Cai
71cb9d0302 [PD] Fix PP dynamic chunking with DP attention (#17339) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-20 11:27:13 +08:00
shuwenn
8fb45523f3 feat: support bitsandbytes quantization algorithm (#15325) 2026-01-19 18:36:56 -08:00
Raghav Ravishankar
84aef37808 fix function calling for Trinity (#17364) 2026-01-19 18:33:17 -08:00
Alison Shao
17c04b109d Enable parallel stage execution for scheduled CI runs (#16880) 2026-01-19 18:31:46 -08:00
Alison Shao
55c4288b3e Fix runner utilization workflow to use 24h default (#17378) 2026-01-19 18:31:33 -08:00
zijiexia
9f8b79f16f [Docs] Fix formatting in Evaluating New Models with SGLang (#17376) 2026-01-19 18:22:30 -08:00
b8zhong
7dc3cbe7ca [Docker] Fix CUDA 13 installing wrong nvidia-nccl-cu13 due to nixl-cu13 not breaking system package (#17370) 2026-01-20 09:52:30 +08:00
zijiexia
79ddc34c1c [Docs] Add new model evaluation docs (#17043) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
 2026-01-19 16:35:03 -08:00
Aurick Qiao
09a9d214f7 Pipe customized_info through CudaGraphRunner output (#17088) 2026-01-19 15:48:49 -08:00
Alison Shao
7e40d52635 Move test_autoround.py to stage-b-test-large-1-gpu suite (#17336) 2026-01-19 14:36:19 -08:00
Alison Shao
057b07fc50 Disable unit-test-backend-4-gpu-gb200 job (#17367) 2026-01-19 14:35:58 -08:00
Douglas Yang
91d8c52d6d fix: updating pypi workflow with new base version formatting in pyproject.toml (#17366) 2026-01-19 13:23:11 -08:00
YC Tseng
e9a44ea607 [AMD] fix perf ci errors (#17363) 2026-01-19 13:04:15 -08:00
Hudson Xing
c1282da236 fix(ci): apply MMMU retry logic to all affected test files (#17329) 2026-01-19 10:00:29 -08:00
shuwenn
71279e31f7 [CI] fix test_vlm_models.py (#17049) 2026-01-19 10:00:00 -08:00
YC Tseng
1a053a810c [AMD] CI - add partitions for stage-b-test-small-1-gpu-amd (#17345) 2026-01-19 08:16:07 -08:00
Bingxu Chen
2ea02f0642 [AMD CI] Migrate and Add More Testcases (#17116) 
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-01-19 08:07:39 -08:00
zhangheng
20b0523eca [RadixTree][1/N Refactor]: Support unified match_prefix params (#17142) 
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
 2026-01-19 22:39:40 +08:00
Ke Bao
ce8a6ac690 Evict swa kv cache during decoding (#17220) 2026-01-19 22:36:52 +08:00
ybyang
ebca5879a1 Fix v32 continue_final_message not work (#16567) 2026-01-19 21:45:39 +08:00
Xiaoyu Zhang
cc410a1088 [Diffusion] Apply qknorm to flux2 and apply lightx2v rms_norm_one_pass kernel(without residual) (#17305) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-19 21:25:33 +08:00
b8zhong
f374623fa9 [Refactor] Set fp4-gemm-backend=auto on SM100 and rename fp4-gemm-backend with flashinfer_ prefix (#17309) 2026-01-19 20:09:07 +08:00
Shu Wang
5c02217746 Inclusion of nvfp4 blockscale in EPLB Rebalance (#17158) 2026-01-19 17:45:27 +08:00
Alison Shao
8916b9d080 Migrate performance, accuracy, and quantization tests to CI registry (#17177) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-18 23:25:24 -08:00