chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Liangsheng Yin
3c358736d1 Enhance test for dp-attention + constrained decoding. (#16849) 2026-01-10 16:49:10 +08:00
Glen Liu
6327dff242 enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333) 2026-01-10 16:49:00 +08:00
Zhiqiang Xie
675acecec6 Attention backend selection bug fix for hicache (#16779) 
Co-authored-by: hxie <haiyong.xie@ustc.edu>
 2026-01-10 00:22:41 -08:00
Yuan Luo
ad20127359 [CI] Remove duplicate code in test_mamba_ut (#16854) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-10 16:16:56 +08:00
Baizhou Zhang
7f393d9512 [Docker] Add nightly dev docker for Cuda 13 (#16862) 2026-01-10 14:56:53 +08:00
Shangming Cai
4b14f622e1 [CI] Add PD Disaggregation aarch64 test (#16572) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-10 14:44:54 +08:00
Baizhou Zhang
94fc26aad8 [Doc]Update note for Cuda 13 container usage (#16805) 2026-01-10 14:03:19 +08:00
Insideyyy
67b61a4e8d [Rework] Add SwapAB Optimization for triton fused_moe_kernel on SM90. (#16723) 2026-01-10 13:57:44 +08:00
Shifang Xu
d27f16f38a Fix EPLB + FP4 Quantization Compatibility Issue (#13715) 
Co-authored-by: Shu Wang <shuw@nvidia.com>
 2026-01-10 13:38:19 +08:00
fzyzcjy
c89949bbaf Tiny let soft watchdog cover initialization phase (#16853) 2026-01-10 13:20:08 +08:00
Ziang Li
20abaee26c [DSv32] Overlap indexer weights_proj during dual_stream decode (#16637) 
Co-authored-by: Ziang Li <ziangli@humansand.ai>
 2026-01-10 13:06:44 +08:00
fzyzcjy
32a569fb77 Tiny add CPU resource monitoring for overload diagnosis (#16852) 2026-01-10 12:48:18 +08:00
fzyzcjy
3ed3b7ef7c Tiny add routing key distribution metrics (#16847) 2026-01-10 12:06:40 +08:00
fzyzcjy
1f9d4795a9 Tiny add gauge histogram abstraction for engine and router (#16848) 2026-01-10 11:45:25 +08:00
Liangsheng Yin
e6d40bff81 Revert "feat: reduce constrained-decoding overhead in TP" (#16845) 2026-01-10 11:39:38 +08:00
若可
fbc128a32e fix(function_call): group batch decode by options instead of fallback (#16698) 
Co-authored-by: Muqi Li <muqi1029@gmail.com>
 2026-01-10 11:38:13 +08:00
Alison Shao
9c64a15ad4 feat: add workflow run URL to /rerun-stage comment (#16825) 2026-01-10 10:41:20 +08:00
Yinghai Lu
e91a717632 [llama] Allow passing tp_rank and tp_size into llama mlp (#16837) 2026-01-10 10:32:05 +08:00
fzyzcjy
1f0ea4f958 Add routing key based schedule policy (#16840) 2026-01-10 10:16:23 +08:00
fzyzcjy
15da3061bc Tiny pass routing key to scheduler processes (#16839) 2026-01-10 10:13:00 +08:00
fzyzcjy
6406a5969b Tiny support customizing prometheus buckets for prefill delayer (#16831) 2026-01-10 08:17:37 +08:00
fzyzcjy
cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) 2026-01-10 07:54:25 +08:00
Alison Shao
ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) 2026-01-09 15:24:26 -08:00
Yuan Luo
08636f72b5 [Fix CI] Fix test_mamba_unittest.py (#16810) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-09 15:03:47 -08:00
Sai Enduri
a6c29d4cbd [AMD CI] Temporarily disable docker caching. (#16783) 2026-01-09 14:35:49 -08:00
Yi Zhong
84ab32a2a0 Reduce some small cpu overhead in stream fetch (#16587) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-01-09 21:53:06 +00:00
Liangsheng Yin
7066711529 [ci hot fix] fix global server args init for mamba ut (#16821) 2026-01-10 02:03:32 +08:00
Praneth Paruchuri
bd1afeb568 [model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804) 2026-01-09 09:29:22 -08:00
Leoyzen
8ef5b90528 Fix GLM-4.7 MoE Detector complex JSON Schema type parsing (#15753) 2026-01-10 01:21:10 +08:00
Raayan Dhar
76b3c698d6 feat: reduce constrained-decoding overhead in TP (#13947) 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
 2026-01-10 00:38:32 +08:00
Hanming Lu
5dcff94791 [nemetron/mtp] fix nemotron mtp (#16275) 2026-01-09 23:22:21 +08:00
fzyzcjy
8eeffbe9aa Support token low usage watermark in prefill delayer (#16814) 2026-01-09 23:07:18 +08:00
fzyzcjy
71e9c31cb8 Tiny add and enhance tests for prefill delayer (#16813) 2026-01-09 22:58:38 +08:00
fzyzcjy
7656d26737 Tiny enhance prefill delayer observability (#16812) 2026-01-09 22:51:16 +08:00
fzyzcjy
dd24ba9084 Refactor prefill delayer for clarity and extensibility (#16811) 2026-01-09 22:46:41 +08:00
siyu
068abe7e40 add doc for #14386 (#14655) 2026-01-09 22:38:51 +08:00
sunxxuns
64a31d4b75 [diffusion] amd: fix SGLANG_DIFFUSION_ATTENTION_BACKEND env var for diffusion attention backend selection (#16325) 
Co-authored-by: root <root@mi300x8-008.atl1.do.cpe.ice.amd.com>
 2026-01-09 20:16:58 +08:00
ybyang
2babf88f24 fix spec qwen3 pd error (#16708) 2026-01-09 19:20:17 +08:00
Lianmin Zheng
d56d14e566 [Docs] Improve docs for install on gb200 (#16760) 2026-01-09 03:07:13 -08:00
Shangming Cai
0c4e155a3c chore: bump mooncake version to 0.3.8.post1 (#16792) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-09 18:42:27 +08:00
Hubert Lu
d6d5c3fdea [AMD] Clean up vllm dependencies in moe_runner/triton.py (#11349) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-01-09 00:24:04 -08:00
Alison Shao
e46f79431b Fix external_models import path and migrate model loading tests (#16458) 2026-01-08 23:43:49 -08:00
Xiaoyu Zhang
9d4d57dbfa [Diffusion] Tiny rename parallel_groups (#16743) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-09 15:08:25 +08:00
Hanming Lu
41609b52fe support page size large than 64 for mamba radix cache with fix (#16768) 2026-01-09 13:28:37 +08:00
YC Tseng
ccd0fb3291 [AMD] Change AITER package name (#16721) 2026-01-08 21:17:20 -08:00
Liangsheng Yin
87ee6b5eaa Tiny remove auto-triggering for list-active-pr-runs. (#16778) 2026-01-09 13:16:23 +08:00
Liangsheng Yin
f7c1d24b18 List ci workflows status. (#16774) 2026-01-09 13:02:12 +08:00
Sirut Buasai
cceb5e6aa5 add AWS SGLang DLC to docs (#16686) 2026-01-08 20:06:31 -08:00
Fenglin Yu
c1c13c841a [diffusion] docs: add LoRA support (#16378) 2026-01-09 11:31:38 +08:00
Michael
fcec35dc4a [AMD] Add MI35x nightly CI tests (#16588) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-01-08 19:29:15 -08:00