chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

11116 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
fzyzcjy
15da3061bc Tiny pass routing key to scheduler processes (#16839) 2026-01-10 10:13:00 +08:00
fzyzcjy
6406a5969b Tiny support customizing prometheus buckets for prefill delayer (#16831) 2026-01-10 08:17:37 +08:00
fzyzcjy
cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) 2026-01-10 07:54:25 +08:00
Alison Shao
ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) 2026-01-09 15:24:26 -08:00
Yuan Luo
08636f72b5 [Fix CI] Fix test_mamba_unittest.py (#16810) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-09 15:03:47 -08:00
Sai Enduri
a6c29d4cbd [AMD CI] Temporarily disable docker caching. (#16783) 2026-01-09 14:35:49 -08:00
Yi Zhong
84ab32a2a0 Reduce some small cpu overhead in stream fetch (#16587) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-01-09 21:53:06 +00:00
Liangsheng Yin
7066711529 [ci hot fix] fix global server args init for mamba ut (#16821) 2026-01-10 02:03:32 +08:00
Praneth Paruchuri
bd1afeb568 [model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804) 2026-01-09 09:29:22 -08:00
Leoyzen
8ef5b90528 Fix GLM-4.7 MoE Detector complex JSON Schema type parsing (#15753) 2026-01-10 01:21:10 +08:00
Raayan Dhar
76b3c698d6 feat: reduce constrained-decoding overhead in TP (#13947) 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
 2026-01-10 00:38:32 +08:00
Hanming Lu
5dcff94791 [nemetron/mtp] fix nemotron mtp (#16275) 2026-01-09 23:22:21 +08:00
fzyzcjy
8eeffbe9aa Support token low usage watermark in prefill delayer (#16814) 2026-01-09 23:07:18 +08:00
fzyzcjy
71e9c31cb8 Tiny add and enhance tests for prefill delayer (#16813) 2026-01-09 22:58:38 +08:00
fzyzcjy
7656d26737 Tiny enhance prefill delayer observability (#16812) 2026-01-09 22:51:16 +08:00
fzyzcjy
dd24ba9084 Refactor prefill delayer for clarity and extensibility (#16811) 2026-01-09 22:46:41 +08:00
siyu
068abe7e40 add doc for #14386 (#14655) 2026-01-09 22:38:51 +08:00
sunxxuns
64a31d4b75 [diffusion] amd: fix SGLANG_DIFFUSION_ATTENTION_BACKEND env var for diffusion attention backend selection (#16325) 
Co-authored-by: root <root@mi300x8-008.atl1.do.cpe.ice.amd.com>
 2026-01-09 20:16:58 +08:00
ybyang
2babf88f24 fix spec qwen3 pd error (#16708) 2026-01-09 19:20:17 +08:00
Lianmin Zheng
d56d14e566 [Docs] Improve docs for install on gb200 (#16760) 2026-01-09 03:07:13 -08:00
Shangming Cai
0c4e155a3c chore: bump mooncake version to 0.3.8.post1 (#16792) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-09 18:42:27 +08:00
Hubert Lu
d6d5c3fdea [AMD] Clean up vllm dependencies in moe_runner/triton.py (#11349) 
Co-authored-by: HAI <hixiao@gmail.com>
 2026-01-09 00:24:04 -08:00
Alison Shao
e46f79431b Fix external_models import path and migrate model loading tests (#16458) 2026-01-08 23:43:49 -08:00
Xiaoyu Zhang
9d4d57dbfa [Diffusion] Tiny rename parallel_groups (#16743) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-09 15:08:25 +08:00
Hanming Lu
41609b52fe support page size large than 64 for mamba radix cache with fix (#16768) 2026-01-09 13:28:37 +08:00
YC Tseng
ccd0fb3291 [AMD] Change AITER package name (#16721) 2026-01-08 21:17:20 -08:00
Liangsheng Yin
87ee6b5eaa Tiny remove auto-triggering for list-active-pr-runs. (#16778) 2026-01-09 13:16:23 +08:00
Liangsheng Yin
f7c1d24b18 List ci workflows status. (#16774) 2026-01-09 13:02:12 +08:00
Sirut Buasai
cceb5e6aa5 add AWS SGLang DLC to docs (#16686) 2026-01-08 20:06:31 -08:00
Fenglin Yu
c1c13c841a [diffusion] docs: add LoRA support (#16378) 2026-01-09 11:31:38 +08:00
Michael
fcec35dc4a [AMD] Add MI35x nightly CI tests (#16588) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
 2026-01-08 19:29:15 -08:00
Liangsheng Yin
75da784d48 Tiny simplify draft worker init. (#16446) 2026-01-09 11:20:29 +08:00
Liangsheng Yin
77d3566555 Tiny fix wording about CI preemption. (#16773) 2026-01-09 11:08:17 +08:00
Yongfei Xu
05dfef92a1 [DeepSeek 3.2] Support and optimize pipeline parallelis when context pipeline enabled (#16380) 
Co-authored-by: ybyang <ybyang7@iflytek.com>
 2026-01-09 11:01:49 +08:00
Simo Lin
7460240737 [model-gateway] release 0.3.1 (#16254) 2026-01-08 17:49:37 -08:00
triple-mu
f7f5c3896d [diffusion] model: wan tp+usp optimize (#16720) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-09 09:40:31 +08:00
fzyzcjy
9e3a032ad6 [smg] cleanup router RAII guards (#16560) 2026-01-08 16:39:53 -08:00
Simo Lin
1bc7aa5801 [smg] update gRPC proto to match upstream changes (#16764) 
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2026-01-08 16:33:09 -08:00
Simo Lin
8726d30cb2 [smg] Add Nemotron Nano V3 reasoning parser support (#16763) 2026-01-08 16:29:24 -08:00
Douglas Yang
a1b243d76f fix: extend cpu only install dependency timeout to 20 mins (#16759) 2026-01-08 16:08:21 -08:00
Alison Shao
a979927727 Skip causal_conv1d test with padded batches due to Triton kernel bug (#16715) 2026-01-08 15:13:13 -08:00
Simo Lin
ee71e773e1 [smg] Work around sglang's notorious orphan process problem (#16756) 2026-01-08 14:41:03 -08:00
Simo Lin
55a8dd0095 [grpc] Fix protobuf compilation in isolated build environments (#16754) 2026-01-08 13:09:01 -08:00
Simo Lin
cf24232100 fix(e2e): prevent potential hangs in model pool subprocess handling (#16752) 2026-01-08 12:35:56 -08:00
Simo Lin
9d03af916a [smg][ci] delete old chat completion integration tests and workflow step (#16751) 2026-01-08 11:31:54 -08:00
Liangsheng Yin
064ae3419e Adjust the cancel PR workflows for better preemption. (#16749) 2026-01-09 03:25:41 +08:00
Simo Lin
49305fa1c1 [smg][ci] migrate function calling tests to new infrastructure (#16748) 2026-01-08 11:08:01 -08:00
YC Tseng
4e999404c3 [AMD] Fix CI - unit-test-backend-1-gpu-amd-mi35x and unit-test-backend-2-gpu-amd, stage-b-test-small-1-gpu-amd (#16675) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-08 10:16:27 -08:00
Simo Lin
fbc24886dd [smg][ci] migrate validation tests to new infrastructure (#16746) 2026-01-08 09:26:31 -08:00
Chang Su
16880235d1 [grpc] Auto-generate protobuf files during wheel build (#16409) 2026-01-08 09:09:54 -08:00