chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
7,735 Commits 1 Branch 0 Tags
c660d8dfd08029a5f0e4d58dc5cf64336b294992
Commit Graph

7735 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Liangsheng Yin
c660d8dfd0 Re-org eagle unit tests (#14909) 2025-12-12 12:25:39 +09:00
Ho-Ren (Jack) Chuang
10146af099 Check KV4 compatibility with attention backends and add KV4 support to the attention_backend doc (#14467) 
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
 2025-12-11 19:00:53 -08:00
Minglei Zhu
b62e7e3bfe [CI]add nightly CI for glm4v_moe arch model (#14927) 
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2025-12-11 18:29:45 -08:00
Douglas Yang
6ce36b1232 fix: making the publish trace error check broader (#14931) 2025-12-11 18:19:57 -08:00
Yuhao Yao
e9e7f15eb5 [bugfix] fix TBO crashes when attn_tp_size > 1 (#13730) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-11 18:18:40 -08:00
Alison Shao
0aa3dec5c7 Fix black formatting in ci_utils.py (#14932) 2025-12-11 17:28:52 -08:00
Xinyuan Tong
4885f8b9c1 fix: handle Jinja2 template errors as client errors in OpenAIServingChat (#14748) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 17:06:26 -08:00
Alison Shao
f832994c32 [CI] Add Mistral Large 3 Eagle nightly performance test (#14525) 2025-12-11 17:01:50 -08:00
Alison Shao
e59435c34b Add retry logic for scheduled CI tests (#14771) 2025-12-11 16:59:58 -08:00
Zaili Wang
d6bd2d1126 [CPU] layernorm & fused add-layernorm kernels (#14074) 2025-12-11 16:58:23 -08:00
Xinyuan Tong
9975acf50f [refactor] Update reasoning parameter to require_reasoning (#14922) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 16:55:59 -08:00
amysaq2023
70758d457e support non-disturbing remote-instance-weight-loader (#13125) 
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
 2025-12-11 16:45:32 -08:00
Xinyuan Tong
fd1ebbb0d6 update mistral detector (#14921) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 16:43:36 -08:00
Douglas Yang
3d98bd5edf ci: adding more nightly tests to bot bump workflows (#14928) 2025-12-11 16:26:21 -08:00
Kangyan-Zhou
aa3716b29d Update CI_PERMISSIONS.json 2025-12-11 15:55:50 -08:00
b8zhong
6107268fe7 extend timeout for b200 test (#14925) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-11 15:43:53 -08:00
sglang-bot
5c8bd8b51b chore: bump SGLang version to 0.5.6.post2 (#14858) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-11 12:29:52 -08:00
Yinghai Lu
b05b346a13 [loader] enable private loader (#14620) 2025-12-11 11:49:46 -08:00
Jimmy
5c961756a3 [FIX][DS32]openai protocol: support openai message role: developer (#14304) 2025-12-11 11:34:41 -08:00
Kangyan-Zhou
c5f1e86117 Update CI_PERMISSIONS.json (#14917) 2025-12-11 10:14:42 -08:00
Jimmy
2c4d376d23 [SMG][DS32][fix] support dsv32, add role developer (#14307) 2025-12-11 08:09:09 -08:00
almaslof
d0f756aec9 [docs] Fix kernel name (#14887) 2025-12-11 10:48:16 -05:00
Simo Lin
6f99dc97f7 [model-gateway] fix imports and delete unused code (#14911) 2025-12-11 07:42:47 -08:00
Simo Lin
cd1c1fa5bc [model-gateway] fix annotation error and code formating (#14910) 2025-12-11 07:06:32 -08:00
Simo Lin
5b0872d2d7 [model-gateway] code clean up on oai router in responses (#14852) 2025-12-11 06:55:09 -08:00
fzyzcjy
ba88f1cace Tiny clean router load report logic (#14889) 2025-12-11 06:50:32 -08:00
fzyzcjy
60560c07a2 [model-gateway] refactor cleanup WorkflowContext.get_or_err (#14890) 2025-12-11 06:48:30 -08:00
Mick
ca1144212a [diffusion] UX: suppress excessive loggers (#14900) 2025-12-11 22:10:22 +08:00
Liangsheng Yin
543d62d11a Introduce server_fixtures in sglang.test (#14899) 2025-12-11 22:30:33 +09:00
Vladimir221
27032cecd9 [Ascend]Support of piecewise graph compilation for prefill on NPU (#12287) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2025-12-11 21:10:07 +08:00
Mick
5d804a3767 [diffusion] feat: support sageattn & sageattn3 backend (#14878) 2025-12-11 20:59:44 +08:00
liupeng374
388018a5bd [NPU] adapt dsv3.2 nsa prefill context parallel (#14541) 2025-12-11 20:12:59 +08:00
AichenF
fca8e88f28 [diffusion] feat: enable torch compile to eliminate GPU bubble (#13641) 
Co-authored-by: jianyingzhu <53300651@qq.com>
Co-authored-by: Jianying <53503712+jianyingzhu@users.noreply.github.com>
Co-authored-by: root <root@2u2g-spr-0417.ipp4a1.colossus.nvidia.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2025-12-11 19:06:32 +08:00
fzyzcjy
45eeeb9a3c Tiny support range ratio in GSP in bench serving (#14828) 2025-12-11 17:26:07 +08:00
fzyzcjy
a368df2818 Tiny add more error info for bench_serving (#14827) 2025-12-11 17:25:49 +08:00
Alison Shao
f85460fb19 Avoid deleting entire cache for missing shards (#14754 follow-up) (#14853) 2025-12-11 01:17:04 -08:00
Douglas Yang
e52cf30e81 fix: adding temporary bypass for nightly tests (#14876) 2025-12-11 00:09:03 -08:00
Shangming Cai
a076d75e98 [Fix] Remove unused import from test_disaggregation_hicache.py (#14880) 2025-12-11 15:50:47 +08:00
shicanwei.scw
8348725d9e [CI][BUG] fix ib setup for disaggregation hicache test (#14877) 
Signed-off-by: lukotong-7 <shicanwei.scw@alibaba-inc.com>
 2025-12-11 15:40:48 +08:00
Kangyan-Zhou
2856624156 Only count limitations for previous runs that reaches the test stages (#14856) 2025-12-10 23:17:34 -08:00
Yuhao Yang
b62fe8504c fix nightly vlm ci : restore original eval for requests without regex (#14875) 2025-12-10 23:13:25 -08:00
Tiance Wang
624725cb5e Move and update MindSpore docs, make it appear on the online documentation (#14861) 
Co-authored-by: wangtiance <tiancew@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-10 23:03:50 -08:00
Douglas Yang
1a96e66493 fix: creating blobs only once for publish trace retries (#14845) 2025-12-10 22:40:06 -08:00
Kangyan-Zhou
32829b1638 Remove myself to test CI gate issue (#14871) 2025-12-10 22:37:01 -08:00
yuchengz816-bot
e54307f26a [6/n] Fix num_token_non_padded computation in prefill (#14313) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
Co-authored-by: Runkai Tao <rt572@physics.rutger.edu>
 2025-12-10 19:15:19 -08:00
Trang Do
8642dbe416 Refactor Marlin MoeRunner (#14554) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-10 19:15:00 -08:00
Baizhou Zhang
7dcad45cad [CI] Temp disable gb200 test (#14865) 2025-12-10 19:05:16 -08:00
roikoren755
7c985331dd Enable TP for Mamba-based models (#14811) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2025-12-10 18:03:50 -08:00
Liangsheng Yin
bd7824b24d Minor code style fix for dllm (#14836) 2025-12-11 10:35:42 +09:00
Binyao Jiang
312df1d6c0 Fix TestGLM41VPPAccuracy test flakiness (#14848) 2025-12-10 16:59:58 -08:00