chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

1815 Commits

Author SHA1 Message Date
Ma Mingfei
88f7759402 [CPU] optimize flash_attn_varlen_func (#15708) 2026-01-29 22:07:05 -08:00
StonyPort
2b3408ff14 feat: add forward timeout (#17831) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
 2026-01-30 08:52:29 +08:00
Hudson Xing
d417c6809e Add tool call tests for DeepSeek V3.2 in nightly CI (#17951) 2026-01-29 09:50:54 -08:00
22dimensions
7b79326751 [NPU] support GPTQ quantization on npu (#15203) 
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
 2026-01-29 15:48:18 +08:00
Niko Ma
cbf90d70ff [PD] Support KV transfer with MORI-IO (#14626) 
Co-authored-by: cwortman-amd <cwortman@amd.com>
 2026-01-28 23:22:41 -08:00
Joe Redmond
0ff0d181ca feat: add custom request header logging (#17786) 2026-01-28 19:33:08 -08:00
kk
f1384f5293 Integration mori backend for EP a2a data communication (#17012) 
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: billishyahao <bill.he@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-01-28 19:07:34 -08:00
Артем Савкин
b77b0ffd60 [NPU] NZ for non-quantized MOE, Qwen3 MOE double memory consumption fix (#15904) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 00:55:08 +08:00
Michael
f8636fbb25 [AMD] Add Kimi-K2, DeepSeek-V3.2 tests to nightly CI (#17523) 
Co-authored-by: YC Tseng <yctseng@amd.com>
 2026-01-28 00:55:46 -08:00
Even Zhou
6077de1237 [CI] [NPU] npu ci use existing modelscope model (#17868) 2026-01-28 16:51:41 +08:00
YC Tseng
52bca42870 [AMD] CI - enable deepseekv3.2 on MI325-8gpu and merge perf/accuracy test suites into stage-b suites (#17633) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-01-27 18:54:36 -08:00
Baizhou Zhang
1d942e4eef [DeepSeek] Update tests and document for DeepSeek V3.2 NVFP4 checkpoint (#17657) 2026-01-27 22:10:57 +08:00
shuwenn
57e432d951 fix: preserve disconnect events in api key middleware (#17253) 2026-01-26 22:48:24 -05:00
shuwenn
fd3b179ffd [HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892) 2026-01-26 19:33:19 -08:00
Shangming Cai
3ad3268e06 [CI] Skip PD hybrid attention test with different TP temporarily (#17791) 2026-01-27 10:59:33 +08:00
Alison Shao
6c0f9b4824 Add test_gpt_oss_4gpu.py to B200 test suite (#17743) 2026-01-26 21:57:06 +08:00
sogalin
738b1ac988 [AMD CI] Add moonshotai/Kimi-K2-Instruct-0905 testcases (#17656) 2026-01-26 02:12:34 -08:00
McZyWu
2734b23481 accuracy enhancement for baichuan2-13B for npu (#16868) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-26 16:14:35 +08:00
Alison Shao
30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
Kangyan-Zhou
5aaedac3c6 Add EP=2 to qwen235b nightly tests (#17738) 2026-01-25 21:36:04 -08:00
Kangyan-Zhou
592603d77b Fix flaky streaming logprobs test by handling detokenizer text buffering (#17687) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-01-25 15:09:06 -08:00
Kangyan-Zhou
9123491430 A few updates to the night tests (#17694) 2026-01-25 11:20:17 -08:00
xjx471258437
9bd92ba0f6 Support PD disaggregation with different TP/DP size for Qwen3-Next (#16056) 
Co-authored-by: xjx392321 <xjx392321@alibaba-inc.com>
 2026-01-25 15:34:02 +08:00
Kangyan-Zhou
69a7a70e47 Temporarily disable lora overlap loading test due to flakiness (#17683) 2026-01-24 12:24:44 -08:00
Kangyan-Zhou
137eb5b95c Fix NSA indexer test and move it to pre commit test (#17682) 2026-01-24 12:06:18 -08:00
strgrb
176da1bbdd Fix: mistake sigmoid in kda (#17508) 2026-01-24 13:35:14 +08:00
Lianmin Zheng
bc6f0b5ce7 [Auto Sync] Update logits_processor.py, test_logprobs.py (20260124) (#17664) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: yehu-ux <yehu@x.ai>
 2026-01-23 17:57:41 -08:00
McZyWu
b4a611fb33 [NPU] solve accuracy problem for stablelm-2-1-6b for npu (#17470) 2026-01-24 08:27:38 +08:00
McZyWu
8a5ed2434f [NPU]support model MiniCPM3-4B for npu (#16866) 2026-01-24 08:25:12 +08:00
Mansoor
bdaa3de075 Add return routed experts to the completions and chat/completions endpoints (#17434) 2026-01-23 12:12:36 -08:00
Nicolas Castet
48e9daadff Support symmetric memory pre-allocation to avoid fragmentation (#17089) 2026-01-23 17:57:04 +08:00
Even Zhou
69ac8b58f7 [NPU] [CI] temporarily disable mtp test (#17614) 2026-01-23 15:17:31 +08:00
Alison Shao
d7dd0b8832 Re-enable unit-test-deepep-8-gpu and unit-test-backend-4-gpu-gb200 (#17438) 2026-01-23 14:31:44 +08:00
JiaruiChang5268
c0b5a180fe [NPU]bugfix: fix for dsv3.2 and dsvl2 (#17007) 
Co-authored-by: Hexq0210 <893781835@qq.com>
Co-authored-by: liupeng374 <782420244@qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-23 11:15:15 +08:00
Ke Bao
7ace64d1d8 Update mamba env setting (#17566) 2026-01-23 11:02:32 +08:00
YC Tseng
04a10c9bc2 [AMD] CI - migrate perf test and fix stage-b-test-1-gpu-amd (#17340) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-22 18:45:05 -08:00
Alison Shao
1e8e0cca2c Update test README with CI registry documentation and 5090/H100 guidance (#17368) 2026-01-22 16:29:08 -08:00
chenxu214
5d299c25c0 [NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478) 
Co-authored-by: amote-i <49533125+amote-i@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-22 22:02:05 +08:00
zhangheng
f33022d039 [RadixTree][3/N Refactor]：Support unified insert/evict params (#17401) 2026-01-22 17:36:31 +08:00
YC Tseng
17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
Piotr Mazurek
d6e2b88288 Add Liquid Foundation Model (LFM2) (#16890) 2026-01-22 11:11:20 +08:00
Alison Shao
9be2a3a9a3 Remove test_gpt_oss_4gpu.py from __not_in_ci__ (keep in per-commit-4-gpu) (#17534) 2026-01-21 15:31:03 -08:00
Lianmin Zheng
b74a57a8d9 [Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
 2026-01-21 14:48:32 -08:00
Alison Shao
85d9af51da Temporarily disable flaky test_gpt_oss_4gpu.py on B200 (#17528) 2026-01-21 14:01:04 -08:00
Yi Zhang
236772c0e1 [RadixTree][2/N Refactor]: swa cache init tiny refactor (#17397) 2026-01-21 15:48:30 +08:00
Kangyan-Zhou
be5121b452 Fix NSA indexer in the nightly test (#17452) 2026-01-20 19:58:13 -08:00
Baizhou Zhang
c3f9c30f99 [Minor] Change lora_target_modules to "all" in CI tests (#17386) 2026-01-21 11:46:36 +08:00
Alison Shao
823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
ympcMark
f7a5e425c3 [3/N] Achieve fault tolerance at the DP level (#11657) 
Co-authored-by: UNIDY <unidy2002@outlook.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
 2026-01-20 18:47:08 +08:00
Michael
a3addd6203 [AMD] Add DeepSeek-V3.2 and VLMs model in nightly tests (#17179) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-19 20:31:56 -08:00