chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

703 Commits

Author SHA1 Message Date
Sugar920
c781db0f6c [NPU] update nightly tests (#17952) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-02-03 00:13:30 +08:00
Byron Hsu
5636d16dec [CI] Add logs to debug TestOpenAIServer.test_completion_stream (#17471) 2026-02-02 02:38:08 -08:00
Yuhao Yang
d11ccc0a0a fix: avoid double reduce in VLM dp attention (#17991) 2026-02-02 09:44:32 +08:00
Glen Liu
99dad105fd [TestFix] rewrite LoRA overlap loading tests (#18047) 2026-02-01 14:52:08 -08:00
Alison Shao
a0bae4c343 Migrate 4-GPU/8-GPU workflow jobs to stage-c and add CI registry decorators (#17299) 2026-01-31 22:37:22 -08:00
Alison Shao
95180484e9 Disable test_mla_int8_deepseek_v3.py temporarily (#18057) 2026-01-31 22:33:43 -08:00
Hudson Xing
c72bf50706 add reasoning_tokens usage test for tool call (#18022) 2026-01-30 21:09:23 -08:00
JiaruiChang5268
e86476acfc [NPU] support llama-3.2-11B-vision-instruct mode for NPU (#17492) 
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
Co-authored-by: chenyang08056032 <chenyang08056032@163.com>
Co-authored-by: Hexq0210 <893781835@qq.com>
 2026-01-31 08:49:38 +08:00
Fan Yin
8ce9609fa2 fix: fix SHM pointer re-serialization in DP attention (#17930) 2026-01-30 17:03:30 +08:00
McZyWu
70db3398d1 [NPU] enhance accuracy for model kimi-vl-a3b-instruct (#17480) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-30 15:19:42 +08:00
StonyPort
2b3408ff14 feat: add forward timeout (#17831) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
 2026-01-30 08:52:29 +08:00
Hudson Xing
d417c6809e Add tool call tests for DeepSeek V3.2 in nightly CI (#17951) 2026-01-29 09:50:54 -08:00
Joe Redmond
0ff0d181ca feat: add custom request header logging (#17786) 2026-01-28 19:33:08 -08:00
Артем Савкин
b77b0ffd60 [NPU] NZ for non-quantized MOE, Qwen3 MOE double memory consumption fix (#15904) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 00:55:08 +08:00
Michael
f8636fbb25 [AMD] Add Kimi-K2, DeepSeek-V3.2 tests to nightly CI (#17523) 
Co-authored-by: YC Tseng <yctseng@amd.com>
 2026-01-28 00:55:46 -08:00
YC Tseng
52bca42870 [AMD] CI - enable deepseekv3.2 on MI325-8gpu and merge perf/accuracy test suites into stage-b suites (#17633) 
Co-authored-by: Bingxu Chen <Bingxu.Chen@amd.com>
 2026-01-27 18:54:36 -08:00
shuwenn
57e432d951 fix: preserve disconnect events in api key middleware (#17253) 2026-01-26 22:48:24 -05:00
shuwenn
fd3b179ffd [HiCache][HA 1/N] Support HiCache storage runtime attach/detach (#15892) 2026-01-26 19:33:19 -08:00
sogalin
738b1ac988 [AMD CI] Add moonshotai/Kimi-K2-Instruct-0905 testcases (#17656) 2026-01-26 02:12:34 -08:00
McZyWu
2734b23481 accuracy enhancement for baichuan2-13B for npu (#16868) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-26 16:14:35 +08:00
Alison Shao
30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
Kangyan-Zhou
5aaedac3c6 Add EP=2 to qwen235b nightly tests (#17738) 2026-01-25 21:36:04 -08:00
Kangyan-Zhou
592603d77b Fix flaky streaming logprobs test by handling detokenizer text buffering (#17687) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-01-25 15:09:06 -08:00
Kangyan-Zhou
9123491430 A few updates to the night tests (#17694) 2026-01-25 11:20:17 -08:00
Kangyan-Zhou
69a7a70e47 Temporarily disable lora overlap loading test due to flakiness (#17683) 2026-01-24 12:24:44 -08:00
Kangyan-Zhou
137eb5b95c Fix NSA indexer test and move it to pre commit test (#17682) 2026-01-24 12:06:18 -08:00
strgrb
176da1bbdd Fix: mistake sigmoid in kda (#17508) 2026-01-24 13:35:14 +08:00
McZyWu
b4a611fb33 [NPU] solve accuracy problem for stablelm-2-1-6b for npu (#17470) 2026-01-24 08:27:38 +08:00
McZyWu
8a5ed2434f [NPU]support model MiniCPM3-4B for npu (#16866) 2026-01-24 08:25:12 +08:00
Mansoor
bdaa3de075 Add return routed experts to the completions and chat/completions endpoints (#17434) 2026-01-23 12:12:36 -08:00
JiaruiChang5268
c0b5a180fe [NPU]bugfix: fix for dsv3.2 and dsvl2 (#17007) 
Co-authored-by: Hexq0210 <893781835@qq.com>
Co-authored-by: liupeng374 <782420244@qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-23 11:15:15 +08:00
Ke Bao
7ace64d1d8 Update mamba env setting (#17566) 2026-01-23 11:02:32 +08:00
YC Tseng
04a10c9bc2 [AMD] CI - migrate perf test and fix stage-b-test-1-gpu-amd (#17340) 
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-22 18:45:05 -08:00
chenxu214
5d299c25c0 [NPU] bugfix with Kimi-k2 and bge-reranker-v2 model (#17478) 
Co-authored-by: amote-i <49533125+amote-i@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-22 22:02:05 +08:00
zhangheng
f33022d039 [RadixTree][3/N Refactor]：Support unified insert/evict params (#17401) 2026-01-22 17:36:31 +08:00
YC Tseng
17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
Piotr Mazurek
d6e2b88288 Add Liquid Foundation Model (LFM2) (#16890) 2026-01-22 11:11:20 +08:00
Lianmin Zheng
b74a57a8d9 [Auto Sync] Update detokenizer_manager.py, io_struct.py, mu... (20260120) (#17442) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Wangfan Fu <wangfan@x.ai>
 2026-01-21 14:48:32 -08:00
Yi Zhang
236772c0e1 [RadixTree][2/N Refactor]: swa cache init tiny refactor (#17397) 2026-01-21 15:48:30 +08:00
Kangyan-Zhou
be5121b452 Fix NSA indexer in the nightly test (#17452) 2026-01-20 19:58:13 -08:00
Baizhou Zhang
c3f9c30f99 [Minor] Change lora_target_modules to "all" in CI tests (#17386) 2026-01-21 11:46:36 +08:00
Alison Shao
823a046e8f Add hybrid parallelism test to nightly CI (#17444) 2026-01-20 17:43:50 -08:00
Michael
a3addd6203 [AMD] Add DeepSeek-V3.2 and VLMs model in nightly tests (#17179) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
 2026-01-19 20:31:56 -08:00
Alison Shao
7e40d52635 Move test_autoround.py to stage-b-test-large-1-gpu suite (#17336) 2026-01-19 14:36:19 -08:00
Hudson Xing
c1282da236 fix(ci): apply MMMU retry logic to all affected test files (#17329) 2026-01-19 10:00:29 -08:00
shuwenn
71279e31f7 [CI] fix test_vlm_models.py (#17049) 2026-01-19 10:00:00 -08:00
YC Tseng
1a053a810c [AMD] CI - add partitions for stage-b-test-small-1-gpu-amd (#17345) 2026-01-19 08:16:07 -08:00
Bingxu Chen
2ea02f0642 [AMD CI] Migrate and Add More Testcases (#17116) 
Co-authored-by: yctseng0211 <yctseng@amd.com>
 2026-01-19 08:07:39 -08:00
zhangheng
20b0523eca [RadixTree][1/N Refactor]: Support unified match_prefix params (#17142) 
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
 2026-01-19 22:39:40 +08:00
Alison Shao
8916b9d080 Migrate performance, accuracy, and quantization tests to CI registry (#17177) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2026-01-18 23:25:24 -08:00