chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,913 Commits 1 Branch 0 Tags
2aa3fe394e2debaf7f1aafc3933f5f6321d0ac59
Commit Graph

209 Commits

Author SHA1 Message Date
Liangsheng Yin
2aa3fe394e [CI] fix the teardown output of disaggregation test (#19193) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-23 12:41:03 -08:00
fzyzcjy
4c7f986c6b Extract dumper and prefill delayer tests common utils (#18857) 2026-02-15 18:33:23 +08:00
Kangyan-Zhou
ae95869292 Enable SGLANG_ENABLE_SPEC_V2 for nightly speculative decoding tests (#18719) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-14 23:00:33 +08:00
DiweiSun
495290aefd enable ut test for xpu devices (#11712) 
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
 2026-02-03 11:15:14 -08:00
kk
f1384f5293 Integration mori backend for EP a2a data communication (#17012) 
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: billishyahao <bill.he@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
 2026-01-28 19:07:34 -08:00
shuwenn
57e432d951 fix: preserve disconnect events in api key middleware (#17253) 2026-01-26 22:48:24 -05:00
Alison Shao
30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
YC Tseng
17807caf82 [AMD] fix amd ci dpskv32 (#17432) 
Co-authored-by: michaelzhang-ai <michaelzhang.ai@users.noreply.github.com>
 2026-01-21 20:34:24 -08:00
Hudson Xing
8ce64aa155 fix(ci): skip offline mode for LoRA scenarios (#17248) 2026-01-16 23:06:20 -08:00
Hudson Xing
21ee597e4a ci: enable offline mode when local cache is complete to avoid HF Hub … (#16121) 2026-01-15 20:15:33 -08:00
fzyzcjy
d874c8bba4 Tiny support http headers in bench serving (#16606) 2026-01-07 10:15:17 +08:00
Junrong Lin
bc2f40bebc [test] Add mamba cache release/resume memory test (#14215) 2026-01-06 15:51:10 +08:00
fzyzcjy
c105a3124b Support multi-round conversations in bench_serving (#6135) 2026-01-06 11:59:39 +08:00
Netanel Haber
bebd625ba1 EVS Framework: Support NemotronH_Nano_VL_V2 (#14051) 2026-01-05 16:18:07 +08:00
Hudson Xing
f4ab2ec5be Add unified metrics collection framework (v1) (#16064) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-03 16:30:38 -08:00
Baizhou Zhang
f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) 2025-12-31 00:09:24 +08:00
Liangsheng Yin
a435f55d18 Tiny print launch command with shlex (#16010) 2025-12-29 11:26:46 +08:00
Lianmin Zheng
183b65190a Clean up logging (#15919) 2025-12-27 15:27:12 -08:00
Liangsheng Yin
9ad546d7e8 Tiny cleanup the models' name in test_utils (#15920) 2025-12-27 14:13:23 +08:00
Liangsheng Yin
159b128357 Tiny add flush for CI crash locating (#15769) 2025-12-24 22:47:10 +08:00
Douglas Yang
f9dd90ac35 fix: increasing H200 test timeout (#15600) 2025-12-23 01:00:37 -08:00
Junrong Lin
bed301a5ac [Feature] Enable return routed experts (#12162) 
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-21 15:16:43 +08:00
Xuchun Shang
45a959d3e9 [PP] Add pp support for Qwen3-VL (#12333) 
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Kun(llfl) <llfl@linux.alibaba.com>
Co-authored-by: kun-llfl <i@imux.top>
Co-authored-by: Kun(llfl) <llfl@linux.alibaba.com>
 2025-12-17 16:03:58 +08:00
Douglas Yang
9e9a61691e ci: adding errors to Github summary (#14778) 2025-12-14 21:08:16 -08:00
Yuhao Yang
06b58c5dc5 fix flaky image access in ci by switching to raw content url (#14940) 2025-12-13 10:52:06 -08:00
b8zhong
6107268fe7 extend timeout for b200 test (#14925) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-11 15:43:53 -08:00
Vladimir221
27032cecd9 [Ascend]Support of piecewise graph compilation for prefill on NPU (#12287) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2025-12-11 21:10:07 +08:00
Yuan Luo
03836d85d2 [GLM-4.6V] Support Pipeline Parallelism for GLM-4.6V & GLM-4.1V (#14720) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-10 16:40:12 +08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
Xiaoyu Zhang
dc69462456 [CI fix] Fix image download failures in VLM CI tests (#13613) 2025-11-20 11:18:06 +08:00
Liangsheng Yin
196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
Kangyan-Zhou
c0d1a3383b Remove jet-ai/Jet-Nemotron-2B in nightly text tests as this is constantly failing (#13540) 2025-11-18 13:58:16 -08:00
Vedant V Jhaveri
aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) 2025-11-17 15:35:18 -08:00
Liangsheng Yin
ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
Liangsheng Yin
1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
fzyzcjy
b0ee99dd03 Super tiny fix typo (#13001) 2025-11-11 00:47:45 +08:00
Zijian Zhang
3633f8b0cf Add Jet-Nemotron (#12448) 2025-11-09 01:32:47 -08:00
alisonshao
d3a03aeef8 Refs/heads/add nightly test multi gpu configs (#12870) 2025-11-08 15:14:50 -08:00
Jonah Bernard
bc25ea6762 [MoE] Add Comprehensive MoE Integration Tests (#12090) 2025-11-07 00:34:46 -08:00
Lianmin Zheng
c7d57d5bb3 Fix CI and style (#12658) 2025-11-05 15:08:15 -08:00
Glen Liu
cbf23dbbfa [Feature] add --lora-request-distribution arg to bench_serving.py and support skewed and distinct workloads (#12175) 2025-11-04 21:41:40 -08:00
Kaixi Hou
0711d1509b [NVIDIA] Fix cutedsl backend of MoE (#12353) 2025-11-04 18:54:55 -08:00
Liangsheng Yin
300b4c212e [CI] fix possible port conflicts. (#12452) 
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
 2025-10-31 17:20:20 +08:00
Rain H
750940ae36 Eagle3 DP attention for Qwen3 MoE (#12002) 2025-10-29 20:25:17 +08:00
Weiwei
caa4819bfc Add support for AutoRound quantized models (#10153) 2025-10-27 18:17:29 +08:00
Mick
770529a731 model: support deepseek-ocr (#11891) 
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-10-24 03:15:17 +08:00
Johnny
252dc4e112 [NVIDIA] FA3/FA4 Fix (#11606) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-10-19 17:10:10 -07:00
Liangsheng Yin
7a020e0f3b [Test] Add basic matched stop for beta eagle (#11833) 2025-10-20 01:17:00 +08:00
YanbingJiang
cbac499750 Split test_intel_amx_attention_backend.py to pass CI of timeout (#11370) 
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
 2025-10-15 19:22:32 -07:00
Lianmin Zheng
cd7e1bd591 Sync code and test CI; rename some env vars (#11686) 2025-10-15 18:37:03 -07:00