chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

1815 Commits

Author SHA1 Message Date
JD
191d354f53 fix double-free kv cache for requests that have already finished and been freed during preemption (#18694) 2026-02-13 13:17:44 -08:00
dongjiyingdjy
8b4c364960 refactor context parallel state (#17213) 
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
 2026-02-13 23:18:17 +08:00
Baizhou Zhang
9a32f8ccb9 [CI] Move test_load_lora_from_tensor test to H100 (#18797) 2026-02-13 21:28:00 +08:00
Liangsheng Yin
e6f7a372ef Rename request timeout env vars for waiting/running stages (#18766) 2026-02-12 22:58:40 -08:00
Alison Shao
0abe4a22c6 Fix flaky penalty tests by using higher temperature for effect comparison (#18380) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-02-12 21:08:37 +08:00
YC Tseng
20554a0a4f [AMD] rocm 7.2 image release, PR test, Nightly Test (#17799) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
 2026-02-11 21:29:25 -08:00
Piotr Mazurek
ded068a76e Add LMF2 MoE model architecture (#17997) 2026-02-12 01:03:43 +08:00
Vedant V Jhaveri
98b5013d59 add support to enable lora with embedding models (#17780) 
Co-authored-by: Vedant Jhaveri <vjhaveri@linkedin.com>
 2026-02-11 23:19:40 +08:00
McZyWu
4f7422f7ba [NPU] support model skywork-reward-gemma2-2-27B-v0.2 (#16947) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-02-11 15:34:53 +08:00
Michael
d84d2063d3 [AMD] Fix Janus-Pro crash and add Kimi-K2.5 nightly test (#18269) 2026-02-10 22:33:13 -08:00
Liangsheng Yin
cd90346a2b Add cache hit rate UT (#18566) 2026-02-10 21:27:41 -08:00
Liangsheng Yin
50f74285e9 Tiny fix regex warning (#18592) 2026-02-10 21:07:53 -08:00
cutetocute
8d2892330c chore: fix some typos (#18577) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-02-10 20:47:41 -08:00
Zehuan Li
26f2b3798d [DLLM] Basic dLLM scheduling strategy and implementation (#17484) 
Signed-off-by: Zehuan Li <lizehuan.lzh@antgroup.com>
 2026-02-10 16:54:15 +08:00
Teng Ma
df733c5ee5 [HiCache][PP] add test case for compatibility (#16395) 2026-02-09 18:03:04 -08:00
Liangsheng Yin
2825f5d8e0 Tiny fix wrong metric collect key name forward_prefill -> forward_extend (#18506) 2026-02-09 16:23:41 -08:00
Baizhou Zhang
615a02dcd4 Revert "optimize get_topk_ragged by fusing get k and k_scale triton kernel" (#18471) 2026-02-09 16:37:19 +08:00
Bingxu Chen
3f3c201243 [AMD] Update aiter to v0.1.10.post2 (#18423) 
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
 2026-02-08 22:08:24 -08:00
Shangming Cai
52401bec1d chore: bump mooncake version to 0.3.9 (#18316) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-02-07 17:30:01 +08:00
Alison Shao
bedade1ef0 Merge stage-c-test-large-4-gpu suites into partitioned suites (#18325) 2026-02-06 15:32:33 -08:00
shaharmor98
c6aa1863be Add Nemotron 3 Nano tests (#18119) 
Signed-off-by: Shahar Mor <smor@nvidia.com>
 2026-02-06 23:55:42 +08:00
aaaandychen
6a4b81e2d9 Refactor(qwen3-vl) optimize position encoding interpolation (#16781) 
Signed-off-by: chenzhenyang <andy271828@163.com>
Signed-off-by: chenzhenyang <chenzhenyang@moonshot.cn>
Co-authored-by: chenzhenyang <chenzhenyang@moonshot.cn>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
 2026-02-05 10:26:35 -08:00
Alison Shao
d22163eb8c Fix flaky test_frequency_penalty_reduces_word_repetition by using deterministic seeds (#18285) 2026-02-05 10:24:18 -08:00
Meng, Hengyu
368936a62b [XPU] Integrate MoE and minor improvements in XPU attention backend (#13561) 2026-02-04 23:09:59 -08:00
Alison Shao
c910829708 Fix test_return_routed_experts to use response-level sglext (#18274) 2026-02-04 20:16:01 -08:00
Michael
6fd878b41d [AMD] Add kimi mi35x nightly test, folder organization and several stability fixes (#17895) 2026-02-04 12:03:57 -08:00
BingjiaWang
760ae933bb optimize get_topk_ragged by fusing get k and k_scale triton kernel (#16043) 
Co-authored-by: abing <wangbingjia.wbj@alibaba-inc.com>
 2026-02-04 19:59:41 +08:00
DiweiSun
495290aefd enable ut test for xpu devices (#11712) 
Co-authored-by: jundu <jun.du@intel.com>
Co-authored-by: Gao, Pengfei <pengfei.gao@intel.com>
 2026-02-03 11:15:14 -08:00
elvischenv
99fab2ce67 [Bugfix] Fix Mistral Large 3 NVFP4 TRTLLM MoE (#18065) 2026-02-03 20:32:49 +08:00
Zhaoyi Li
8e933e1914 AMD PD/D PR ci (#17183) 
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: Bingxu Chen <bingxche@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
 2026-02-02 23:29:14 -08:00
Viacheslav
74f716dbd7 Gigachat 3 tool parser and tests (#14765) 2026-02-02 22:28:34 -08:00
Glen Liu
fe57a887b1 [TestFix] use unit tests for LoRA overlap loading tests (#18140) 2026-02-02 22:06:50 -08:00
zhangheng
180594358b [HiCache]: Support DeepSeek v32 cpu offloading (#17415) 
Co-authored-by: 晟海 <huangtingwei.htw@antgroup.com>
 2026-02-02 18:07:37 -08:00
Douglas Yang
c8da307d7e feature: adding gpt-oss 120b nightly test (#18134) 2026-02-02 17:11:28 -08:00
Alison Shao
812fd47cb4 Re-enable test_mla_int8_deepseek_v3.py after HF token fix (#18123) 2026-02-02 14:38:42 -08:00
cctry
027f314050 [Fix] data race in req_to_token pool (#17850) 2026-02-02 14:38:15 -08:00
Yongfei Xu
677f3c49da [DeepSeek V3.2] [Bugfix] slice indexer and padding fa3 when can not run cuda graph (#17076) 2026-02-03 01:32:20 +08:00
Sugar920
c781db0f6c [NPU] update nightly tests (#17952) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: cy <chenyang08056032@163.com>
 2026-02-03 00:13:30 +08:00
Byron Hsu
5636d16dec [CI] Add logs to debug TestOpenAIServer.test_completion_stream (#17471) 2026-02-02 02:38:08 -08:00
Yuhao Yang
d11ccc0a0a fix: avoid double reduce in VLM dp attention (#17991) 2026-02-02 09:44:32 +08:00
Glen Liu
99dad105fd [TestFix] rewrite LoRA overlap loading tests (#18047) 2026-02-01 14:52:08 -08:00
Alison Shao
56907cbcb1 Move deleted 8-GPU tests to test/manual/ (#18060) 2026-02-01 00:21:56 -08:00
Alison Shao
a0bae4c343 Migrate 4-GPU/8-GPU workflow jobs to stage-c and add CI registry decorators (#17299) 2026-01-31 22:37:22 -08:00
Alison Shao
95180484e9 Disable test_mla_int8_deepseek_v3.py temporarily (#18057) 2026-01-31 22:33:43 -08:00
b8zhong
398d13a189 [Perf] Add Flashinfer DeepGEMM SM90 for SwapAB Optimization (#15514) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2026-02-01 08:56:23 +08:00
Hudson Xing
c72bf50706 add reasoning_tokens usage test for tool call (#18022) 2026-01-30 21:09:23 -08:00
JiaruiChang5268
e86476acfc [NPU] support llama-3.2-11B-vision-instruct mode for NPU (#17492) 
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
Co-authored-by: chenyang08056032 <chenyang08056032@163.com>
Co-authored-by: Hexq0210 <893781835@qq.com>
 2026-01-31 08:49:38 +08:00
Fan Yin
8ce9609fa2 fix: fix SHM pointer re-serialization in DP attention (#17930) 2026-01-30 17:03:30 +08:00
McZyWu
70db3398d1 [NPU] enhance accuracy for model kimi-vl-a3b-instruct (#17480) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-01-30 15:19:42 +08:00
jianan-gu
c35aa0238c [CPU][INT4] Add INT4 kernels for CPU (#8226) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-29 22:30:13 -08:00