Commit Graph

9885 Commits

Author SHA1 Message Date
Liangsheng Yin
85d077f44d Introduce global alloc_len_per_decode & clean check decode memory (#15115) 2026-01-26 10:26:20 -08:00
Douglas Yang
8643fb2f52 fix: remove truncation for test and job names in ci failure monitor (#17765) 2026-01-26 09:46:33 -08:00
Makcum888e
bba6e38ff8 [NPU] Split pyproject npu from pyproject other (#17641) 2026-01-26 09:45:44 -08:00
Douglas Yang
51d139b867 fix: move nightly whl to cuda version folder (#17762) 2026-01-27 00:13:46 +08:00
Yuan Luo
7bb41989fa [1/N] Optimize All Reduce - Benchmark different AR operations (#13797)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-01-26 22:44:13 +08:00
Alison Shao
6c0f9b4824 Add test_gpt_oss_4gpu.py to B200 test suite (#17743) 2026-01-26 21:57:06 +08:00
lawtherWu
b56366f827 [NPU]DeepSeek-V3.2 support npu mlaprolog (#15381)
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: richhuan <huan_rz@qq.com>
2026-01-26 20:42:37 +08:00
sogalin
738b1ac988 [AMD CI] Add moonshotai/Kimi-K2-Instruct-0905 testcases (#17656) 2026-01-26 02:12:34 -08:00
Yi Zhang
5844cb2fd8 refactor mamba radix cache logic in server_args (#17645) 2026-01-26 17:02:49 +08:00
shaharmor98
f6f1b6d000 Bump FI version (#17700)
Signed-off-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: b8zhong <b8zhong@uwaterloo.ca>
2026-01-26 16:50:06 +08:00
McZyWu
2734b23481 accuracy enhancement for baichuan2-13B for npu (#16868)
Co-authored-by: cy <chenyang08056032@163.com>
2026-01-26 16:14:35 +08:00
Simo Lin
6756cf18c6 remove multimodal as this is completely dead code (#17750) 2026-01-26 00:07:40 -08:00
Prozac614
12f794e516 [diffusion] fix: fix missing backend argument in pipelines_core initialization (#17343) 2026-01-26 15:47:10 +08:00
Simo Lin
d4adff31aa update wasm endpoint (#17748) 2026-01-25 23:43:29 -08:00
Kangyan-Zhou
48f4340b14 Exclude some diffusion package for ARM in docker release (#17745) 2026-01-25 23:32:39 -08:00
Simo Lin
ed75136e85 remove self managed wasm as it has been replaced with official smg wa… (#17746) 2026-01-25 22:56:33 -08:00
Alison Shao
30b3192039 Merge performance/accuracy test suites into regular stage-b suites (#17609) 2026-01-25 22:49:19 -08:00
Praneth Paruchuri
8c2d8b51e9 [model-gateway] fix wasm example2 (#17244) 2026-01-25 22:45:36 -08:00
Praneth Paruchuri
02c1dabf5d [model-gateway] fix wasm example3 (#17277) 2026-01-25 22:45:21 -08:00
Praneth Paruchuri
511961870f [model-gateway] Optimize WASM cache lookups using SHA-256 (#17344) 2026-01-25 22:44:55 -08:00
CSWYF3634076
1a19b3987d [Model] Add Ernie4.5 VL model support (#15679)
Signed-off-by: CSWYF3634076 <wangyafeng@baidu.com>
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
2026-01-25 22:36:29 -08:00
zackyoray
d275d47973 [NIXL] Add custom NIXL backend selection for KVManager (#17146)
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
2026-01-26 14:35:38 +08:00
Yuan Luo
1e8db18290 [Kimi-Linear] Remove duplicated code in kimi-linear (#17731) 2026-01-26 14:20:24 +08:00
Simo Lin
7890a96f97 remove self managed mcp as it has been replaced with official rmcp crate (#17740) 2026-01-25 22:17:06 -08:00
Kangyan-Zhou
52e0f65fce Update nightly-test-nvidia.yml to remove push trigger (#17625) 2026-01-25 21:42:36 -08:00
Kangyan-Zhou
5aaedac3c6 Add EP=2 to qwen235b nightly tests (#17738) 2026-01-25 21:36:04 -08:00
Alison Shao
7b22b8ff8a Fix sgl-kernel install: fail instead of PyPI fallback when artifacts missing (#17728) 2026-01-26 11:46:49 +08:00
chenxu214
444b9521e4 [Bugfix]Repeated add modelslim quant_config and bugfix with "enable-piecewise-cuda-graph" on NPU (#17511) 2026-01-26 09:51:07 +08:00
Simo Lin
46bc53a81b [smg] import db crate to replace self managed one (#17727) 2026-01-25 16:54:52 -08:00
Simo Lin
52d0ca944b [smg] import official wfaas crate to replace self managed one (#17724) 2026-01-25 15:20:58 -08:00
Kangyan-Zhou
592603d77b Fix flaky streaming logprobs test by handling detokenizer text buffering (#17687)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-01-25 15:09:06 -08:00
Simo Lin
bf139af37a [smg] use already published auth crate for better compilation speed (#17723) 2026-01-25 14:52:42 -08:00
Kangyan-Zhou
344eeaee90 Upload nightly test metrics to GH artifacts (#17696) 2026-01-25 14:35:14 -08:00
Simo Lin
97a36a72b7 [smg] remove dead tokenizer code (#17722) 2026-01-25 14:04:48 -08:00
Praneth Paruchuri
fc7096f80b [model-gateway] Optimize special token search using Aho-Corasick (#17387)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-25 13:54:15 -08:00
Simo Lin
f5ac1ca10b [smg] use official tokenizer crate instead of manually built one (#17721) 2026-01-25 13:35:16 -08:00
Simo Lin
2c1e2674cc [misc] replace existing tool call code with new crate package (#17720) 2026-01-25 13:07:39 -08:00
Simo Lin
48f5c46a8d [misc] remove tool parser and tree benchmark as they are not meaningful atm (#17719) 2026-01-25 13:03:06 -08:00
Kangyan-Zhou
7ca8c12e0e Extend b200 kernel tests timeout for CPU differences (#17718) 2026-01-25 12:59:39 -08:00
Simo Lin
86c7bc6431 [smg] update crate for tools (#17717) 2026-01-25 12:56:42 -08:00
Kangyan-Zhou
8d3e1ac0c8 Add an all type in pyproject.tml to include diffusion support (#17697) 2026-01-25 12:52:13 -08:00
Kangyan-Zhou
9123491430 A few updates to the night tests (#17694) 2026-01-25 11:20:17 -08:00
HandH1998
a883906a24 Support mxint4 flashinfer_trtllm moe gemm (#16892) 2026-01-26 00:15:53 +08:00
Mick
b105dad5da [diffusion] refactor: remove useless lazy-import cache-dit codes (#17659) 2026-01-25 22:43:22 +08:00
Simo Lin
7a1d7ab47b remove self managed protocols as it has been replaced with official oai spec (#17711) 2026-01-25 06:38:13 -08:00
Simo Lin
8db2802b2d update to use official openai protocol crate (#17710) 2026-01-25 06:35:59 -08:00
Simo Lin
6af22f8dbf use published reasoning parser crate (#17709) 2026-01-25 06:15:03 -08:00
Zhengbo Wang
fb61164f27 [Refactor] Use is_in_ci() utility in JIT kernel benchmarks (#17118) 2026-01-25 20:40:47 +08:00
Makcum888e
64d809937a revert row from https://github.com/sgl-project/sglang/pull/17584/ (#17701) 2026-01-25 12:17:47 +03:00
Makcum888e
d1042e0d62 [Refactore] [CI] Remove redundant CI test runs step 2 (#17584) 2026-01-24 23:39:48 -08:00