chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
10,506 Commits 1 Branch 0 Tags
d093e700672defeb9bfedce9c084b3ee00a3d326
Commit Graph

10506 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Matt Van Horn
d093e70067 [Doc] Add DSA/NSA attention backend to support matrix (#20326) 
Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-11 13:40:35 -04:00
R0CKSTAR
dae5c6cadf [diffusion] doc: add Moore Threads as a supported vendor (#20146) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-03-11 10:15:15 -07:00
Thomas
05e40922b3 [Doc] Fix wrong link and cmd description (#20365) 2026-03-11 11:30:45 -04:00
Even Zhou
6cfc21ba74 [NPU] Bump SGL-Kernel-NPU version to 2026.03.10.rc1 (#20362) 2026-03-11 22:28:21 +08:00
Артем Савкин
ed42af99a9 [NPU] [Quantization] w4a4 MoE layer support (#18924) 2026-03-11 16:52:35 +03:00
Yoray Zack
9991debde3 [Feature] Integrate Elastic NIXL-EP into SGLang (#19248) 
Signed-off-by: Barak Biber <bbiber@nvidia.com>
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Barak Biber <bbiber@nvidia.com>
 2026-03-11 17:37:43 +08:00
Xiaoyu Zhang
680d9d98e4 Fix cutedsl ci error (#20309) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-03-11 16:17:35 +08:00
qy-seu
456934fed5 feat: fix update last_receive_tstamp logic for health-check in multi-token-worker mode (#20256) 2026-03-11 00:23:22 -07:00
Liangsheng Yin
61cad15d28 [Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306) 2026-03-11 00:07:37 -07:00
Kurkur
55e6acf834 [NPU][QwenVL] Support qwen image preprocess on npu (#20189) 2026-03-11 15:03:08 +08:00
Xuhao Zhang
57b093dc34 [NPU]MindSpore backend support eagle3 (#17098) 
Co-authored-by: wangtiance <tiancew@qq.com>
Co-authored-by: Tiance Wang <wangtiance@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2026-03-11 09:11:19 +03:00
zhaoshang
18cfeabd33 Add SGLANG_SORT_WEIGHT_FILES env var for sequential I/O optimization (#20194) 
Signed-off-by: zhaoshang <zhaoshangsjtu@linux.alibaba.com>
 2026-03-11 14:10:53 +08:00
Ke Bao
4011065c65 Update CODEOWNERS (#20320) 2026-03-11 14:08:07 +08:00
Mick
8c8a487468 [diffusion] doc: add diffusion-optimal-perf (#20311) 2026-03-11 12:20:09 +08:00
Aleksi Vesanto
c8bbe5010a [diffusion] feat: add AITER Sage attention backend (#20178) 2026-03-11 12:17:45 +08:00
xieminghe1
21a0015aa3 [PCG]add piecewise cuda graph support for marlin linear (#20119) 
Co-authored-by: undefined <zhouchen.arrebol@jd.com>
 2026-03-11 10:57:08 +08:00
sglang-bot
fe294904c9 [README] Add GB300 NVL72 inference blog post to News section (#20313) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
 2026-03-10 19:31:37 -07:00
Polisetty V R K Jyothendra Varma
b2dd104ade [Intel GPU] Upgrade pytorch xpu version to 2.10 (#20254) 
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
 2026-03-10 18:47:25 -07:00
Kurkur
16ec4f3a4a Integrate the AddRmsNorm operator (#19939) 2026-03-11 09:05:04 +08:00
Liangsheng Yin
50953aea8d [Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296) 2026-03-10 17:50:23 -07:00
Michael
7a1ca53805 [AMD] Fix JSON mode streaming test flake on AMD CI (#20293) 2026-03-10 17:24:11 -07:00
Michael
dc4380e33a [AMD] [DeepSeek-OCR-2 Day 0] Enable DeepSeek-OCR-2 on AMD GPUs and add nightly test (#19732) 2026-03-10 17:04:35 -07:00
Alison Shao
eea7f8de41 [CI] Fix B200 runner label for scheduled runs (#20297) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 16:00:31 -07:00
Alison Shao
f32882cee5 [CI] Relax Eagle infer_b spec accept length threshold (#20300) 
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
 2026-03-10 15:40:52 -07:00
Qiaolin Yu
09a118fafe Support return_logprob for spec v2 (overlap safe) (#19801) 
Co-authored-by: Ratish1 <ratish1501@gmail.com>
Co-authored-by: Ratish1 <formula733@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-10 15:38:27 -07:00
Ziang Li
76ee4bb98c [FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537) 2026-03-10 15:37:57 -07:00
Qiaolin Yu
bd460e9565 add logprob related params in bench_serving (#20218) 2026-03-10 15:04:57 -07:00
R0CKSTAR
db97f193b7 [diffusion][llm] macOS support (#19549) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-10 13:11:07 -07:00
Qiaolin Yu
a3d88a247b Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453) 2026-03-10 12:50:57 -07:00
fxmarty-amd
031d0a2aad [Qwen-MOE] Fix memory duplication issues in case layers weights are re-assigned during weight loading (#18255) 2026-03-10 17:34:56 +00:00
Xinyuan Tong
11d9c36c2f Replace soundfile+torchaudio with torchcodec AudioDecoder in load_audio (#20190) 2026-03-10 17:26:29 +00:00
Mick
e1f0b3181a [diffusion] fix: adjust convert_hf_to_fp8 to be compatible with more dits (#20281) 2026-03-11 01:21:54 +08:00
Xiaoyu Zhang
60cc06297e [4/n jit_kernel restruct] speed up CI tests and add benchmark workflow (#20268) 2026-03-10 21:37:41 +08:00
JiaruiChang5268
5a7c1b8ec6 [NPU] replace swiglu with custom kernel 2026-03-10 21:08:37 +08:00
Hexq0210
9884957c07 [NPU] Bugfix for qwen35 on NPU (#19756) 2026-03-10 20:03:26 +08:00
heziiop
6ed996bf65 [bugfix] disable share input buffer feature on npu due to accuracy issue (#19507) 2026-03-10 19:26:46 +08:00
Xiaoyu Zhang
51d9d34977 [2/n jit_kernel restruct] unify rotary embedding entrypoints under rope.py (#20247) 2026-03-10 17:49:57 +08:00
Thomas Wang
6407891b4f [AMD] Fp8 prefill integration with radix cache path for dpsk models (#20187) 2026-03-10 02:49:47 -07:00
Yuan Luo
751c454099 Add DeepSeek3.2 and GlmMoeDsa into moe tune (#18876) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-03-10 17:12:58 +08:00
Liangsheng Yin
ac07a6d439 Revert "[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result" (#20259) 2026-03-10 01:58:48 -07:00
Lancer
8cd1de3354 [diffusion] fix: map each prompt to corresponding image in multi-prompt scenario (#20081) 
Signed-off-by: Lancer <maruixiang6688@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-03-10 16:58:21 +08:00
Lancer
2c2003158f [diffusion] fix: fix flux2 lora (#20200) 
Signed-off-by: Lancer <maruixiang6688@gmail.com>
 2026-03-10 16:57:01 +08:00
Xiaoyu Zhang
8517da5d08 [3/n jit_kernel restruct] Clean up benchmark naming and benchmarking helpers (#20250) 2026-03-10 16:39:03 +08:00
Xiaoyu Zhang
c812504b92 [1/n jit_kernel restruct] unify cache usage and clean up naming in ngram_embedding (#20244) 2026-03-10 15:53:43 +08:00
Johnsonms
7cf0551014 Migrate norm kernels to FlashInfer JIT implementation (#18871) 2026-03-10 14:56:07 +08:00
Junrong Lin
69158e9d9f [Bugfix] Skip _mamba_verify_update for idle batch (#20167) 2026-03-10 14:53:01 +08:00
Yuwei An
834795adb8 [CI] Refactor PCG related CI (#19994) 
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-03-10 14:49:25 +08:00
liupeng374
9b2e5526fb [NPU][Bug fix] context parallel bug fix (#19820) 2026-03-10 14:43:49 +08:00
khalilzhk
5f717913a0 support Kimi-K2.5-w4a8 on ascend 2026-03-10 14:43:27 +08:00
Jacob0226
dadd4dde83 [AMD] Skip the flaky test for lora ci test. (#20175) 
Co-authored-by: YC Tseng <yctseng@amd.com>
 2026-03-09 23:15:30 -07:00