chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Douglas Yang
45715af50c fix: nightly whl dev date suffix (#18873) 2026-02-16 10:57:37 +08:00
Rain Jiang
0ffd0a3995 Nsa trtllm mla sparse fp8 support with Deepseek v3.2 NVFP4 (#18389) 2026-02-16 09:29:54 +08:00
Mohammad Miadh Angkad
8290171f52 [CI] Remove --mem-fraction-static 0.93 from gpt-oss test (#18869) 2026-02-16 09:24:11 +08:00
Xiaoyu Zhang
d3bae71e3f Add claude skills for sgl-kernel and jit-kernel (#18855) 2026-02-15 15:14:03 -08:00
chenxu214
fd5a45d5cf Update ascend_npu_support.rst (#18868) 2026-02-16 01:41:38 +08:00
chenxu214
f2d72866e9 Create ascend_npu_qwen3_5_examples.md (#18864) 2026-02-16 01:15:20 +08:00
blake-snc
0d30896015 fix(sgl-kernel): use >= 120 for SM12x CUDA kernel dispatch (#18750) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-16 00:44:47 +08:00
blake-snc
5fc328465a fix(sgl-kernel): support CUDA 13 runtime preloading for DGX Spark (#18747) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-16 00:43:04 +08:00
Mike Qiu
b79808bee2 Fix libnuma.so does not exsit (#15355) 
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: fzyzcjy <5236035+fzyzcjy@users.noreply.github.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2026-02-16 00:37:50 +08:00
akhilg-nv
48eac1b62d Improve profiler options for bench_serving (#16991) 2026-02-16 00:36:01 +08:00
Blake Ledden
f759960ac2 feat: expose consistent_hashing policy in Python router CLI args (#17972) 2026-02-16 00:33:24 +08:00
Chanh Nguyen
597d17dd18 Use ephemeral nccl port via get_free_port() (#18009) 
Co-authored-by: Chanh Nguyen <cnguyen@linkedin.com>
 2026-02-16 00:32:47 +08:00
tjp_zju
7a607c4900 fix_get_quant_method_in_fused_moe_condition (#18459) 
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
 2026-02-16 00:31:42 +08:00
Zack Yu
536ed3143b test: add test for Modelopt FP8 on SM90 (#18463) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-02-16 00:29:37 +08:00
WiwilZ
b2f74d660a fix: add SM110 (Jetson AGX Thor) to Blackwell capability check (#18787) 2026-02-16 00:26:58 +08:00
blake-snc
57f7e06cb9 fix: update Blackwell log/error messages to include SM12x (#18751) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-16 00:23:51 +08:00
SoluMilken
07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
Alison Shao
f7603203b0 Enable DeepGemm fast warmup in CI to prevent cold-cache timeouts (#18823) 2026-02-16 00:02:30 +08:00
Douglas Yang
4ef8ece08a feature: adding build commit to sgl kernel workflow (#18853) 2026-02-15 23:28:43 +08:00
Ratish P
ddfe147377 [diffusion]: Improve layerwise offload buffer reuse and shared-storage handling (#18611) 2026-02-15 22:17:51 +08:00
chenxu214
4e162d4b1b change npu.dockerfile (#18835) 2026-02-15 20:43:15 +08:00
Mick
3feb48139e [diffusion] quant: add support for svdquant and nunchaku (#18549) 
Co-authored-by: AichenF <aichenf@nvidia.com>
Co-authored-by: jianyingzhu <53300651@qq.com>
 2026-02-15 20:43:00 +08:00
Michael
88010e9601 [AMD] Fix nightly 1-GPU test failures and bench_serving regression (#18761) 
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
 2026-02-15 20:36:47 +08:00
fzyzcjy
90555a0228 Add missing dumper tests (#18859) 2026-02-15 18:42:57 +08:00
fzyzcjy
4c7f986c6b Extract dumper and prefill delayer tests common utils (#18857) 2026-02-15 18:33:23 +08:00
haowen-han
b992828ad2 fix: fix bug on kimi2.5 with dp2 and tp4 (#18604) 
Co-authored-by: hanhaowen <hanhaowen@baidu.com>
 2026-02-15 16:32:13 +08:00
Ratish P
274bf6607a [diffusion] fix: enable torch.compile for UlyssesAttention (#18840) 2026-02-15 15:54:27 +08:00
zhangxiaolei123456
ad1bdb93df perf: add minimax-2.5 fused_moe tuning config for h20 (#18833) 2026-02-15 15:46:56 +08:00
jackey hua
922fbc21e2 [Perf] Tune MiniMax M2 fused moe kernel on H100 GPU (#18851) 2026-02-15 15:30:52 +08:00
andyluo7
944a9f6fcf Fix/qwen3 5 amd rope cutedsl fallback (#18753) 
Co-authored-by: seungrokj <seungrok.jung@amd.com>
 2026-02-14 22:09:44 -08:00
muse-coder
91230dcca8 [FIX] Correct JIT kernel compilation on newer GPUs with outdated driver metadata. (#18496) 
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-02-15 12:14:39 +08:00
Bhavneek Singh
1ce3420784 Model: Support IBM Granite (Dense/Mamba + MoE) (#18040) 2026-02-15 11:24:41 +08:00
shuwenn
4cf4f0859f [Doc] Convert the speculative decoding notebook to markdow (#18395) 2026-02-14 18:18:56 -08:00
Lianmin Zheng
b33769786f [Auto Sync] Update grpc_request_manager.py, tokenizer_manag... (20260214) (#18838) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2026-02-14 18:12:32 -08:00
Guangda Liu
190fa8246f Fix model loading for DeepSeek-V3.2-AWQ (#16907) 
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
 2026-02-15 09:39:53 +08:00
Lianmin Zheng
8b2020584c [Auto Sync] Update test_deterministic.py (20260214) (#18839) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Jiayi Yuan <34369239+jy-yuan@users.noreply.github.com>
 2026-02-14 17:19:30 -08:00
Mohammad Miadh Angkad
b1b69ae0a9 Add CI permissions (#18847) 2026-02-15 08:24:36 +08:00
Xiaoyu Zhang
4067d9487d [diffusion] feat: opt vae decode with channels_last_3d (#18540) 2026-02-14 23:19:45 +08:00
Xiaoyu Zhang
c29394e3c8 [kernel slimming] Move fast_hadamard_transform to jit_kernel (#18475) 2026-02-14 23:06:21 +08:00
Kangyan-Zhou
ae95869292 Enable SGLANG_ENABLE_SPEC_V2 for nightly speculative decoding tests (#18719) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-02-14 23:00:33 +08:00
Raayan Dhar
92cdd398cd feat: Support mrope_section with rope_type: "yarn" (#13313) 
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
Signed-off-by: raayandhar <raayan.dhar@gmail.com>
 2026-02-14 22:51:44 +08:00
Ke Bao
f51e9d9ca1 Add ci test for ring model (#18829) 2026-02-14 22:20:23 +08:00
ybyang
c8aa2a6534 Fix dsv32 encode_messages (#18126) 2026-02-14 16:44:13 +08:00
Johnsonms
34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) 2026-02-14 16:40:15 +08:00
Bingxu Chen
38473f8ee0 [AMD] Fix sgl-model-gateway Build Errors in ROCm Docker Release (#18836) 2026-02-14 00:07:26 -08:00
Zehuan Li
e2eb5bf28d [DLLM] Update CODEOWNERS for diffusion LLM (#18834) 2026-02-14 15:31:42 +08:00
Yuan Luo
fa0ef6e4f7 [VLM][LLM] Optimize fused_moe triton kernel tma (#18782) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-02-14 14:35:26 +08:00
JD
f6c18c3a85 Fix/partial gen from waiting queue miss metadata (#17610) 2026-02-13 19:04:08 -08:00
R0CKSTAR
45a4697d45 [diffusion][MUSA] fix: MUSA platform breakage caused by PR #13662 (#18456) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-02-14 11:00:39 +08:00
Alison Shao
8ef3e3d56b Fix CI concurrency collision between scheduled runs and fork PRs (#18826) 2026-02-14 10:48:31 +08:00