chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

11116 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
R0CKSTAR
07633349c9 [diffusion] fix: webui task_type check (#18462) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 21:19:16 +08:00
Mick
efdd676d56 [diffusion] refactor: merge redundant default_dtype and param_dtype parameters in FSDP loader (#18789) 2026-02-13 21:18:02 +08:00
Kaixi
98ad284ebf Added cuda availability guard (#18480) 2026-02-13 20:18:34 +08:00
Ke Bao
a0ebaa6498 Cleanup debug log for Ring model (#18793) 2026-02-13 18:36:20 +08:00
Ke Bao
a9d59776cc Enhence gsm8k test (#18791) 2026-02-13 18:08:57 +08:00
Ke Bao
eacab2868a Adjust mamba cache allocation (#18786) 2026-02-13 18:06:23 +08:00
Ke Bao
a6c4b52ac5 Cleanup unused rerun stages (#18788) 2026-02-13 17:44:42 +08:00
Yinghai Lu
e4b2b57620 [schedule] Fix streaming return of customized_info (#18654) 2026-02-13 17:19:16 +08:00
Xinwei Qiang
356e338607 [diffusion] feat: support SparseVideoGen2 attention backend (#17507) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 16:20:46 +08:00
ant-yy
d97eb111a3 Support LingV2_5 model (#18598) 
Co-authored-by: zhangkaihong.zkh <zhangkaihong.zkh@antgroup.com>
Co-authored-by: 有禾 <zhangdonghao.zdh@antgroup.com>
Co-authored-by: yudian0504 <138860534+yudian0504@users.noreply.github.com>
Co-authored-by: 悠扬 <youyang.zmy@antgroup.com>
Co-authored-by: xinxingyang <xinxing.yangxx@antgroup.com>
Co-authored-by: zmy460290 <zmy460290@antgroup.com>
 2026-02-13 16:09:15 +08:00
Xiaoyu Zhang
013a199bc6 [CI] Skip cutedsl gdn performance test in jit_kernel ci (#18783) 2026-02-13 15:49:30 +08:00
Shangming Cai
1f39bf6523 [Bugfix] Add warnings when NSA indexer cache indice mismatch in PD module (#18727) 2026-02-13 15:20:05 +08:00
Liangsheng Yin
e6f7a372ef Rename request timeout env vars for waiting/running stages (#18766) 2026-02-12 22:58:40 -08:00
xiaoye
5700b19cbf [diffusion] feat: support tp for qwen-image-edit-2511 (#18619) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 13:04:29 +08:00
Liangsheng Yin
d29e331491 [Spec] Move forward timeout before verify to fix Eagle v1 filter mismatch (#18760) 2026-02-12 20:58:34 -08:00
pansicheng
7d4ae057ec [Kernel] Add JIT rotary_embedding_kernel (#17934) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: root <root@zhikuan-A10x2.ea134>
 2026-02-13 12:41:25 +08:00
Bhavneek Singh
32e0286829 [diffusion] fix: fixe local model loading issue in bench_serving (#18687) 
Co-authored-by: Bhavneek Singh <blazingbhavneek@Bhavneeks-MacBook-Air.local>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 11:57:52 +08:00
HuangJi
f4d80f9d42 [diffusion] feat: allows quality adjustment of generated images/videos (#17937) 2026-02-13 11:56:20 +08:00
Bingxu Chen
6555b2a71d [diffusion] fix: fix ci on amd (#18716) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-13 11:51:24 +08:00
BourneSun0527
f65c885e7c Modify glm5 readme on npu (#18768) 2026-02-13 11:42:40 +08:00
shuwenn
bc2405e6c1 feat: support release lookup (#18450) 2026-02-13 10:47:02 +08:00
Lianmin Zheng
c56a5efbaa [Auto Sync] Update grok.py (20260213) (#18765) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2026-02-12 18:41:41 -08:00
Lianmin Zheng
d5f66fec15 Revert changes to weight_utils.py (#18759) 2026-02-12 17:15:16 -08:00
Alison Shao
dd77bd4651 Fix invalid import paths in glm_image.py (#18757) 2026-02-12 16:44:34 -08:00
Lianmin Zheng
9815ee934c [Auto Sync] Update weight_utils.py (20260212) (#18692) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Dan Zheng <dzheng@x.ai>
 2026-02-12 16:26:05 -08:00
Hao Jin
b48fe1d95e [Diffusion] [BUG] Fix missing initialization of GLM-Image text encoder config (#18704) 
Co-authored-by: Hao Jin <Hao Jin>
 2026-02-12 16:19:22 -08:00
HAI
f4417475b8 Build ROCm7.2 Image with latest AITER v0.1.10.post3 (#18741) 2026-02-12 14:30:13 -08:00
Shangming Cai
2a8a48c0ca Reuse initialized transfer engine in mooncake store (#18460) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-02-13 01:21:35 +08:00
Simo Lin
0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Douglas Yang
e730c728d3 fix: image version in pypi pr workflow (#18735) 2026-02-13 00:18:01 +08:00
Xiaoyu Zhang
9e9e949261 speed up sgl-kernel build (#18586) 2026-02-12 23:43:22 +08:00
Simo Lin
2f283d8152 refactor: consolidate gRPC client into shared crate dependency (#18730) 2026-02-12 06:43:24 -08:00
Kangyan-Zhou
1b8f68af57 Fix B200 installation issue (#18725) 2026-02-12 22:06:23 +08:00
Yi Zhang
b168723424 [BUGFIX] fix bug in handle mamba radix cache in server_args (#18723) 2026-02-12 21:33:32 +08:00
Simo Lin
92c5749f41 refactor: replace local proto compilation with smg-grpc-proto package (#18682) 2026-02-12 05:29:24 -08:00
Scott Lee
c59b9223e6 Add spec_accept_histogram request statistic (#18332) 2026-02-12 21:09:21 +08:00
Alison Shao
0abe4a22c6 Fix flaky penalty tests by using higher temperature for effect comparison (#18380) 
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-02-12 21:08:37 +08:00
Kangyan-Zhou
f116b3a51b Make PR based docker and pypi workflow work for forked PR (#18720) 2026-02-12 21:05:17 +08:00
Hudson Xing
f3656432c7 add tool_choice=auto nightly test case (#18302) 2026-02-12 19:28:05 +08:00
Thomas Wang
e20e6c28b9 [AMD] Fix accuracy issue when running TP4 dsv3 model with mtp (#18607) 
Co-authored-by: YC Tseng <yctseng@amd.com>
Co-authored-by: kkHuang-amd <wunhuang@amd.com>
 2026-02-12 01:13:16 -08:00
YC Tseng
d6f0ef677b [AMD] reset AMD image release time and reduce CI queue time (#18707) 2026-02-12 01:05:53 -08:00
Alison Shao
f20b1703ce [CI] Fix torchaudio/torchvision CUDA version mismatch (#18211) 2026-02-11 23:47:32 -08:00
chenxu214
1edc69be08 [Ascend]Support qwen3.5 (#18544) 
This PR affects only the NPU. If any issues arise, please contact iforgetmyname.
 2026-02-12 15:22:47 +08:00
Alan Kao
0305d12df2 [AMD] Enable release image build for ROCm 7.2.0 (#18698) 2026-02-11 23:16:54 -08:00
Vinh H. Pham
feaa9e7e00 [diffusion] fix: replace TextEncoderConfig with Qwen3TextConfig for Z-Image (#18560) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-12 14:31:23 +08:00
JooYeon
c9297661b9 fix: /metrics endpoint always reports engine_type="unified" in PD disaggregation mode (#18552) 
Co-authored-by: joo_yeon.lee <joo_yeon.lee@samsung.com>
 2026-02-12 14:20:43 +08:00
Li Jinliang
d91ce176bf Update README commands to include model-path option (#18557) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-02-12 14:15:26 +08:00
Zheng Li
4ed2548427 [Qwen3_5] Refactor Qwen3_5ForCausalLMMTP class implementation (#18538) 2026-02-12 13:38:26 +08:00
YAMY
454676811e [Flashinfer Autotune] Fix FlashInfer FP4 MoE autotuning crash by removing incorrect flatten on hidden_states_scale (#18500) 2026-02-12 13:31:27 +08:00
YC Tseng
20554a0a4f [AMD] rocm 7.2 image release, PR test, Nightly Test (#17799) 
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: bingxche <Bingxu.Chen@amd.com>
Co-authored-by: Michael <13900043+michaelzhang-ai@users.noreply.github.com>
 2026-02-11 21:29:25 -08:00