Commit Graph

6950 Commits

Author SHA1 Message Date
Kangyan-Zhou
2bc7c5ebef Fix 8-gpu B200 nightly tests (#13457) 2025-11-17 13:26:56 -08:00
Sirut Buasai
a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) 2025-11-17 13:14:17 -08:00
Kangyan-Zhou
58f8f4e408 Add missing models (#13456) 2025-11-17 13:10:37 -08:00
Simo Lin
25acbbc612 Remove verbs from GET endpoint paths to follow REST standards (#13273) 2025-11-17 12:34:36 -08:00
hlu1
a8fcbf6fe3 [Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-17 12:20:49 -08:00
Liangsheng Yin
e486308c99 Temporarily disable model hooks CI (#13450) 2025-11-18 02:35:13 +08:00
Liangsheng Yin
6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) 2025-11-18 02:08:19 +08:00
Mick
ff00b6adbe diffusion: fix loading with local model_path (#13445) 2025-11-18 00:56:30 +08:00
Xiaoyu Zhang
7b44526038 [Ci tiny fix] Lower score threshold in evaluation test (#13443) 2025-11-18 00:45:20 +08:00
Rain H
c236d05f8c Fix log time stats (#13418) 2025-11-17 23:10:49 +08:00
Carlo Mussolini
df56139226 Adding user defined hooks support (#13217) 2025-11-17 23:07:37 +08:00
kebyn
15db5497d3 [feature] Custom base path on FastAPI server (#5879)
Co-authored-by: lianhu.yin <lianhu.yin@nio.com>
Co-authored-by: kebyn <kebyn@kebyn.cc>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-11-17 22:40:09 +08:00
Mike Qiu
9ba3597d2a Fix cache_tokens calculate issue when retracted (#11900)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
2025-11-17 21:25:38 +08:00
Xuchun Shang
80797c2a15 [PD][bug fix] fix memleak when last_batch is none (#13144)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2025-11-17 21:22:20 +08:00
Mick
7afff8fd1a diffusion: fix wan2.2 ti2v num_frames adjust logic (#13379)
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
2025-11-17 20:53:15 +08:00
AlphaBaby
ac406d4301 fix uneven PP layer indices (#13282)
Co-authored-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
2025-11-17 19:54:23 +08:00
Simo Lin
b436113fc2 [model-gateway] Add Gateway Release Tooling (#13420) 2025-11-17 03:26:48 -08:00
Xiaoyu Zhang
8b5e2c5368 [Tiny fix] Fix bench_speculative.py run bug (#13416) 2025-11-17 18:58:19 +08:00
Simo Lin
b24235b8bb [model-gateway] update workflow names for gateway and exclude npu (#13415) 2025-11-17 02:04:07 -08:00
Liangsheng Yin
ae7698fbd5 Remove deprecated scripts (#13399) 2025-11-17 16:54:39 +08:00
Yi Zhang
a3e4fe4b41 refactor linear memory pool (#13004) 2025-11-17 16:24:29 +08:00
fzyzcjy
f3e9336dcb Support weight update for blackwell DeepGEMM (#13324) 2025-11-17 15:55:26 +08:00
Teng Ma
290fcd8971 [HiCache] add GPU id to IB dev topo for mooncake storage backend (#13112) 2025-11-17 15:48:29 +08:00
huangtingwei
1dcde53928 [HiCache] support memory_pool_host page head layout (#11644) 2025-11-17 13:45:17 +08:00
Ying Sheng
15bc1f5cd7 Update .github/MAINTAINER.md (#13398)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-16 21:32:24 -08:00
Lianmin Zheng
4d59761623 [Doc] Update CI oncall list (#13396)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
2025-11-16 20:43:12 -08:00
Liangsheng Yin
ab63f3c50b [1/N] CI refactor: introduce CI register. (#13345) 2025-11-17 12:21:20 +08:00
Zilin Zhu
147b782352 [RL] re-abort_request when model_update_lock is still locked (#13338) 2025-11-17 12:13:39 +08:00
lixiaolx
d368c7451a (1/n)support context parallel with deepseekv3.2-DSA (#12065) 2025-11-16 20:12:25 -08:00
Lianmin Zheng
7e626d12b7 Update docs (#13391)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-16 19:36:33 -08:00
Rivers
2a5773440e refactor: replace worker pool with semaphore-based concurrency in jobqueue (#13383) 2025-11-16 17:57:59 -08:00
sglang-bot
7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
Baizhou Zhang
d64dd3e18e [Tiny]Fix 1-gpu nightly test bugs (#13389) 2025-11-16 15:54:17 -08:00
Baizhou Zhang
3ccd7fa669 [CI] Fix B200 CI (#13387) 2025-11-16 15:13:57 -08:00
Lifu Huang
254f62d879 Support spec decoding when LoRA is applied to target model (#12903) 2025-11-16 13:20:23 -08:00
Cheng Wan
2b8b9d8496 [CI] use cached deepep installation in gb200 CI (#13388) 2025-11-16 12:49:01 -08:00
DangKai
e970892ffa fix import qwenvl error in RL engine (#12874) 2025-11-16 12:01:16 -08:00
b8zhong
d5fa58c4dd fix nightly docker build (#13386) 2025-11-16 11:21:09 -08:00
Netanel Haber
9f011f617f fix generative_models.md table - remove newlines (#13385) 2025-11-16 10:33:38 -08:00
ybyang
3b18fd4cf5 [router] bindings for go (#13384)
Signed-off-by: ybyang <ybyang7@iflytek.com>
2025-11-16 10:12:10 -08:00
Liangsheng Yin
1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) 2025-11-16 23:15:36 +08:00
Liangsheng Yin
e019f233f9 Remove unused code / testcases in lang (#13335) 2025-11-16 22:48:35 +08:00
Xinyuan Tong
b1c688fba2 refactor: cleanup vision attention related codes (#13228)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-16 22:44:40 +08:00
Zilin Zhu
8e3663d4e8 Add default enable_memory_saver to HybridLinearKVPool (#13371) 2025-11-16 22:35:13 +08:00
Zilin Zhu
9edb0e0da3 Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339) 2025-11-16 22:02:22 +08:00
Xiaoyu Zhang
95f43669b5 [2 / 2] apply sgl-kernel weak_ref_tensor (#12978)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-16 21:24:35 +08:00
Xiaoyu Zhang
50691d7b49 [opt kimi k2 2/n] apply kimi k2 thinking moe_fused_gate (#13332) 2025-11-16 21:20:08 +08:00
Yuhao Yang
6afe396399 diffusion: support fa4 in fa backend for blackwell (#13263)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-16 21:02:45 +08:00
Mick
191f5c7795 diffusion: correct check-changes for multimodal_gen (#13375) 2025-11-16 20:32:33 +08:00
Adarsh Shirawalmath
d724670873 [diffusion] refactor and added tests for Flux, T2V, TI2V, I2V(#13344) 2025-11-16 19:58:04 +08:00