Commit Graph
8020 Commits
Author SHA1 Message Date
Rivers 2a5773440e refactor: replace worker pool with semaphore-based concurrency in jobqueue (#13383) 2025-11-16 17:57:59 -08:00
sglang-bot 7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
Baizhou Zhang d64dd3e18e [Tiny]Fix 1-gpu nightly test bugs (#13389) 2025-11-16 15:54:17 -08:00
Baizhou Zhang 3ccd7fa669 [CI] Fix B200 CI (#13387) 2025-11-16 15:13:57 -08:00
Lifu Huang 254f62d879 Support spec decoding when LoRA is applied to target model (#12903) 2025-11-16 13:20:23 -08:00
Cheng Wan 2b8b9d8496 [CI] use cached deepep installation in gb200 CI (#13388) 2025-11-16 12:49:01 -08:00
DangKai e970892ffa fix import qwenvl error in RL engine (#12874) 2025-11-16 12:01:16 -08:00
b8zhong d5fa58c4dd fix nightly docker build (#13386) 2025-11-16 11:21:09 -08:00
Netanel Haber 9f011f617f fix generative_models.md table - remove newlines (#13385) 2025-11-16 10:33:38 -08:00
ybyang 3b18fd4cf5 [router] bindings for go (#13384)
Signed-off-by: ybyang <ybyang7@iflytek.com>
2025-11-16 10:12:10 -08:00
Liangsheng Yin 1869f25ca5 Tiny deprecate the --range-begin in run_suite.py (#13381) 2025-11-16 23:15:36 +08:00
Liangsheng Yin e019f233f9 Remove unused code / testcases in lang (#13335) 2025-11-16 22:48:35 +08:00
b1c688fba2 refactor: cleanup vision attention related codes (#13228)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-16 22:44:40 +08:00
Zilin Zhu 8e3663d4e8 Add default enable_memory_saver to HybridLinearKVPool (#13371) 2025-11-16 22:35:13 +08:00
Zilin Zhu 9edb0e0da3 Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339) 2025-11-16 22:02:22 +08:00
Xiaoyu ZhangandYuan Luo 95f43669b5 [2 / 2] apply sgl-kernel weak_ref_tensor (#12978)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-16 21:24:35 +08:00
Xiaoyu Zhang 50691d7b49 [opt kimi k2 2/n] apply kimi k2 thinking moe_fused_gate (#13332) 2025-11-16 21:20:08 +08:00
Yuhao YangandMick 6afe396399 diffusion: support fa4 in fa backend for blackwell (#13263)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-16 21:02:45 +08:00
Mick 191f5c7795 diffusion: correct check-changes for multimodal_gen (#13375) 2025-11-16 20:32:33 +08:00
Adarsh Shirawalmath d724670873 [diffusion] refactor and added tests for Flux, T2V, TI2V, I2V(#13344) 2025-11-16 19:58:04 +08:00
Simo Lin efc5d8f5ed [model-gateway] fix SDist step readme path (#13373) 2025-11-16 03:16:52 -08:00
Simo Lin ef32a252d0 [model-gateway] fix model gateway pypi release workflow path (#13372) 2025-11-16 02:33:49 -08:00
Zilin Zhu 9509c4ccd3 [RL] enable offloading hybrid linear attn model (#13336) 2025-11-16 17:12:52 +08:00
Kangyan-Zhou 4e19c1d541 Add missing models (#13369) 2025-11-16 00:04:47 -08:00
Qiaolin YuandKangyan-Zhou 78a4b446c6 Fix dpsk-r1-fp4 tp8 by reverting two commits (#13162 and #13341) (#13348)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-15 21:31:36 -08:00
DarkSharpness f969664172 [Performance] Move the contiguous to torch compile region (#13199) 2025-11-15 20:49:52 -08:00
b8zhong f35f7f1245 [Piecewise CUDA Graph] Support W4A8 (#13179) 2025-11-16 11:53:50 +08:00
ash-sighandronnie_zheng 12c789ebd1 [Ascend]support xgrammar backend for ascend npu (#12310)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-11-15 19:39:24 -08:00
kyleliang-nv 597d416070 [feature] Add layerwise NVTX support (#11870) 2025-11-15 19:20:56 -08:00
sglang-bot 1ca205f6da chore: bump sgl-kernel version to 0.3.17.post1 (#13358) 2025-11-15 19:11:41 -08:00
b8zhong 24a25ffa20 [Piecewise CUDA Graph] Support ModelOpt FP4 (#13101) 2025-11-16 11:03:19 +08:00
Lianmin Zheng db7299aa30 [Fix] Register custom ops only if they exist (#13321) 2025-11-15 17:48:17 -08:00
Cheng Wan 13366843a4 [CI] check unit-test-backend-8-gpu-h20 in workflow (#13355) 2025-11-15 16:44:10 -08:00
Kangyan-Zhou be353ffd13 Add missing models (#13351) 2025-11-15 13:51:20 -08:00
iLeGend 20e59f9510 Add FP32 dtype support for RoPE - Part1 (#13181) 2025-11-15 11:37:18 -08:00
Vincent Zhong 0d116b9a0b Clean up deprecated tile_tokens_dim for next flashinfer (#13341)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
2025-11-16 00:50:15 +08:00
sglang-bot 4a56fa5cf2 chore: bump sgl-kernel version to 0.3.17.post1 (#13325) 2025-11-15 23:36:32 +08:00
FlyPanda 51f9b9628b [optimize] Provide Usrbio compilation and installation commands (#12329) 2025-11-15 23:06:24 +08:00
Liangsheng Yin daf494b681 tiny fix lint (#13337) 2025-11-15 23:05:08 +08:00
xlzheng 37e8724ef3 perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001) 2025-11-15 22:02:42 +08:00
Zhihao Lyuandronnie_zheng 10592e9c08 [Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-11-15 21:59:58 +08:00
Even Zhou 2aec8b6e1b [Feature] Spec-Overlap supporting DP-ATTN; PD-Disaggregation; npugraph mode (#12443) 2025-11-15 21:51:07 +08:00
Ke Bao 0d41ddfbd0 Temporarily disable test_vision_openai_server_a CI (#13331) 2025-11-15 19:46:49 +08:00
Simo Lin 37c8761567 [model-gateway] remove grpc feature flag and mark as default (#13330) 2025-11-15 03:16:57 -08:00
Adarsh Shirawalmath 3f400f25df [Diffusion] add health endpoints to diffusion server (#13329) 2025-11-15 19:12:37 +08:00
Yongfei Xu d91b16eb16 Opt tp: tp attn support tp reduce scattered input (#10568) 2025-11-15 02:08:12 -08:00
Xinyue Zhang 4a10e37ba7 [router] Fix flaky router e2e tests (#13306) 2025-11-15 02:00:25 -08:00
Charles Chen b051d76dab Fix: add missing get_embed_and_head in MiniMax M2 for Eagle3 (#13297) 2025-11-15 01:36:03 -08:00
Yineng Zhang d52d992a90 Update README (#13326) 2025-11-15 01:33:10 -08:00
fzyzcjy d971f22898 Super tiny expose transform_scale_ue8m0 API for RL frameworks (#13323) 2025-11-15 17:31:04 +08:00