Commit Graph

7131 Commits

Author SHA1 Message Date
Simo Lin
9054e844ea remove package json which is not used (#13810) 2025-11-23 15:00:30 -08:00
yinghui
18403f6bfe make trtllm attn backend's init_forward_metadat non blocking (#13802) 2025-11-23 13:35:40 -08:00
Qiaolin Yu
2892265d4c Tune fp8_w8a8 fused triton moe for GLM-4.6-FP8 (#13815) 2025-11-23 13:29:54 -08:00
Baizhou Zhang
c9bd1aca32 [CI] Tiny refactoring sgl-kernel tests (#13813) 2025-11-23 12:45:17 -08:00
hlu1
618ca23802 [Deepseek] Refactor deepseek server_args _handle_model_specific_adjustments (#13687) 2025-11-23 12:41:14 -08:00
Liangsheng Yin
5c2915494c [Scheduler] Tiny organize code style (#13806) 2025-11-23 23:41:34 +08:00
alisonshao
aaa40a9b3b Fix pagination bug in CI monitor preventing performance-test-2-gpu data collection (#13781) 2025-11-23 22:02:30 +08:00
Mick
dd70cf99c1 [diffusion] CI: add run_suite to multimodal_gen CI (#13791) 2025-11-23 21:27:33 +08:00
Mick
d4593964fe [diffusion] feat: support sp for image models (#13180) 2025-11-23 18:11:42 +08:00
YAMY
53fffefd5d Upgrade flashmla kernel for NSA tp support (#13718) 2025-11-23 01:36:49 -08:00
Xiaoyu Zhang
b964ce61d6 [DeepEP] Add SGLANG_DEEPEP_BF16_DISPATCH env var in Normal mode (#13787) 2025-11-23 17:32:43 +08:00
DarkSharpness
ac5505b04c [Feature] HiCache JIT kernel (once again) (#13764) 2025-11-22 22:19:16 -08:00
Peiqi Yin
a90435c059 Fix typo in docs (#13709) 2025-11-23 10:49:49 +08:00
Simo Lin
5354d7b7fd [model-gateway] clean up router manager function order (#13776) 2025-11-22 16:16:20 -08:00
Simo Lin
e01486778a [model-gateway] update smg code owner (#13777) 2025-11-22 15:50:53 -08:00
ErsongWang
047935080d Revert "Fix RMSNorm API CALL mismatch issue. (#10032)" (#13727) 2025-11-22 14:25:52 -08:00
cctry
cad7878964 Gather static input buffers for cuda graph (#13676) 2025-11-22 13:01:50 -08:00
Binyao Jiang
b29769f3b6 Move unnecessary input_addr capture under debug mode flag for speed-up (#13690) 2025-11-22 11:42:26 -08:00
Ho-Ren (Jack) Chuang
3990b84bd3 Refactor MHA & MLA KV caches to support FP4 (#13547)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
2025-11-22 11:13:43 -08:00
yinghui
5a4394a342 align code style eagle draft&draft_extend cuda graph runner (#13533) 2025-11-23 01:55:16 +08:00
Yuhao Yang
dd303614e0 [diffusion] CI: tinyfix diffusion ci (#13769)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-23 01:03:36 +08:00
Liangsheng Yin
863124684c [Spec v2] Remove allocate_lens and enable over-allocation (#13478) 2025-11-22 22:49:10 +08:00
Yuan Luo
5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-22 22:45:32 +08:00
Mick
ca548d8324 [diffusion] refactor: refactor sampling params (#13706) 2025-11-22 22:43:04 +08:00
Liangsheng Yin
3397bcee84 Tiny support different prompts in send_one.py (#13768) 2025-11-22 21:59:58 +08:00
Liangsheng Yin
3e804bb0ba Update mem checker during busy (#13704) 2025-11-22 21:15:02 +08:00
Yuhao Yang
a22de641ef [diffusion] fix: fix hunyuanvideo and add 2-gpu ci test (#13720)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-22 20:54:51 +08:00
Liangsheng Yin
ac43822634 Refactor eagle bigram key matching (#13714) 2025-11-22 20:40:42 +08:00
Yijie Zhu
a92afb00c6 [Ascend] support Kimi-K2-Thinking (#12759)
Co-authored-by: ZhengdQin <zhengdqin@gmail.com>
Co-authored-by: richhuan <huan_rz@qq.com>
Co-authored-by: ZhengdQin <46387172+ZhengdQin@users.noreply.github.com>
2025-11-22 17:33:07 +08:00
Trevor Morris
0eea17e3b5 Use dual stream for DS MoE whenever cuda graph is used (instead of with token threshold) (#9405) 2025-11-22 00:37:41 -08:00
Netanel Haber
3805243245 modularize gsm8k and mmmu test classes (#13506) 2025-11-22 16:06:53 +08:00
Baizhou Zhang
8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Lianmin Zheng
b41afa3754 [Auto Sync] Update evict_policy.py, radix_cache.py (20251120) (#13669)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: cctry <shiyang@x.ai>
2025-11-21 22:07:36 -08:00
alisonshao
94ae816f29 Fix model weights validation with automatic cache cleanup (#13729) 2025-11-22 11:40:00 +08:00
Glen Liu
53620a1b1a fix test_lora_update.py starvation message check (#13702) 2025-11-21 19:33:04 -08:00
Kangyan-Zhou
59b4d7f8d6 Fix B200 Nightly tests and move one manual test back to unit test to prevent the same issue (#13746) 2025-11-21 17:41:12 -08:00
Shu Wang
a56f770277 Fix global scaling factor loading hang (#13484) 2025-11-21 16:07:06 -08:00
roikoren755
1b48e1b974 Feat/nemotron nano v3 support (#12690) 2025-11-21 13:53:05 -08:00
b8zhong
a24aefe562 add some more labels (#13701)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-11-21 11:29:33 -08:00
fzyzcjy
45c572c58f Support torch 12.9 + DeepEP by removing custom nvshmem (#12949)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-21 11:11:43 -08:00
Qiaolin Yu
681b9e6425 Revert "enable csgmv automatically on cuda" (#13707) 2025-11-21 10:37:41 -08:00
alisonshao
dab06b50ab Fix: CI monitor should not exit with error on regressions (#13694) 2025-11-21 10:01:48 -08:00
b8zhong
85ffce30af [Piecewise CUDA Graph] Support Kimi-K2 (non-Thinking) (#13466)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-21 09:39:59 -08:00
Jiajun Li
e94ef9fcae Add to ci permission (#13739) 2025-11-22 01:21:09 +08:00
Liangsheng Yin
964cdedc50 [CI] minor hot fix of model validation list (#13737) 2025-11-22 01:00:41 +08:00
Mick
aa6e2c8aa0 [diffusion] log: minor improve logging (#13735) 2025-11-21 23:01:23 +08:00
fzyzcjy
1776dce557 Super tiny delete unused files (#13734) 2025-11-21 22:26:39 +08:00
Lianmin Zheng
99e13d189b Fix url: use https://roadmap.sglang.io for roadmap (#13733)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-21 05:42:32 -08:00
weibingo
dc836909a6 fix 3fs down, lock schedule main thread (#13407) 2025-11-21 03:02:36 -08:00
Mick
323fed5cfd [diffusion] doc: add contributing.md (#13649) 2025-11-21 19:00:27 +08:00