Commit Graph

7002 Commits

Author SHA1 Message Date
Baizhou Zhang
9f59194f29 [Fix] Fix DeepSeek V3 MTP on B200 (#13548) 2025-11-18 16:30:26 -08:00
Kangyan-Zhou
cf1f0166b6 Add Qwen/Qwen1.5-MoE-A2.7B to model list (#13543) 2025-11-18 14:43:38 -08:00
Baizhou Zhang
10969ae4be [chore] Disable ccache for sgl-kernel release (#13541) 2025-11-18 14:28:58 -08:00
b8zhong
92ad2ff9ce Flashinfer TRTLLM-GEN-MoE + Qwen3 (#13489) 2025-11-18 14:18:29 -08:00
Baidu-AIAK
9b64f6f359 [fix] Fixes accuracy issues caused by incorrect use of rope (#13495) 2025-11-18 14:17:33 -08:00
Kangyan-Zhou
c0d1a3383b Remove jet-ai/Jet-Nemotron-2B in nightly text tests as this is constantly failing (#13540) 2025-11-18 13:58:16 -08:00
gongwei-130
a9d22b751d fix lora test (#13537) 2025-11-18 12:40:35 -08:00
Simo Lin
6b9459e86c [docker] fix dockerfile naming for diffusion (#13534) 2025-11-18 12:18:32 -08:00
Chang Su
3a6ec47b0b [model-gateway] limit opened files in docker build to fix edge case (#13536) 2025-11-18 12:17:38 -08:00
Chang Su
b8e32e7965 [model-gateway] fix gateway docker build due to recent py code change (#13532) 2025-11-18 11:24:25 -08:00
Liangsheng Yin
f5566acc2a [CI] fix CI skipped on main (#13527) 2025-11-19 01:19:08 +08:00
Glen Liu
d79e12941c Small cleanups related to LoRA weight loading (#13474) 2025-11-18 09:14:34 -08:00
Liangsheng Yin
6e9b154981 [CI] fix skipping pr-gate on main (#13525) 2025-11-19 00:57:22 +08:00
Liangsheng Yin
109f27ba3a [CI] update pr-gate to be compatible with new slash triggering mananer. (#13522) 2025-11-19 00:49:13 +08:00
sglang-bot
c1a30aa765 Add /tag-and-rerun-ci (#13521) 2025-11-18 06:53:53 -08:00
Lianmin Zheng
2e1dbdb258 Update docs (#13519)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 06:24:58 -08:00
Lianmin Zheng
6d025fd35b Trigger CI retry with edit (#13516)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 05:42:31 -08:00
Junrong Lin
518467be64 [Feature] Re:Enable hybrid mem saver (#12962) 2025-11-18 21:29:15 +08:00
Lianmin Zheng
63807079b9 Add docs on trigger ci (#13513)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 05:23:05 -08:00
Lianmin Zheng
f6cfe9f197 Use slash command to trigger CI (#13512)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:39:58 -08:00
Lianmin Zheng
7bc99d4164 README.md -> FOLDER_README.md (#13510)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:10:04 -08:00
Lianmin Zheng
e2d6746808 Add .github/CI_PERMISSIONS.json to define the CI permissions (#13509)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 04:00:15 -08:00
alisonshao
6beb6e991f fix: create git tags directly instead of temporary branches (#13168) 2025-11-18 03:23:27 -08:00
Morpheus Guo
7e88b9c128 [BugFix] Accuracy and function Issue when run ptpc quant model (#13157)
Co-authored-by: yuechguo <yuechguo@amd.com>
2025-11-18 01:54:58 -08:00
Zhiqiang Xie
cfcf2758aa [HiCache] Critical fix to host memory double free (#13501)
Co-authored-by: Hao Chen <cighao@gmail.com>
2025-11-18 01:34:23 -08:00
Nicholas
ac81db66c2 [VLM][feat] Support encoder DP for Qwen2.5-VL (#13126)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-18 16:13:18 +08:00
Liangsheng Yin
33905005ee [CI] fix lint yml (syntax error) (#13496) 2025-11-18 15:53:33 +08:00
Xiaoyu Zhang
820e13c9c1 [opt kimi k2 3/n] opt kimi_k2 moe_fused_gate kernel (#13374) 2025-11-18 15:36:31 +08:00
Liangsheng Yin
595adf6d93 [CI] Add input for pr-gate (#13491) 2025-11-18 15:35:49 +08:00
Cheng Wan
a5ad0069b2 fix: change performance log directory to cache path (#13482)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-18 15:18:43 +08:00
Liangsheng Yin
4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) 2025-11-18 14:59:46 +08:00
Liangsheng Yin
67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) 2025-11-18 14:24:58 +08:00
alisonshao
0c96677902 CI: fix NFS EBUSY error in PR test workflow (#13460)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-18 13:25:29 +08:00
b8zhong
f33860777c [Piecewise CUDA Graph] Support ModelOpt FP8 (#13094) 2025-11-18 12:46:24 +08:00
Liangsheng Yin
4ce8fb3cc2 Fix lora test (#13479) 2025-11-18 12:21:57 +08:00
Shangming Cai
4c3573e493 [PD] Clarify init method docstrings for kvsender and kvreceiver (#13476) 2025-11-18 12:20:19 +08:00
wingedge
f1be8aa0f2 chore: add an unified server arg for multimodal inputs preprocess config(#12149)
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-11-18 12:18:50 +08:00
Zijian Zhang
aa8ecbda7a model: support JetVLM (#13289) 2025-11-18 12:02:03 +08:00
Simo Lin
9188feccca [model-gateway] use worker startup time out for worker registration (#13473) 2025-11-17 19:28:21 -08:00
Binyao Jiang
26ca07469b [GLM4.6v] Relax the constraint of non-user role chat completion message schema for new GLM-v release (#13258) 2025-11-18 10:58:17 +08:00
Binyao Jiang
90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
Douglas Yang
d7984f3125 Adding CI Monitor Improvements (#13462) 2025-11-17 18:42:35 -08:00
Yuhao Yang
7119d188f6 [CI] re-enable test_vision_openai_server_a ci (#13444) 2025-11-17 18:32:59 -08:00
Sai Enduri
fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) 2025-11-17 18:13:24 -08:00
Minglei Zhu
9846f8ed72 fix MambaPool clear method after refactoring (#13449) 2025-11-18 10:03:45 +08:00
Baizhou Zhang
85ae508e8b Add bfloat16 tuned fused moe config for Dpsk-MTP layer on B200 (#13455) 2025-11-17 17:44:31 -08:00
pansicheng
d879e37f1b Add interface_v1 option for dynamic HiCache backend (#13140)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-11-17 17:42:17 -08:00
Kangyan-Zhou
e2c9a59023 Update pr-test.yml to fix invalid job name error 2025-11-17 17:08:02 -08:00
Kangyan-Zhou
a1e37b0258 Temporarily comment out multimodal gen test to recover runners (#13463) 2025-11-17 16:55:04 -08:00
Kaixi Hou
e389f91dec [NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-17 16:13:28 -08:00