chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Junrong Lin
518467be64 [Feature] Re:Enable hybrid mem saver (#12962) 2025-11-18 21:29:15 +08:00
Lianmin Zheng
63807079b9 Add docs on trigger ci (#13513) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 05:23:05 -08:00
Lianmin Zheng
f6cfe9f197 Use slash command to trigger CI (#13512) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 04:39:58 -08:00
Lianmin Zheng
7bc99d4164 README.md -> FOLDER_README.md (#13510) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 04:10:04 -08:00
Lianmin Zheng
e2d6746808 Add .github/CI_PERMISSIONS.json to define the CI permissions (#13509) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 04:00:15 -08:00
alisonshao
6beb6e991f fix: create git tags directly instead of temporary branches (#13168) 2025-11-18 03:23:27 -08:00
Morpheus Guo
7e88b9c128 [BugFix] Accuracy and function Issue when run ptpc quant model (#13157) 
Co-authored-by: yuechguo <yuechguo@amd.com>
 2025-11-18 01:54:58 -08:00
Zhiqiang Xie
cfcf2758aa [HiCache] Critical fix to host memory double free (#13501) 
Co-authored-by: Hao Chen <cighao@gmail.com>
 2025-11-18 01:34:23 -08:00
Nicholas
ac81db66c2 [VLM][feat] Support encoder DP for Qwen2.5-VL (#13126) 
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
 2025-11-18 16:13:18 +08:00
Liangsheng Yin
33905005ee [CI] fix lint yml (syntax error) (#13496) 2025-11-18 15:53:33 +08:00
Xiaoyu Zhang
820e13c9c1 [opt kimi k2 3/n] opt kimi_k2 moe_fused_gate kernel (#13374) 2025-11-18 15:36:31 +08:00
Liangsheng Yin
595adf6d93 [CI] Add input for pr-gate (#13491) 2025-11-18 15:35:49 +08:00
Cheng Wan
a5ad0069b2 fix: change performance log directory to cache path (#13482) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-11-18 15:18:43 +08:00
Liangsheng Yin
4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) 2025-11-18 14:59:46 +08:00
Liangsheng Yin
67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) 2025-11-18 14:24:58 +08:00
alisonshao
0c96677902 CI: fix NFS EBUSY error in PR test workflow (#13460) 
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-11-18 13:25:29 +08:00
b8zhong
f33860777c [Piecewise CUDA Graph] Support ModelOpt FP8 (#13094) 2025-11-18 12:46:24 +08:00
Liangsheng Yin
4ce8fb3cc2 Fix lora test (#13479) 2025-11-18 12:21:57 +08:00
Shangming Cai
4c3573e493 [PD] Clarify init method docstrings for kvsender and kvreceiver (#13476) 2025-11-18 12:20:19 +08:00
wingedge
f1be8aa0f2 chore: add an unified server arg for multimodal inputs preprocess config(#12149) 
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-11-18 12:18:50 +08:00
Zijian Zhang
aa8ecbda7a model: support JetVLM (#13289) 2025-11-18 12:02:03 +08:00
Simo Lin
9188feccca [model-gateway] use worker startup time out for worker registration (#13473) 2025-11-17 19:28:21 -08:00
Binyao Jiang
26ca07469b [GLM4.6v] Relax the constraint of non-user role chat completion message schema for new GLM-v release (#13258) 2025-11-18 10:58:17 +08:00
Binyao Jiang
90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
Douglas Yang
d7984f3125 Adding CI Monitor Improvements (#13462) 2025-11-17 18:42:35 -08:00
Yuhao Yang
7119d188f6 [CI] re-enable test_vision_openai_server_a ci (#13444) 2025-11-17 18:32:59 -08:00
Sai Enduri
fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) 2025-11-17 18:13:24 -08:00
Minglei Zhu
9846f8ed72 fix MambaPool clear method after refactoring (#13449) 2025-11-18 10:03:45 +08:00
Baizhou Zhang
85ae508e8b Add bfloat16 tuned fused moe config for Dpsk-MTP layer on B200 (#13455) 2025-11-17 17:44:31 -08:00
pansicheng
d879e37f1b Add interface_v1 option for dynamic HiCache backend (#13140) 
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-11-17 17:42:17 -08:00
Kangyan-Zhou
e2c9a59023 Update pr-test.yml to fix invalid job name error 2025-11-17 17:08:02 -08:00
Kangyan-Zhou
a1e37b0258 Temporarily comment out multimodal gen test to recover runners (#13463) 2025-11-17 16:55:04 -08:00
Kaixi Hou
e389f91dec [NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
 2025-11-17 16:13:28 -08:00
Vedant V Jhaveri
aac07bf7fd [Embeddings Performance Testing] Add performance test for embedding models (#12359) 2025-11-17 15:35:18 -08:00
Kangyan-Zhou
ea89a3a0c5 Fixes validation errors for Wan-AI models which store model weights in subdirectories (#13461) 2025-11-17 15:33:02 -08:00
Kangyan-Zhou
2bc7c5ebef Fix 8-gpu B200 nightly tests (#13457) 2025-11-17 13:26:56 -08:00
Sirut Buasai
a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) 2025-11-17 13:14:17 -08:00
Kangyan-Zhou
58f8f4e408 Add missing models (#13456) 2025-11-17 13:10:37 -08:00
Simo Lin
25acbbc612 Remove verbs from GET endpoint paths to follow REST standards (#13273) 2025-11-17 12:34:36 -08:00
hlu1
a8fcbf6fe3 [Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022) 
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
 2025-11-17 12:20:49 -08:00
Liangsheng Yin
e486308c99 Temporarily disable model hooks CI (#13450) 2025-11-18 02:35:13 +08:00
Liangsheng Yin
6042010964 [2/N] CI refactor: sperate some backend-independent CPU tasks. (#13447) 2025-11-18 02:08:19 +08:00
Mick
ff00b6adbe diffusion: fix loading with local model_path (#13445) 2025-11-18 00:56:30 +08:00
Xiaoyu Zhang
7b44526038 [Ci tiny fix] Lower score threshold in evaluation test (#13443) 2025-11-18 00:45:20 +08:00
Rain H
c236d05f8c Fix log time stats (#13418) 2025-11-17 23:10:49 +08:00
Carlo Mussolini
df56139226 Adding user defined hooks support (#13217) 2025-11-17 23:07:37 +08:00
kebyn
15db5497d3 [feature] Custom base path on FastAPI server (#5879) 
Co-authored-by: lianhu.yin <lianhu.yin@nio.com>
Co-authored-by: kebyn <kebyn@kebyn.cc>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-11-17 22:40:09 +08:00
Mike Qiu
9ba3597d2a Fix cache_tokens calculate issue when retracted (#11900) 
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
 2025-11-17 21:25:38 +08:00
Xuchun Shang
80797c2a15 [PD][bug fix] fix memleak when last_batch is none (#13144) 
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2025-11-17 21:22:20 +08:00
Mick
7afff8fd1a diffusion: fix wan2.2 ti2v num_frames adjust logic (#13379) 
Co-authored-by: adarshxs <adarsh.shirawalmath@gmail.com>
Co-authored-by: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
 2025-11-17 20:53:15 +08:00