chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
7,361 Commits 1 Branch 0 Tags
1f2b84d28d639ba251f8f4c7b6ce94dea78e6605
Commit Graph

846 Commits

Author SHA1 Message Date
Lianmin Zheng
bc3d2a85af [Minor] update docs (#14212) 2025-12-01 02:33:58 -08:00
Richard Chen
4addb60274 Pull Request Instructions: RL and Training Framework Integrations (#14187) 
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
 2025-11-30 21:58:54 -08:00
YAMY
decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
vipwangerxiao
ab9a46d462 Support configuring the request limit per receiving poll (#14076) 
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com>
 2025-11-28 16:14:21 +08:00
Jimmy
ab843ced31 [Feat]Add scheduler recv skipper weights to environment configuration (#13855) 2025-11-27 18:16:11 +08:00
Netanel Haber
082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
Wenyi Xu
5e70880e64 [model-gateway] Add PostgreSQL support to binding (#13766) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2025-11-26 09:11:13 -08:00
Liangsheng Yin
6c190cbda0 Rename: --hooks to --forward-hooks (#13994) 2025-11-26 22:26:28 +08:00
Jan Bernlöhr
fcccaf9001 Add Llama4 attention backend auto-selection (#13421) 
Signed-off-by: jbernloehr <jbernloehr@nvidia.com>
 2025-11-25 11:54:21 -08:00
Cheng Wan
bf10869203 [Doc] Add an Introduction to Expert Parallelism (#13783) 2025-11-24 14:46:51 -08:00
Tiance Wang
75222bfed9 Update MindSpore documentation (#13656) 
Co-authored-by: wangtiance <tiancew@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-24 11:20:51 +08:00
Peiqi Yin
a90435c059 Fix typo in docs (#13709) 2025-11-23 10:49:49 +08:00
Binyao Jiang
b29769f3b6 Move unnecessary input_addr capture under debug mode flag for speed-up (#13690) 2025-11-22 11:42:26 -08:00
Baizhou Zhang
8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Qiaolin Yu
681b9e6425 Revert "enable csgmv automatically on cuda" (#13707) 2025-11-21 10:37:41 -08:00
Lianmin Zheng
99e13d189b Fix url: use https://roadmap.sglang.io for roadmap (#13733) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-21 05:42:32 -08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
赵晨阳
c56fc42430 Update quantization.md with new model resources (#13677) 2025-11-20 15:50:16 -08:00
b8zhong
42028af614 enable csgmv automatically on cuda (#13600) 2025-11-20 12:53:02 -08:00
hlu1
7291c72e57 [Deepseek V3.2] Change indexer weights_proj to fp32 (#13459) 2025-11-20 12:24:10 -08:00
Liangsheng Yin
19729f723e [CI] Align metric units for CI rate limit (#13633) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-20 16:25:57 +08:00
Liangsheng Yin
196b940aed [3/N] CI refactor: move some manually triggered tests. (#13448) 2025-11-19 23:06:53 +08:00
ykwd
075ba74dd4 [Doc] Update HiCache and Mooncake docs & Mooncake Setup Error Checking (#12740) 2025-11-19 12:03:27 +08:00
Chen Haozhe
6c2e5fcd91 [feat][Ascend][Mindspore]: support model-impl of mindspore (#9234) 2025-11-19 09:17:47 +08:00
Liangsheng Yin
109f27ba3a [CI] update pr-gate to be compatible with new slash triggering mananer. (#13522) 2025-11-19 00:49:13 +08:00
sglang-bot
c1a30aa765 Add /tag-and-rerun-ci (#13521) 2025-11-18 06:53:53 -08:00
Lianmin Zheng
2e1dbdb258 Update docs (#13519) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 06:24:58 -08:00
Lianmin Zheng
6d025fd35b Trigger CI retry with edit (#13516) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 05:42:31 -08:00
Lianmin Zheng
63807079b9 Add docs on trigger ci (#13513) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 05:23:05 -08:00
Lianmin Zheng
e2d6746808 Add .github/CI_PERMISSIONS.json to define the CI permissions (#13509) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-18 04:00:15 -08:00
Liangsheng Yin
4e41edcb9c [CI] remove auto-labeling run-ci label. (#13486) 2025-11-18 14:59:46 +08:00
wingedge
f1be8aa0f2 chore: add an unified server arg for multimodal inputs preprocess config(#12149) 
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-11-18 12:18:50 +08:00
Zijian Zhang
aa8ecbda7a model: support JetVLM (#13289) 2025-11-18 12:02:03 +08:00
Binyao Jiang
90c18a16cb [GLM4.6v] Required changes for bumping up to transformer 5.x (#13229) 2025-11-18 10:58:00 +08:00
pansicheng
d879e37f1b Add interface_v1 option for dynamic HiCache backend (#13140) 
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-11-17 17:42:17 -08:00
Sirut Buasai
a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) 2025-11-17 13:14:17 -08:00
Carlo Mussolini
df56139226 Adding user defined hooks support (#13217) 2025-11-17 23:07:37 +08:00
Ying Sheng
15bc1f5cd7 Update .github/MAINTAINER.md (#13398) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-16 21:32:24 -08:00
lixiaolx
d368c7451a (1/n)support context parallel with deepseekv3.2-DSA (#12065) 2025-11-16 20:12:25 -08:00
Lianmin Zheng
7e626d12b7 Update docs (#13391) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-16 19:36:33 -08:00
sglang-bot
7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
Netanel Haber
9f011f617f fix generative_models.md table - remove newlines (#13385) 2025-11-16 10:33:38 -08:00
kyleliang-nv
597d416070 [feature] Add layerwise NVTX support (#11870) 2025-11-15 19:20:56 -08:00
Zhihao Lyu
10592e9c08 [Ascend][Feat] Add Ascend sampling backend (#12692) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2025-11-15 21:59:58 +08:00
Yongfei Xu
d91b16eb16 Opt tp: tp attn support tp reduce scattered input (#10568) 2025-11-15 02:08:12 -08:00
Kaixi Hou
5ae0ac4244 [NVIDIA] Fix use case of SGLANG_ENABLE_FLASHINFER_GEMM (#13274) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-14 12:51:11 -08:00
Zesen SenmiaoORZ
fd3be107bb [Doc] Add item for repetition punishment (#13260) 2025-11-14 11:15:56 -08:00
Praneth Paruchuri
665f43bdd8 model: support teleflm (#10573) 2025-11-15 03:14:49 +08:00
Praneth Paruchuri
a53f2d6c12 Support orion (#10665) 2025-11-15 03:08:32 +08:00
Taishi Nakamura
bfe638f7e8 Fix broken Markdown formatting in DeepEP documentation (#13210) 2025-11-13 11:34:57 -08:00