b8zhong and Brayden Zhong
e6420100ee
sync attention doc and ep doc to doctree ( #14257 )
...
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com >
2025-12-01 21:15:22 -08:00
Lianmin Zheng
8a7b1b8301
[Docs] Update CI docs ( #14260 )
2025-12-01 18:15:03 -08:00
Lianmin Zheng
bc3d2a85af
[Minor] update docs ( #14212 )
2025-12-01 02:33:58 -08:00
Richard Chen and zhaochenyang20
4addb60274
Pull Request Instructions: RL and Training Framework Integrations ( #14187 )
...
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com >
2025-11-30 21:58:54 -08:00
YAMY
decb48965d
[DeepSeekV3.2] Enable pure TP & Partial DP Attention ( #13646 )
2025-11-30 15:59:23 -08:00
ab9a46d462
Support configuring the request limit per receiving poll ( #14076 )
...
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com >
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com >
2025-11-28 16:14:21 +08:00
Jimmy
ab843ced31
[Feat]Add scheduler recv skipper weights to environment configuration ( #13855 )
2025-11-27 18:16:11 +08:00
Netanel Haber
082b54c689
Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) ( #12277 )
2025-11-26 16:28:52 -07:00
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Liangsheng Yin
6c190cbda0
Rename: --hooks to --forward-hooks ( #13994 )
2025-11-26 22:26:28 +08:00
Jan Bernlöhr
fcccaf9001
Add Llama4 attention backend auto-selection ( #13421 )
...
Signed-off-by: jbernloehr <jbernloehr@nvidia.com >
2025-11-25 11:54:21 -08:00
Cheng Wan
bf10869203
[Doc] Add an Introduction to Expert Parallelism ( #13783 )
2025-11-24 14:46:51 -08:00
75222bfed9
Update MindSpore documentation ( #13656 )
...
Co-authored-by: wangtiance <tiancew@qq.com >
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-24 11:20:51 +08:00
Peiqi Yin
a90435c059
Fix typo in docs ( #13709 )
2025-11-23 10:49:49 +08:00
Binyao Jiang
b29769f3b6
Move unnecessary input_addr capture under debug mode flag for speed-up ( #13690 )
2025-11-22 11:42:26 -08:00
Baizhou Zhang
8bfce9b08d
[Tiny] Renaming environ for NVFP4 dispatch ( #13756 )
2025-11-22 00:05:20 -08:00
Qiaolin Yu
681b9e6425
Revert "enable csgmv automatically on cuda" ( #13707 )
2025-11-21 10:37:41 -08:00
Lianmin Zheng and sglang-bot
99e13d189b
Fix url: use https://roadmap.sglang.io for roadmap ( #13733 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-21 05:42:32 -08:00
Even Zhou
589d9ad55b
[NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 ( #13647 )
2025-11-21 17:07:08 +08:00
赵晨阳
c56fc42430
Update quantization.md with new model resources ( #13677 )
2025-11-20 15:50:16 -08:00
b8zhong
42028af614
enable csgmv automatically on cuda ( #13600 )
2025-11-20 12:53:02 -08:00
hlu1
7291c72e57
[Deepseek V3.2] Change indexer weights_proj to fp32 ( #13459 )
2025-11-20 12:24:10 -08:00
Liangsheng Yin and gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
19729f723e
[CI] Align metric units for CI rate limit ( #13633 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-20 16:25:57 +08:00
Liangsheng Yin
196b940aed
[3/N] CI refactor: move some manually triggered tests. ( #13448 )
2025-11-19 23:06:53 +08:00
ykwd
075ba74dd4
[Doc] Update HiCache and Mooncake docs & Mooncake Setup Error Checking ( #12740 )
2025-11-19 12:03:27 +08:00
Chen Haozhe
6c2e5fcd91
[feat][Ascend][Mindspore]: support model-impl of mindspore ( #9234 )
2025-11-19 09:17:47 +08:00
Liangsheng Yin
109f27ba3a
[CI] update pr-gate to be compatible with new slash triggering mananer. ( #13522 )
2025-11-19 00:49:13 +08:00
sglang-bot
c1a30aa765
Add /tag-and-rerun-ci ( #13521 )
2025-11-18 06:53:53 -08:00
Lianmin Zheng and sglang-bot
2e1dbdb258
Update docs ( #13519 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-18 06:24:58 -08:00
Lianmin Zheng and sglang-bot
6d025fd35b
Trigger CI retry with edit ( #13516 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-18 05:42:31 -08:00
Lianmin Zheng and sglang-bot
63807079b9
Add docs on trigger ci ( #13513 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-18 05:23:05 -08:00
Lianmin Zheng and sglang-bot
e2d6746808
Add .github/CI_PERMISSIONS.json to define the CI permissions ( #13509 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-18 04:00:15 -08:00
Liangsheng Yin
4e41edcb9c
[CI] remove auto-labeling run-ci label. ( #13486 )
2025-11-18 14:59:46 +08:00
f1be8aa0f2
chore: add an unified server arg for multimodal inputs preprocess config( #12149 )
...
Co-authored-by: bianfeng <bianfeng@pinduoduo.com >
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com >
2025-11-18 12:18:50 +08:00
Zijian Zhang
aa8ecbda7a
model: support JetVLM ( #13289 )
2025-11-18 12:02:03 +08:00
Binyao Jiang
90c18a16cb
[GLM4.6v] Required changes for bumping up to transformer 5.x ( #13229 )
2025-11-18 10:58:00 +08:00
pansicheng and Zhiqiang Xie
d879e37f1b
Add interface_v1 option for dynamic HiCache backend ( #13140 )
...
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu >
2025-11-17 17:42:17 -08:00
Sirut Buasai
a63f433b6f
extend sagemaker.Dockerfile serve script to allow all sglang serve flags ( #13173 )
2025-11-17 13:14:17 -08:00
Carlo Mussolini
df56139226
Adding user defined hooks support ( #13217 )
2025-11-17 23:07:37 +08:00
Ying Sheng and sglang-bot
15bc1f5cd7
Update .github/MAINTAINER.md ( #13398 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-16 21:32:24 -08:00
lixiaolx
d368c7451a
(1/n)support context parallel with deepseekv3.2-DSA ( #12065 )
2025-11-16 20:12:25 -08:00
Lianmin Zheng and sglang-bot
7e626d12b7
Update docs ( #13391 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-16 19:36:33 -08:00
sglang-bot
7b2fb3d47c
chore: bump SGLang version to 0.5.5.post3 ( #13366 )
2025-11-16 17:55:38 -08:00
Netanel Haber
9f011f617f
fix generative_models.md table - remove newlines ( #13385 )
2025-11-16 10:33:38 -08:00
kyleliang-nv
597d416070
[feature] Add layerwise NVTX support ( #11870 )
2025-11-15 19:20:56 -08:00
Zhihao Lyu and ronnie_zheng
10592e9c08
[Ascend][Feat] Add Ascend sampling backend ( #12692 )
...
Co-authored-by: ronnie_zheng <zl19940307@163.com >
2025-11-15 21:59:58 +08:00
Yongfei Xu
d91b16eb16
Opt tp: tp attn support tp reduce scattered input ( #10568 )
2025-11-15 02:08:12 -08:00
Kaixi Hou and Baizhou Zhang
5ae0ac4244
[NVIDIA] Fix use case of SGLANG_ENABLE_FLASHINFER_GEMM ( #13274 )
...
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
2025-11-14 12:51:11 -08:00
Zesen SenmiaoORZ
fd3be107bb
[Doc] Add item for repetition punishment ( #13260 )
2025-11-14 11:15:56 -08:00
Praneth Paruchuri
665f43bdd8
model: support teleflm ( #10573 )
2025-11-15 03:14:49 +08:00
