chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
7,593 Commits 1 Branch 0 Tags
32f8b6064e0bd4404a35c4d76ee87eedba0232ea
Commit Graph

878 Commits

Author SHA1 Message Date
sglang-bot
9a327bdfcf chore: bump SGLang version to 0.5.6.post1 (#14651) 2025-12-09 00:35:28 +08:00
Muqi Li
06836ad02a [Reasoning + Structured Output] make reasoning compatible with structured output (#12551) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-08 01:28:39 -08:00
Binyao Jiang
cf0478d602 [Glm46v] Bug fix for accuracy drop and unable to launch server (#14585) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
 2025-12-07 23:45:02 -08:00
fzyzcjy
1915a1f8a7 Super tiny remove unneeded policy flag (#14608) 2025-12-07 19:35:07 -08:00
Zhiyu
f6423b626c Rename TensorRT Model Optimizer to Model Optimizer (#14455) 
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
 2025-12-07 13:18:20 -08:00
George Armstrong
91c9c14c28 DOC update nemo-skills in docs (#14555) 
Signed-off-by: George Armstrong <georgea@nvidia.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-12-06 19:03:08 -08:00
b8zhong
dd91d38e6a [Doc] Add short explanation on page size (#14557) 2025-12-06 17:26:30 -08:00
Lee Nau
5f6f550af8 Update DeepSeek V3 docs to use B200 (#14447) 2025-12-06 17:22:11 -08:00
Baizhou Zhang
9dfa01a435 [Misc]Register and refactor some environs for dpsk-fp4 and DeepEp (#14538) 2025-12-06 12:29:16 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Rain Jiang
ea177372bd support mtp with deepseek r1 nvfp4 model (#13115) 
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
 2025-12-06 00:45:54 -08:00
Baizhou Zhang
42fcf5438f Revert "tiny remove deprecated endpoint call" (#14533) 2025-12-05 23:48:54 -08:00
Yuhao Yang
7b0c7ad163 Revise DP Multi-Modal Encoder Document (#14290) 2025-12-06 12:56:53 +08:00
Simo Lin
d30d6b368f [bug] fix notebook to include new keys from model_info (#14528) 2025-12-05 20:44:03 -08:00
Alison Shao
e41664ba1a [Docs] Add /rerun-stage command to contribution guide (#14521) 2025-12-05 15:46:47 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00
b8zhong
ec7b2c16d9 tiny remove deprecated endpoint call (#13607) 2025-12-05 09:54:49 -08:00
ishandhanani
498ea41ca6 dockerfile: add runtime stage + ubuntu 24.04 (#13861) 2025-12-05 00:28:36 -08:00
sglang-bot
b5d3998508 Rename secrets.WHL_TOKEN -> secrets.GH_PAT_FOR_WHL_RELEASE (#14421) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2025-12-04 18:24:54 -08:00
b8zhong
88d1bab537 add doc for quantized kv cache (#14348) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
 2025-12-04 13:01:05 -08:00
Zaili Wang
4f73e53dcc [CPU] document updates (#14272) 2025-12-03 19:56:06 -08:00
b8zhong
9d82340298 Revert "Revert "enable csgmv automatically on cuda"" (#14277) 2025-12-03 13:12:30 -08:00
Baizhou Zhang
7e78825d5a [Tiny]Small fixes in deepseek v32 doc (#14372) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-12-03 11:35:40 -08:00
VDV1985
dc1635023f [NPU][Doc] updated installation guide for Ascend NPU (#13585) 
Co-authored-by: Howeee <15935120809@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
 2025-12-03 16:58:49 +03:00
b8zhong
65c8568c4a sync attention, deepseek doc (#14335) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-02 21:19:40 -08:00
Baizhou Zhang
4bcc5879af [Doc] Fix DeepSeek V32 Doc (#14336) 2025-12-02 21:06:55 -08:00
Vikram
42271376d1 [bug fix] use npu phy id in container env (#14266) 
Co-authored-by: jinke15 <jinke15@jd.com>
 2025-12-03 11:33:43 +08:00
Baizhou Zhang
922054079c [Doc] Update DeepSeek-V3.2 document (#14321) 2025-12-02 18:19:39 -08:00
sglang-bot
7ae368efde chore: bump SGLang version to 0.5.6 (#14316) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-02 17:17:13 -08:00
Yuan Luo
21ec99beff [VLM][Doc] Document for VLM DP Encoder (#14279) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-02 15:08:37 +08:00
b8zhong
e6420100ee sync attention doc and ep doc to doctree (#14257) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-01 21:15:22 -08:00
Lianmin Zheng
8a7b1b8301 [Docs] Update CI docs (#14260) 2025-12-01 18:15:03 -08:00
Lianmin Zheng
bc3d2a85af [Minor] update docs (#14212) 2025-12-01 02:33:58 -08:00
Richard Chen
4addb60274 Pull Request Instructions: RL and Training Framework Integrations (#14187) 
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
 2025-11-30 21:58:54 -08:00
YAMY
decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
vipwangerxiao
ab9a46d462 Support configuring the request limit per receiving poll (#14076) 
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com>
 2025-11-28 16:14:21 +08:00
Jimmy
ab843ced31 [Feat]Add scheduler recv skipper weights to environment configuration (#13855) 2025-11-27 18:16:11 +08:00
Netanel Haber
082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
Wenyi Xu
5e70880e64 [model-gateway] Add PostgreSQL support to binding (#13766) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2025-11-26 09:11:13 -08:00
Liangsheng Yin
6c190cbda0 Rename: --hooks to --forward-hooks (#13994) 2025-11-26 22:26:28 +08:00
Jan Bernlöhr
fcccaf9001 Add Llama4 attention backend auto-selection (#13421) 
Signed-off-by: jbernloehr <jbernloehr@nvidia.com>
 2025-11-25 11:54:21 -08:00
Cheng Wan
bf10869203 [Doc] Add an Introduction to Expert Parallelism (#13783) 2025-11-24 14:46:51 -08:00
Tiance Wang
75222bfed9 Update MindSpore documentation (#13656) 
Co-authored-by: wangtiance <tiancew@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-11-24 11:20:51 +08:00
Peiqi Yin
a90435c059 Fix typo in docs (#13709) 2025-11-23 10:49:49 +08:00
Binyao Jiang
b29769f3b6 Move unnecessary input_addr capture under debug mode flag for speed-up (#13690) 2025-11-22 11:42:26 -08:00
Baizhou Zhang
8bfce9b08d [Tiny] Renaming environ for NVFP4 dispatch (#13756) 2025-11-22 00:05:20 -08:00
Qiaolin Yu
681b9e6425 Revert "enable csgmv automatically on cuda" (#13707) 2025-11-21 10:37:41 -08:00
Lianmin Zheng
99e13d189b Fix url: use https://roadmap.sglang.io for roadmap (#13733) 
Co-authored-by: sglang-bot <sglangbot@gmail.com>
 2025-11-21 05:42:32 -08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
赵晨阳
c56fc42430 Update quantization.md with new model resources (#13677) 2025-11-20 15:50:16 -08:00