chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

1275 Commits

Author SHA1 Message Date
Yi Zhong
ec9b48ea96 Add olmo3 in supported docs (#13672) 
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
 2026-01-16 12:18:16 -05:00
Mohammad Miadh Angkad
c771933dc5 [Doc] Tiny docs update for CUDA 13 (#17200) 2026-01-16 20:53:36 +08:00
Raghav Ravishankar
daea51385d Add AFMoE model implementation (#13216) 2026-01-16 20:35:42 +08:00
StonyPort
3355b6e21b feat: add request queued timeout (#17143) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-16 17:55:09 +08:00
R0CKSTAR
a1dd3d48ac [diffusion] hardware: support diffusion (single GPU, 3/N) (#17105) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-16 17:01:09 +08:00
Adarsh Shirawalmath
7c39ea68f3 [diffusion] model: support flux Klein (#17173) 2026-01-16 16:16:17 +08:00
shuwenn
8ec160ed46 feature: support uvicorn access log filter(disable logging /metrics) (#15513) 2026-01-15 20:00:06 -08:00
Baizhou Zhang
8b99af9af8 [Doc] Tiny update Cuda 13 environment instructions (#17174) 2026-01-16 06:12:26 +08:00
b8zhong
3d72944fb8 [Doc] Add tip on how to use Spec V2 (#15455) 2026-01-16 05:30:18 +08:00
Yi Zhong
7dde3438e2 Show how to use cu13 image with B300 (#17170) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2026-01-15 15:25:20 -05:00
Guy Stone
cd23c2f0a3 [Docs] add v1/score api to native api documentation (#16568) 2026-01-15 12:29:40 -05:00
Yi Zhong
d1110e1c3e docs only add kimi k2 thinking and kimi linear (#15789) 2026-01-15 12:09:52 -05:00
shuwenn
9227d9f60c [Docs] sort and update server_arguments.md (#17163) 2026-01-15 12:07:18 -05:00
Hexq0210
6586f44ad4 [NPU] Add Ascend NPU best practice in doc (#17103) 2026-01-15 15:21:45 +08:00
Glen Liu
6b065298b5 [Docs] add routing-key to schedule-policy in docs (#17101) 2026-01-14 22:22:07 -05:00
Артем Савкин
424a380077 [NPU] NPU quantization refactoring & more quantization formats support (#14504) 
Co-authored-by: TamirBaydasov <mr.jeijy@gmail.com>
Co-authored-by: Tamir Baydasov <41994229+TamirBaydasov@users.noreply.github.com>
Co-authored-by: Савкин Артем <savkinartem@MacBook-Air-Viktoria.local>
Co-authored-by: Edward Shogulin <edward.shogulin@gmail.com>
 2026-01-15 04:25:15 +08:00
shuwenn
de94d793ad feat: support qwen3(-VL) rerank scoring&chat template (#16403) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2026-01-15 00:45:46 +08:00
fxmarty-amd
5af84c8af5 [AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392) 
Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
 2026-01-14 01:44:40 -08:00
shuwenn
cd33694585 feat: add --admin-api-key for finer-grained endpoint auth (#15908) 
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
 2026-01-13 20:21:55 -08:00
ybyang
2122fea3c4 Update deepseekV32 Cp doc (#17054) 2026-01-14 11:19:26 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
James
ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) 2026-01-13 09:02:10 +08:00
ybyang
aab640c99f add doc for dsv32 cp+pp (#16916) 2026-01-12 19:14:07 +08:00
Adarsh Shirawalmath
aab906a3d4 [docs] sync diffusion docs to main docs (#16932) 2026-01-12 14:49:55 +08:00
Hexq0210
c581b5ed79 [NPU] update feature supported on ascend NPU (#16915) 2026-01-12 11:47:58 +08:00
Wenyi Xu
3c16c58619 [model-gateway] Add Redis support as a history backend (#16300) 2026-01-11 01:03:00 -08:00
Ratish P
c0248d6f37 [dpc]: unify DP controller load balancing and simplify dispatch logic (#16258) 2026-01-11 12:38:03 +08:00
hlu1
aeb480c11f Add top-p to run_eval.py (#16844) 2026-01-10 17:10:37 +08:00
Baizhou Zhang
94fc26aad8 [Doc]Update note for Cuda 13 container usage (#16805) 2026-01-10 14:03:19 +08:00
siyu
068abe7e40 add doc for #14386 (#14655) 2026-01-09 22:38:51 +08:00
Lianmin Zheng
d56d14e566 [Docs] Improve docs for install on gb200 (#16760) 2026-01-09 03:07:13 -08:00
Sirut Buasai
cceb5e6aa5 add AWS SGLang DLC to docs (#16686) 2026-01-08 20:06:31 -08:00
Liangsheng Yin
77d3566555 Tiny fix wording about CI preemption. (#16773) 2026-01-09 11:08:17 +08:00
Hexq0210
20ca2c6e1e [NPU] update model and features supported (#16733) 2026-01-08 21:50:42 +08:00
Hexq0210
5e867f60cf [NPU] Update model and features supported (#16652) 2026-01-08 09:13:30 +08:00
Even Zhou
d4b717c01e [NPU] update docs (#16651) 2026-01-07 20:20:01 +08:00
Shangming Cai
973116e6bb [Doc] Optimize pipeline parallelism doc (#16630) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-07 14:52:42 +08:00
Baizhou Zhang
7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
Hexq0210
4c9ac8566c [NPU] fix command in npu best practice (#16576) 2026-01-07 09:37:27 +08:00
Ke Bao
3aa11ca722 Remove hybrid_kvcache_ratio in server args (#16399) 2026-01-06 13:13:13 +08:00
Hexq0210
abb06be946 [NPU] Fixed link redirection issue. (#16475) 2026-01-05 19:03:29 +08:00
Netanel Haber
bebd625ba1 EVS Framework: Support NemotronH_Nano_VL_V2 (#14051) 2026-01-05 16:18:07 +08:00
Huapeng Zhou
078270473a [Doc] Default lora backend: csgmv (#16444) 2026-01-05 12:45:49 +08:00
Hexq0210
bf32cd8397 [npu] update model and feature supported for ascend npu (#16390) 2026-01-04 21:50:20 +08:00
Yuan Luo
9bd64d739b [VLM] Add doc for ViT CUDA Graph (#16343) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-04 10:05:23 +08:00
Baizhou Zhang
f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Yongfei Xu
0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
Huaixin Chang
c1dfbc777b deprecate prefill-round-robin-balance (#16195) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-31 22:25:33 +08:00
Hexq0210
386e541520 Update document for Ascend NPU (#16214) 2025-12-31 19:03:53 +08:00
Simo Lin
4bc2f2e0bc [model-gateway][docs] Add Classification API documentation (#16182) 
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2025-12-30 10:53:31 -08:00