chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

11116 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
fzyzcjy
ec242f516e Super tiny extract route_typed_request_once (#14951) 2025-12-12 11:10:10 -08:00
Kangyan-Zhou
b243154614 Fix CI by reverting incorrect metric check logic (#15004) 2025-12-12 10:07:38 -08:00
Simo Lin
526fd0082f [model-gateway] refactor: workflow engine cleanup and minor optimization (#15001) 2025-12-12 09:03:28 -08:00
Simo Lin
56d0ad47f4 [model-gateway] fix: handle workflow deadlock and optimize cycle detection (#15000) 2025-12-12 08:53:45 -08:00
Simo Lin
306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin
10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Mick
c7c837cd1d Update CODEOWNERS for multimodal_gen (#14995) 2025-12-12 22:08:16 +08:00
Xiaoyu Zhang
3e1e71575c [diffusion] docker: Tiny fix Docker Hub link in installation documentation (#14987) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-12 20:25:36 +08:00
Kevin Li
8fa8d9d7e8 [PD] Add decode PP event loop for PD disaggregation (#14945) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
 2025-12-12 20:15:00 +08:00
Shangming Cai
c8cf1cafdb [1/N] Update doc of Pipeline Parallelism (#14985) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: alpha-baby <fujianhao1997@qq.com>
 2025-12-12 19:32:52 +08:00
DefTruth
d71baa72dc [diffusion] dependency: upgrade cache-dit for better compatibility (#14534) 2025-12-12 18:52:58 +08:00
Mick
82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
gongwei-130
94e1251131 enable flashinfer-jit-cache in image build and ci install to speed up model launch (#14959) 2025-12-11 23:20:44 -08:00
Zaili Wang
4dabfbc827 [Fix] suppress remote weight loading engine w/o mooncake installed (#14937) 2025-12-11 23:12:26 -08:00
Sam
d7ed8a8c24 [NVIDIA] Enable TRTLLM BF16 MoE on Blackwell GPUs (#13798) 2025-12-11 22:56:13 -08:00
ZhengdQin
c05d3afb5d [NPU] optimization for dsv3.2 (#14572) 2025-12-12 14:52:16 +08:00
fzyzcjy
edb172e927 Super tiny refactor error.rs logic (#14949) 2025-12-12 14:48:18 +08:00
b8zhong
fe6d38d2fa fix: trtllm mha attention auto-selection on sm120 (#14842) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-11 22:35:25 -08:00
b8zhong
dab31e4cc7 direct register custom op for mm_fp4 (#13699) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-11 22:33:17 -08:00
fzyzcjy
a7fa31ff17 Super tiny move error.rs (#14944) 2025-12-12 14:25:30 +08:00
fzyzcjy
bd91f8824a Super tiny remove non-updated sgl_router_worker_load (#14888) 2025-12-12 13:19:30 +08:00
fzyzcjy
b47adb807e Tiny add e2e http request arrival metric (#14893) 2025-12-12 13:18:23 +08:00
fzyzcjy
b2b5bdb06e Tiny add router e2e duration histogram (#14892) 2025-12-12 13:18:13 +08:00
JinYan Su
22fe5da13e Fix negative duration panic in token bucket wait time calculation (#14941) 
Signed-off-by: xiaguan <751080330@qq.com>
 2025-12-11 21:16:47 -08:00
Praneth Paruchuri
1834401e7c [model-gateway] optimize worker selection (#14894) 2025-12-11 21:15:12 -08:00
Prozac614
198c8ecf98 [diffusion] fix: support applying different LoRA adapters to different transformers in multi-transformer pipelines (#14839) 2025-12-12 13:08:57 +08:00
Xuchun Shang
c01b2ee094 [PP] Refactor PP to async mode (#11852) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: bluecoffee8 <jasperli2002@gmail.com>
Co-authored-by: zhangxiaolei123456 <zhangxiaolei.666@bytedance.com>
Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
 2025-12-12 12:54:16 +08:00
Peng Zhang
8f5adac8c6 [RL] refactor flash rl weight reload in sglang (#14870) 
Co-authored-by: eternally-z <zzywzj@gmail.com>
 2025-12-12 12:50:47 +08:00
Zehuan Li
76743a983e [DLLM] Add documentation for diffusion LLMs (#14358) 
Co-authored-by: Tiwei Bie <tiwei.btw@antgroup.com>
Co-authored-by: Jinwei Yao <jinweiy@illinois.edu>
 2025-12-11 20:29:51 -08:00
Xinyuan Tong
8bf10e71cd remove dpsk3.2 sys prompt (#14923) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 20:26:13 -08:00
fzyzcjy
e4873d0439 Super tiny remove sgl_router_active_workers (#14891) 2025-12-11 20:00:55 -08:00
Liangsheng Yin
c660d8dfd0 Re-org eagle unit tests (#14909) 2025-12-12 12:25:39 +09:00
Ho-Ren (Jack) Chuang
10146af099 Check KV4 compatibility with attention backends and add KV4 support to the attention_backend doc (#14467) 
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
 2025-12-11 19:00:53 -08:00
Minglei Zhu
b62e7e3bfe [CI]add nightly CI for glm4v_moe arch model (#14927) 
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2025-12-11 18:29:45 -08:00
Douglas Yang
6ce36b1232 fix: making the publish trace error check broader (#14931) 2025-12-11 18:19:57 -08:00
Yuhao Yao
e9e7f15eb5 [bugfix] fix TBO crashes when attn_tp_size > 1 (#13730) 
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-11 18:18:40 -08:00
Alison Shao
0aa3dec5c7 Fix black formatting in ci_utils.py (#14932) 2025-12-11 17:28:52 -08:00
Xinyuan Tong
4885f8b9c1 fix: handle Jinja2 template errors as client errors in OpenAIServingChat (#14748) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 17:06:26 -08:00
Alison Shao
f832994c32 [CI] Add Mistral Large 3 Eagle nightly performance test (#14525) 2025-12-11 17:01:50 -08:00
Alison Shao
e59435c34b Add retry logic for scheduled CI tests (#14771) 2025-12-11 16:59:58 -08:00
Zaili Wang
d6bd2d1126 [CPU] layernorm & fused add-layernorm kernels (#14074) 2025-12-11 16:58:23 -08:00
Xinyuan Tong
9975acf50f [refactor] Update reasoning parameter to require_reasoning (#14922) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 16:55:59 -08:00
amysaq2023
70758d457e support non-disturbing remote-instance-weight-loader (#13125) 
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
 2025-12-11 16:45:32 -08:00
Xinyuan Tong
fd1ebbb0d6 update mistral detector (#14921) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-11 16:43:36 -08:00
Douglas Yang
3d98bd5edf ci: adding more nightly tests to bot bump workflows (#14928) 2025-12-11 16:26:21 -08:00
Kangyan-Zhou
aa3716b29d Update CI_PERMISSIONS.json 2025-12-11 15:55:50 -08:00
b8zhong
6107268fe7 extend timeout for b200 test (#14925) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-12-11 15:43:53 -08:00
sglang-bot
5c8bd8b51b chore: bump SGLang version to 0.5.6.post2 (#14858) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-11 12:29:52 -08:00
Yinghai Lu
b05b346a13 [loader] enable private loader (#14620) 2025-12-11 11:49:46 -08:00
Jimmy
5c961756a3 [FIX][DS32]openai protocol: support openai message role: developer (#14304) 2025-12-11 11:34:41 -08:00