chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Qiaolin Yu
729529190d [ci] Move dpsk-r1-fp4 b200 test to stage b (#15084) 2025-12-13 23:14:08 -08:00
monkeyLoveding
2ae5bed193 [NPU][CI] change de trigger of release image workflow (#14969) 2025-12-14 15:11:47 +08:00
fzyzcjy
54df514bac Avoid confusing zero value metric when worker is removed (#15096) 2025-12-14 13:57:20 +08:00
fzyzcjy
681c68cfbf Fix issue not reported when load decrement is incorrect (#15061) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-14 13:17:35 +08:00
Simo Lin
74ea45cc4b [model-gateway] optimize metric labels to avoid unnecessary allocations (#15095) 2025-12-13 21:10:45 -08:00
Simo Lin
0fa044ad63 [model-gateway] Add circuit breaker and discovery watcher metrics (#15094) 2025-12-13 20:47:04 -08:00
Simo Lin
7d8e42c979 [model-gateway] Fix metric emission gaps and name mismatch (#15093) 2025-12-13 20:16:30 -08:00
Huang Lin
6abdf73f4d [Fix] Environment variable SGL_* is deprecated (#14943) 2025-12-13 19:55:43 -08:00
Simo Lin
20ce9938b5 [model-gateway] Remove unused TokenizerMetrics to reduce CPU overhead (#15087) 2025-12-13 18:54:18 -08:00
fzyzcjy
168a31eb00 Support prefill max requests limitation (#14993) 2025-12-14 10:52:10 +08:00
narutolhy
69cfb17b9a [Fix] avoid stream sync in _compute_mrope_positions (#14956) 2025-12-13 18:50:57 -08:00
Brian
a7a4b1755d [Doc][TPU]add sglang-jax tpu docs (#15056) 2025-12-14 09:29:41 +08:00
fzyzcjy
fdc93b019c Add sglang:decode_sum_seq_lens metric (#15066) 2025-12-14 08:42:45 +08:00
Simo Lin
fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Xinyuan Tong
96705514bd fix: dpskv32 chat history processing, default drop_thinking to true (#15064) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
 2025-12-13 12:16:04 -08:00
Baizhou Zhang
ab3ffd1c8e Add nightly accuracy test for DeepSeek V3.2 (#14935) 2025-12-13 12:11:16 -08:00
Wenyi Xu
2285affffa [model-gateway] Avoid MCP Server Initialization Issue (#15065) 2025-12-13 11:20:16 -08:00
Yuhao Yang
a81cc1b8b3 add transformers version validation for glm-4.6v moe models (#14998) 2025-12-13 10:54:08 -08:00
liupeng374
3134d2b2a7 [scheduler] enhance scheduler in dp_attention mixed case with spec (#14201) 2025-12-14 02:52:26 +08:00
Yuhao Yang
06b58c5dc5 fix flaky image access in ci by switching to raw content url (#14940) 2025-12-13 10:52:06 -08:00
Douglas Yang
ea07a283b2 fix: adding schedule for nightly wheel (#15054) 2025-12-13 10:48:21 -08:00
Douglas Yang
ea91a720d5 feature: ci failure monitor improvements (#15055) 2025-12-13 10:47:52 -08:00
Simo Lin
5d9c6bac07 [bug] fix grpc secheduler launcher breaking change (#15080) 2025-12-13 10:36:49 -08:00
Simo Lin
e048ee90fc [model-gateway] Simplify error response creation (#15079) 2025-12-13 10:28:24 -08:00
Liangsheng Yin
ed52d01b0b Fix spec info's filter when reqs are finished right after prefill (#14742) 2025-12-14 00:32:54 +08:00
Liangsheng Yin
90e7d4f78f Tiny adjust CI run suite (#15074) 2025-12-14 00:05:19 +08:00
Mick
c20d43d2e6 [diffusion] doc: update profiling.md with output location details (#15072) 2025-12-13 23:15:23 +08:00
Liangsheng Yin
d977dd2e07 Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740) 2025-12-13 23:04:41 +08:00
Xiaoyu Zhang
0c23331e2e [diffusion] doc: add multimodal-gen profiling doc (#15069) 
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-13 22:26:20 +08:00
fzyzcjy
993278b488 Fix double decrease load (#15060) 2025-12-13 22:12:35 +08:00
fzyzcjy
9e9d910744 Fix load metric not updated when using guard (#15059) 2025-12-13 22:11:52 +08:00
Yuan Luo
3b8a824b8b [VLM] Support VLM ViT Piecewise CUDA Graph (#14422) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: kousakawang <wanghanpei@bytedance.com>
 2025-12-13 20:49:40 +08:00
Stefan He
f1bbd26ff7 Clean up GDN Init (#14855) 2025-12-13 02:56:54 -08:00
liupeng374
d36299ad77 [NPU] perf update with kvcache nz & w4a8 quant (#14423) 2025-12-13 17:39:55 +08:00
YAMY
0e7d7969d5 [PP Prefill][NIXL] Fix PP mode transfer completion tracking to wait for all ranks (#15027) 2025-12-13 00:55:28 -08:00
cynial
80554598d3 Fix GLM-4.6 tool calls don't support streaming output for arguments i… (#13989) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-13 00:37:18 -08:00
Douglas Yang
b2e240bc4a feature: adding nightly wheel workflow and indexer (#14924) 2025-12-13 00:26:10 -08:00
Fenglin Yu
dcc5f5c0da [diffusion] feat: Improve LoRA compatibility by adding unified format detection and diffusers-based normalization (#14659) 2025-12-13 16:04:36 +08:00
Sam
4eda4194f2 [Fix] Disable trtllm moe backend for draft model for a qucik fix (#15002) 2025-12-12 23:58:47 -08:00
Mick
875f84db7b [diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034) 2025-12-13 13:42:38 +08:00
Daniel Cámpora
f6031adf08 Mistral Large 3 NVFP4 support (#14485) 
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
 2025-12-13 13:34:42 +08:00
Chunyuan WU
2a39cfe0ff call check_quantized_moe_compatibility after initialize (#13876) 2025-12-13 13:32:19 +08:00
fzyzcjy
bf17e769fe Add sgl_router_attempt_http_responses_total for single attempt information (#15037) 2025-12-13 13:29:18 +08:00
fzyzcjy
9a5d6a84ab Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036) 2025-12-13 13:28:32 +08:00
fzyzcjy
31c23e5fe3 Provide more fine grained error reason for reqwest error (#15032) 2025-12-13 13:27:06 +08:00
fzyzcjy
06617a9ec8 Tiny change http router response format to unify (#15031) 2025-12-13 13:25:45 +08:00
fzyzcjy
e79ca95961 Tiny unify grpc existing error responses into new format (#15030) 2025-12-13 13:25:10 +08:00
fzyzcjy
9d3b411c56 Add code field and unify error responses for router (#15028) 2025-12-13 13:21:34 +08:00
fzyzcjy
05325db349 Super tiny remove unused log_request (#15035) 2025-12-13 13:21:24 +08:00
Liangsheng Yin
01e3b3f3a3 Fix decode OOM caused by retraction (#14939) 2025-12-13 12:59:17 +08:00