chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
8,810 Commits 1 Branch 0 Tags
b5493f65be22447af02edbfb6eb4cee71f2bc779
Commit Graph

8810 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Johnny
b5493f65be [NVIDIA] upstream FA4 (#15182) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-01-11 15:31:28 +08:00
Liangsheng Yin
09e2571e2e Clarify the meaning of cpu_group / entry_rank when dp + tp is enabled. (#16876) 2026-01-11 13:04:43 +08:00
Ratish P
c0248d6f37 [dpc]: unify DP controller load balancing and simplify dispatch logic (#16258) 2026-01-11 12:38:03 +08:00
Alison Shao
cc25f9df50 Update est_time for stage-b-test-small-1-gpu tests (#16835) 2026-01-11 12:03:43 +08:00
Leoyzen
cf14feba4d Fix parallel tool call parsing bug when tool parameters contain arrays (#16345) 2026-01-10 19:31:38 -08:00
Simo Lin
7c25687c9b fix(gateway): rewrite gauge_histogram.rs for zero-allocation hot path (#16878) 2026-01-10 18:15:21 -08:00
Mohammad Miadh Angkad
ff97814232 Tiny fix hicache kernel backend comparison (#16867) 
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
 2026-01-10 18:10:42 -08:00
DarkSharpness
d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
Minglei Zhu
a2c2c09d7d [BugFix] fix gpt-oss-120b launch failure with --enable-piecewise-cuda-graph (#16757) 2026-01-11 09:19:59 +08:00
Yuwei An
2a9344d320 [tiny remove] remove torch_compile in parallel_state (#16865) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 16:04:25 -08:00
Liangsheng Yin
78c41758ad [hot fix ci] Hot fix for the unregistered. (#16877) 2026-01-11 01:24:32 +08:00
Qiaolin Yu
206db66f5c tiny refactor pcg split op registration (#16863) 2026-01-10 23:45:28 +08:00
WenhaoZhang
5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 23:32:45 +08:00
wxy
76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) 2026-01-10 21:25:59 +08:00
Yuan Luo
d1ec93e3ac Optimize layernorm_gated for Qwen3-Next (#16397) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-10 20:55:31 +08:00
WenhaoZhang
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 20:17:35 +08:00
fzyzcjy
dae6a4092a Tiny add scheduler status logging (#16872) 2026-01-10 20:12:24 +08:00
fzyzcjy
a0899bdbd8 Fix log_decode_stats_every_iteration when having TP in attention (#16871) 2026-01-10 20:10:23 +08:00
fzyzcjy
641830c1c2 Tiny extract file logging utils (#16870) 2026-01-10 20:02:37 +08:00
YAMY
3fd88ea9b5 [MTP][spec_v2] Fix TRTLLM MLA backend crash in EAGLE draft_extend mode (#15790) 2026-01-10 19:58:23 +08:00
Yuwei An
145bd54f1b Piecewise Cuda Graph Memory Usage (#15927) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 19:29:13 +08:00
YAMY
2d088b85d9 [IDLE FORWARD][Indexer] Fix forward_idle bs mismatch issue in DeepseekV3.2's NSAIndexer (#15227) 2026-01-10 18:14:30 +08:00
lg(x)
3a8b44fe89 Update LoRA Weights via Tensor (#16226) 
Co-authored-by: PopSoda2002 <zhouhp.me@gmail.com>
 2026-01-10 17:36:43 +08:00
hlu1
aeb480c11f Add top-p to run_eval.py (#16844) 2026-01-10 17:10:37 +08:00
Baizhou Zhang
9fd2358cc2 Update Cutedsl version and pin cuda-python version (#16838) 2026-01-10 17:08:43 +08:00
Liangsheng Yin
3c358736d1 Enhance test for dp-attention + constrained decoding. (#16849) 2026-01-10 16:49:10 +08:00
Glen Liu
6327dff242 enhance LoRA tests and fix base model LoRA eviction in Scheduler (#16333) 2026-01-10 16:49:00 +08:00
Zhiqiang Xie
675acecec6 Attention backend selection bug fix for hicache (#16779) 
Co-authored-by: hxie <haiyong.xie@ustc.edu>
 2026-01-10 00:22:41 -08:00
Yuan Luo
ad20127359 [CI] Remove duplicate code in test_mamba_ut (#16854) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-10 16:16:56 +08:00
Baizhou Zhang
7f393d9512 [Docker] Add nightly dev docker for Cuda 13 (#16862) 2026-01-10 14:56:53 +08:00
Shangming Cai
4b14f622e1 [CI] Add PD Disaggregation aarch64 test (#16572) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-10 14:44:54 +08:00
Baizhou Zhang
94fc26aad8 [Doc]Update note for Cuda 13 container usage (#16805) 2026-01-10 14:03:19 +08:00
Insideyyy
67b61a4e8d [Rework] Add SwapAB Optimization for triton fused_moe_kernel on SM90. (#16723) 2026-01-10 13:57:44 +08:00
Shifang Xu
d27f16f38a Fix EPLB + FP4 Quantization Compatibility Issue (#13715) 
Co-authored-by: Shu Wang <shuw@nvidia.com>
 2026-01-10 13:38:19 +08:00
fzyzcjy
c89949bbaf Tiny let soft watchdog cover initialization phase (#16853) 2026-01-10 13:20:08 +08:00
Ziang Li
20abaee26c [DSv32] Overlap indexer weights_proj during dual_stream decode (#16637) 
Co-authored-by: Ziang Li <ziangli@humansand.ai>
 2026-01-10 13:06:44 +08:00
fzyzcjy
32a569fb77 Tiny add CPU resource monitoring for overload diagnosis (#16852) 2026-01-10 12:48:18 +08:00
fzyzcjy
3ed3b7ef7c Tiny add routing key distribution metrics (#16847) 2026-01-10 12:06:40 +08:00
fzyzcjy
1f9d4795a9 Tiny add gauge histogram abstraction for engine and router (#16848) 2026-01-10 11:45:25 +08:00
Liangsheng Yin
e6d40bff81 Revert "feat: reduce constrained-decoding overhead in TP" (#16845) 2026-01-10 11:39:38 +08:00
若可
fbc128a32e fix(function_call): group batch decode by options instead of fallback (#16698) 
Co-authored-by: Muqi Li <muqi1029@gmail.com>
 2026-01-10 11:38:13 +08:00
Alison Shao
9c64a15ad4 feat: add workflow run URL to /rerun-stage comment (#16825) 2026-01-10 10:41:20 +08:00
Yinghai Lu
e91a717632 [llama] Allow passing tp_rank and tp_size into llama mlp (#16837) 2026-01-10 10:32:05 +08:00
fzyzcjy
1f0ea4f958 Add routing key based schedule policy (#16840) 2026-01-10 10:16:23 +08:00
fzyzcjy
15da3061bc Tiny pass routing key to scheduler processes (#16839) 2026-01-10 10:13:00 +08:00
fzyzcjy
6406a5969b Tiny support customizing prometheus buckets for prefill delayer (#16831) 2026-01-10 08:17:37 +08:00
fzyzcjy
cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) 2026-01-10 07:54:25 +08:00
Alison Shao
ef35d8fe4e Migrate VLM tests and remove unit-test-backend-1-gpu job (#16679) 2026-01-09 15:24:26 -08:00
Yuan Luo
08636f72b5 [Fix CI] Fix test_mamba_unittest.py (#16810) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-09 15:03:47 -08:00
Sai Enduri
a6c29d4cbd [AMD CI] Temporarily disable docker caching. (#16783) 2026-01-09 14:35:49 -08:00