chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
khalilzhk
9a628744fc [CI] fix piecewise graph test case on ascend (#16933) 2026-01-12 20:16:30 +08:00
chenxu214
53dca74f47 Bugfix: EagleDraftWorker has not attribute "eagle_use_aux_hidden_state" (#16480) 2026-01-12 20:14:35 +08:00
HuangJi
2dadf63562 [diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-12 19:40:37 +08:00
ybyang
aab640c99f add doc for dsv32 cp+pp (#16916) 2026-01-12 19:14:07 +08:00
Liangsheng Yin
2b3791ed37 Fix wrong kernel selection for int32/int64 indices (#16912) 
Co-authored-by: DarkSharpness <2040703891@qq.com>
 2026-01-12 17:26:57 +08:00
Xun Sun
9f5cd80a8d Re-introduce the unit test of test_mooncake_ep_small (#16019) 2026-01-12 17:01:24 +08:00
YC Tseng
b1ee75ae7b [AMD] CI - enable test case for amd ci : triton_attention_kernels , torch_compile_moe (#16559) 2026-01-12 00:06:31 -08:00
Hu Chong
f44c63eef7 [diffusion] chore: validate sampling params (#16677) 
Co-authored-by: root <root@huchong2-0.huchong2.podvm.svc.cluster.local>
 2026-01-12 16:00:10 +08:00
Wenyi Xu
c54c70ab62 [model-gateway] Improve Health Check Logging (#16930) 2026-01-11 23:01:29 -08:00
Adarsh Shirawalmath
aab906a3d4 [docs] sync diffusion docs to main docs (#16932) 2026-01-12 14:49:55 +08:00
HuangJi
feb39f7768 [diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536) 2026-01-12 13:55:38 +08:00
fzyzcjy
38b30c7b56 Tiny refactor age computation in router (#16850) 
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
 2026-01-11 21:42:43 -08:00
Hexq0210
c581b5ed79 [NPU] update feature supported on ascend NPU (#16915) 2026-01-12 11:47:58 +08:00
fzyzcjy
a1c48943d7 Tiny fix NoAvailableWorkers being a RetryError (#16896) 2026-01-11 18:53:17 -08:00
Liangsheng Yin
5b7bed7ca4 Decouple grammar logic out of scheduler. (#16820) 2026-01-12 10:52:42 +08:00
chenxu140
38a88479c6 llama model and llama eagle3 model support dp-attn (#15268) 2026-01-12 08:54:56 +08:00
ybyang
503c3d9566 [model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909) 2026-01-11 16:09:41 -08:00
Liangsheng Yin
934ae89abe Tiny fix typo minxin -> mixin (#16908) 2026-01-12 00:36:45 +08:00
Liangsheng Yin
cf1426a7b7 [CI] reapply max-parallel in stage-b-test-small-1-gpu (#16906) 2026-01-11 23:17:38 +08:00
Alison Shao
17cb3c8e49 Enable /rerun-stage workflow URL lookup for fork PRs (#16851) 2026-01-11 23:05:37 +08:00
Yibo Cai
2f4a6addf3 [cpu/arm64] support run sglang on arm64 cpu (#14867) 2026-01-11 04:27:19 -08:00
Baizhou Zhang
f9fc50acd6 [Tiny] Rename test_sparse_flash_attn.py to fix CI (#16895) 2026-01-11 18:18:29 +08:00
Wenyi Xu
3c16c58619 [model-gateway] Add Redis support as a history backend (#16300) 2026-01-11 01:03:00 -08:00
Adarsh Shirawalmath
7b089ae4e0 [Diffusion] Docs for Diffusers backend (#16864) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-11 00:08:26 -08:00
Baizhou Zhang
8b5d426340 [CI]Move fa4 e2e test to 4-gpu-b200 runner (#16889) 2026-01-11 15:53:38 +08:00
Johnny
b5493f65be [NVIDIA] upstream FA4 (#15182) 
Co-authored-by: Qiaolin-Yu <liin1211@outlook.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-01-11 15:31:28 +08:00
Liangsheng Yin
09e2571e2e Clarify the meaning of cpu_group / entry_rank when dp + tp is enabled. (#16876) 2026-01-11 13:04:43 +08:00
Ratish P
c0248d6f37 [dpc]: unify DP controller load balancing and simplify dispatch logic (#16258) 2026-01-11 12:38:03 +08:00
Alison Shao
cc25f9df50 Update est_time for stage-b-test-small-1-gpu tests (#16835) 2026-01-11 12:03:43 +08:00
Leoyzen
cf14feba4d Fix parallel tool call parsing bug when tool parameters contain arrays (#16345) 2026-01-10 19:31:38 -08:00
Simo Lin
7c25687c9b fix(gateway): rewrite gauge_histogram.rs for zero-allocation hot path (#16878) 2026-01-10 18:15:21 -08:00
Mohammad Miadh Angkad
ff97814232 Tiny fix hicache kernel backend comparison (#16867) 
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
 2026-01-10 18:10:42 -08:00
DarkSharpness
d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
Minglei Zhu
a2c2c09d7d [BugFix] fix gpt-oss-120b launch failure with --enable-piecewise-cuda-graph (#16757) 2026-01-11 09:19:59 +08:00
Yuwei An
2a9344d320 [tiny remove] remove torch_compile in parallel_state (#16865) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 16:04:25 -08:00
Liangsheng Yin
78c41758ad [hot fix ci] Hot fix for the unregistered. (#16877) 2026-01-11 01:24:32 +08:00
Qiaolin Yu
206db66f5c tiny refactor pcg split op registration (#16863) 2026-01-10 23:45:28 +08:00
WenhaoZhang
5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 23:32:45 +08:00
wxy
76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) 2026-01-10 21:25:59 +08:00
Yuan Luo
d1ec93e3ac Optimize layernorm_gated for Qwen3-Next (#16397) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-10 20:55:31 +08:00
WenhaoZhang
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737) 
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-10 20:17:35 +08:00
fzyzcjy
dae6a4092a Tiny add scheduler status logging (#16872) 2026-01-10 20:12:24 +08:00
fzyzcjy
a0899bdbd8 Fix log_decode_stats_every_iteration when having TP in attention (#16871) 2026-01-10 20:10:23 +08:00
fzyzcjy
641830c1c2 Tiny extract file logging utils (#16870) 2026-01-10 20:02:37 +08:00
YAMY
3fd88ea9b5 [MTP][spec_v2] Fix TRTLLM MLA backend crash in EAGLE draft_extend mode (#15790) 2026-01-10 19:58:23 +08:00
Yuwei An
145bd54f1b Piecewise Cuda Graph Memory Usage (#15927) 
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
 2026-01-10 19:29:13 +08:00
YAMY
2d088b85d9 [IDLE FORWARD][Indexer] Fix forward_idle bs mismatch issue in DeepseekV3.2's NSAIndexer (#15227) 2026-01-10 18:14:30 +08:00
lg(x)
3a8b44fe89 Update LoRA Weights via Tensor (#16226) 
Co-authored-by: PopSoda2002 <zhouhp.me@gmail.com>
 2026-01-10 17:36:43 +08:00
hlu1
aeb480c11f Add top-p to run_eval.py (#16844) 2026-01-10 17:10:37 +08:00
Baizhou Zhang
9fd2358cc2 Update Cutedsl version and pin cuda-python version (#16838) 2026-01-10 17:08:43 +08:00