chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,885 Commits 1 Branch 0 Tags
cc63c99f112f781605017db018fced686cdc94de
Commit Graph

9885 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
shuwenn
c0fc7a89e7 [sgl-kernel] fix: make sgl-kernel build respect MAX_JOBS (#15575) 2025-12-31 10:44:45 +08:00
Mick
5bf0d862dd [diffusion] CI: fix generate mode and add cli test (#16174) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-31 09:51:48 +08:00
liupeng374
75b72eb8b2 [cp] assert dsv3.2 cp in pd decode mode (#16156) 2025-12-31 09:24:46 +08:00
Leoyzen
bc8b526eda Fix: Handle empty func_name and None values in GLM MoE detectors (#15754) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-12-30 14:32:35 -08:00
Izzy Putterman
3dfff6ae3c Eagle: GPT-OSS Eagle v2 support (#14920) 
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
 2025-12-30 14:23:07 -08:00
EkiRui
ad2c1ee352 doc: mooncake store add dummy client support (#16050) 
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
 2025-12-30 12:37:57 -08:00
Simo Lin
9940c6f592 [model-gateway]: ASCII byte comparison and probabilistic timestamp updates (#16181) 2025-12-30 12:28:01 -08:00
Yineng Zhang
00e607111a [Auto Sync] Update request_metrics_exporter.py (20251230) (#16183) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
 2025-12-30 11:09:41 -08:00
Simo Lin
4bc2f2e0bc [model-gateway][docs] Add Classification API documentation (#16182) 
Co-authored-by: Chang Su <chang.s.su@oracle.com>
 2025-12-30 10:53:31 -08:00
Roger Young
d17b9e6392 Fusing RMSNormTP in minimax_m2 (#14416) 
Co-authored-by: xuebi <xuebi@minimaxi.com>
 2025-12-30 10:22:07 -08:00
Liangsheng Yin
ba67e006a7 Refactor speculative algorithm registry. (#16168) 2025-12-31 01:24:22 +08:00
DarkSharpness
45f3ad2f52 [Refactor] Rename CustomOp -> MultiPlatformOp (#16175) 2025-12-31 01:16:32 +08:00
Baizhou Zhang
f35b5da521 [CI] Append test variant name to markdown report header in nightly test (#16166) 2025-12-31 00:09:24 +08:00
Xiaoyu Zhang
733a0c1a37 [Diffusion] Zimage opt with qknorm and flashinfer rope (#16161) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-30 23:39:32 +08:00
Xiaoyu Zhang
b369aaa23f [Diffusion] Refine diffusion profling doc (#16163) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-30 23:38:46 +08:00
Ke Bao
b973202526 Split tp model worker init (#16165) 2025-12-30 23:36:03 +08:00
Mufeez Amjad
cbff7ad985 dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110) 2025-12-30 22:33:06 +08:00
Liangsheng Yin
4de59d83a1 Reduce stages of pr-test from 4 to 3. (#16173) 2025-12-30 22:21:48 +08:00
Yuhao Yang
39ca57cd28 [diffusion] chore: tiny fix model config (#16159) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-30 22:11:38 +08:00
Mick
3449806727 [diffusion] feat: generalize layer-wise-offload to all supported models (#16150) 2025-12-30 22:06:57 +08:00
Ke Bao
b3817fa93b Split model_worker init function (#16160) 2025-12-30 21:39:11 +08:00
Ke Bao
059428bd8a Tiny remove additional args in init_memory_pool (#16158) 2025-12-30 21:38:06 +08:00
jiapingW
5d200dd8d9 [diffusion] bench: distinguish between video generation and image generation in the bench_serving (#16149) 2025-12-30 21:29:18 +08:00
husf
7f9a3d0609 [docs][NPU]Update model and feature docs support (#16124) 2025-12-30 20:05:40 +08:00
Jumiar
664f611e83 Add profiling capture support to the encoder server (#15730) 
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
 2025-12-30 19:56:25 +08:00
yh0903
49adb37e37 [diffusion] chore: fix ZMQ binding and model loading for FastWan compatibility (#13978) 
Co-authored-by: Han Yu <hyu5@dt-login01.delta.ncsa.illinois.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-30 18:09:38 +08:00
Gaoji Liu
7518dc3532 feat(SpecEagleV2): add standalone_worker_v2 (#12625) 
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
 2025-12-30 17:55:04 +08:00
Liangsheng Yin
b6871ba7c9 [CI] set max-parallel to 4 by default. (#16154) 2025-12-30 17:27:48 +08:00
Baizhou Zhang
98225be6e5 [CI] Fixing release with cut branch workflow (#16153) 
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
 2025-12-30 17:18:02 +08:00
Yuan Luo
94bcc19bce [VLM] Support Video for InternVL3_5 (#15942) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-30 17:07:49 +08:00
Shangming Cai
db3821a9ef [PP] Add a minimum chunk value for PP dynamic chunking (#16140) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-12-30 16:35:39 +08:00
Alison Shao
8c5d91b884 Fix race condition in /tag-and-rerun-ci command (#16142) 2025-12-30 15:55:49 +08:00
Qiaolin Yu
6a3e709253 Tiny rename test_deepseek_v3_fp4_mtp_stage_b.py (#16141) 2025-12-30 15:55:07 +08:00
Liangsheng Yin
c2601f0d21 Fix wrong assigning extend_input_len_per_req with eagle. (#16129) 2025-12-30 15:51:53 +08:00
Vitaly Tuzov
1048803c1f Reworked fast_pos_embed_interpolate() using torch (#10959) 2025-12-30 14:45:34 +08:00
HuangJi
8a84b1e7e0 [diffusion] model: support TurboWan2.1-T2V-1.3B/14B SLA (#15888) 2025-12-30 14:30:22 +08:00
Bingxu Chen
5e20e7a60d [AMD CI] Organize AMD nightly perf test files (#16114) 2025-12-29 22:09:46 -08:00
Liangsheng Yin
3946dad6fa Add attack204 into CI_PERMISSION (#16131) 2025-12-30 13:55:00 +08:00
Liangsheng Yin
ac03ec0851 Add PR review process into template. (#16133) 2025-12-30 13:45:56 +08:00
Stefan He
9416464682 Fix Qwen Next GDN w/ Radix Cache (#16053) 2025-12-29 21:06:06 -08:00
Cheng Wan
5fb734f1a5 Enhance comments in set_extend_input_len method (#16130) 2025-12-29 20:47:33 -08:00
Cheng Wan
60f1ca6925 Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105) 2025-12-30 12:38:33 +08:00
Vladimir Serov
9e263c2162 [LoRA] Torch native backend: rework implementation and updated tests (#15187) 2025-12-30 11:48:51 +08:00
Kangyan-Zhou
0d003e34b0 Reduce CI failure monitor to run once every 12 hours (#16123) 2025-12-29 19:44:25 -08:00
Prozac614
f253f43c9d [diffusion] CI: fix LoRA downloading issues and respect offline flag (#15813) 2025-12-30 11:39:27 +08:00
Mick
1e45320198 [diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081) 2025-12-30 11:31:00 +08:00
Mick
26e17f9076 [diffusion] improve: tiny speedup qwen-image-edit-2511 by avoiding unnecessary calculation (#15896) 2025-12-30 10:10:32 +08:00
Ke Bao
3de23274ee Clean up swa handling in fa3 backend (#15877) 2025-12-30 08:51:40 +08:00
Alison Shao
f4ec6f8e17 ci: migrate remaining spec/eagle tests to test/registered/spec/ (#15800) 2025-12-29 14:00:00 -08:00
Kangyan-Zhou
9c4eb46099 Add a new branch cut GH workflow, and adopt setuptools-scm for version control (#15985) 2025-12-29 13:51:21 -08:00