chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
9,108 Commits 1 Branch 0 Tags
71482dd17152ee864a75c2f215d65139c026a6f5
Commit Graph
5872 Commits
Author SHA1 Message Date
triple-muandMick 888e126ac9 [diffusion] comment: fix typo (#16257) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-03 11:42:04 +08:00
Baizhou Zhang bb23a8fe77 [Tiny]Remove progress bar for fp8 ue8m0 quant when unneeded (#16177) 2026-01-03 10:54:12 +08:00
sunxxuns 8b869e326c [AMD] feat: add DLLM support for AMD GPUs with LLaDA2 testing (#15560) 2026-01-03 10:41:11 +08:00
Lianmin Zhengandgithub-actions[bot] <github-actions[bot]@users.noreply.github.com> 62f73a8c81 [Auto Sync] Update engine.py (20260102) (#16317) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2026-01-02 17:29:40 -08:00
Ke Bao 7c1b4b1c4c Support swa allocator page size > 1 (#16296) 2026-01-03 08:49:47 +08:00
sunxxuns 30cfb687fa fixed amd multimodal CI failures caused by refactor in #15812 #15813 (#16287) 2026-01-02 14:55:42 -08:00
Baizhou Zhang f07e76b229 Multiple refactors of DeepSeek V32 and context parallel (#16305) 2026-01-03 02:21:22 +08:00
Xiaoyu Zhang 1cfd2b2ded [diffusion] chore: remove redundant ulysses nccl warmup (#16301) 2026-01-03 00:19:35 +08:00
Yongfei Xu 0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
Changyi YangandMick 0eae831797 [diffusion] fix: Increase text length from 256 to 1024 in Qwen-Image (#16248) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2026-01-02 23:25:31 +08:00
Ke Bao c483a5f45f Tiny adjust hybrid swa handling (#16292) 2026-01-02 23:11:23 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> f26f6c2c99 [diffusion] fix: make lora compatible with layerwise-offload (#16298) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2026-01-02 22:33:26 +08:00
roikoren755 b021332339 [NemotronH] Add latent MoE support (#16227) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2026-01-02 22:08:58 +08:00
Mick 5062537b67 [diffusion] feat: support lightweight e2e warmup for benchmarking (#16213) 2026-01-02 20:10:27 +08:00
Ke Bao 698629d1f2 Add swa page table to FA3 backend forward metadata (#16267) 2026-01-02 20:00:43 +08:00
Qiaolin Yu dd93e4451c Support returning customized info (#16144) 2026-01-02 15:32:18 +08:00
Yuhao Yang 6c8587b5db [diffusion] fix: align negative prompt with official readme for new model (#16222) 2026-01-02 15:20:56 +08:00
Yinghai Lu 027042604d [distributed] Clean up MoE groups in destroy_model_parallel (#15345) 2026-01-02 14:45:14 +08:00
Xiaoyu Zhang bd48ad5e6b [Diffusion] Fix broken ring_attention when use upstream fa3 (#16270) 2026-01-02 14:33:12 +08:00
fzyzcjy 749736ba95 Tiny fix single-gpu dumper and add tests for dumper (#16285) 2026-01-02 13:30:09 +08:00
Nan JiangandXinyuan Tong 7254986342 [VLM] feat: true on policy for vlm + fsdp (#14636) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2026-01-01 16:54:39 -08:00
DarkSharpness f6f7af4068 [Refactor] Clean up custom op (#15995) 2026-01-01 21:41:56 +08:00
DarkSharpness a3b1e8ef3d [Feature] add aligned_vector type for JIT kernel (#16162) 2026-01-01 21:40:05 +08:00
fzyzcjy db499e1889 Tiny add filter, support duplications, add visualizations, fix error and robustness for dump comparator (#16262) 2026-01-01 17:47:00 +08:00
fzyzcjy 6cf3a6dd69 Support HTTP control for dumper (#16261) 2026-01-01 17:40:17 +08:00
fzyzcjy 90e24f5c31 Tiny add filter, dump dict, failable save to dumper (#16260) 2026-01-01 17:35:38 +08:00
Mick 21de3e1406 [diffusion] webui: tiny fix loading output image (#16251) 2026-01-01 14:34:49 +08:00
Lianmin Zheng e4c1e441af Fix deprecation warning of sre_parse for python 3.13 (#16247) 2025-12-31 21:25:09 -08:00
1874.ronnie_zhengLiangsheng Yin
 		e0e5084802 Fix parse args from file(#13911) (#14085) 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-01-01 11:37:33 +08:00
Yuan Luoandluoyuan.luo 3a42c5e341 [VLM] Adopt jit qk_norm kernel in VLM (#16171) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2026-01-01 10:10:36 +08:00
Kangyan-Zhou 12b89e51d8 Add P90/99 e2e latency in bench_serving script (#16245) 2025-12-31 15:40:33 -08:00
Feng Su 57d2ba9203 SGLang Tracing: Supports propagating trace headers through sgl.Engine… (#15814) 
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
 2025-12-31 15:19:53 -08:00
ishandhanani 0500fea965 fix editable install (#16241) 2025-12-31 14:34:54 -08:00
Cheng Wan 2b461c15b4 Update logprob_start_len handling in scheduler (#16240) 2025-12-31 14:11:24 -08:00
siyu abdf65d4f3 Fix OOM by offloading multimodal features to CPU after embedding (#16018) 2025-12-31 23:02:34 +08:00
Huaixin ChangandLiangsheng Yin c1dfbc777b deprecate prefill-round-robin-balance (#16195) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2025-12-31 22:25:33 +08:00
Muqi Li 2667c857a7 Fix DeepSeekV31's structural tag trigger (#13394) 2025-12-31 21:13:52 +08:00
Kangyan-Zhou fc643ffbc9 Download missing shards in model weights files when not in CI (#16211) 2025-12-31 20:42:34 +08:00
Yuhao YangandMick 4280a18a13 [diffusion] CI: add test for cache-dit (#16204) 
Co-authored-by: Mick <mickjagger19@icloud.com>
 2025-12-31 19:58:10 +08:00
Baizhou Zhang e47afa0237 [DP]Fix sync bubble in adjust_num_token_non_padded_for_attn_tp (#16178) 2025-12-31 17:58:18 +08:00
cen121212 25b48564c3 [NPU][Bugfix] fix Qwen3-VL-30B-A3B-Instruct accuracy loss (#15597) 2025-12-31 15:57:38 +08:00
chhnbandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 3619ec61b4 [diffusion] feat: support multi-frame image output (#15878) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-31 13:50:02 +08:00
Hudson Xing 8a9ca41fda Move log_prefill_stats_late to correct location in PP mode (#15946) 2025-12-31 12:00:24 +08:00
roikoren755 47a660d5b9 [NemotronH] PP support (#16172) 
Signed-off-by: Roi Koren <roik@nvidia.com>
 2025-12-31 11:16:15 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 5bf0d862dd [diffusion] CI: fix generate mode and add cli test (#16174) 
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
 2025-12-31 09:51:48 +08:00
liupeng374 75b72eb8b2 [cp] assert dsv3.2 cp in pd decode mode (#16156) 2025-12-31 09:24:46 +08:00
LeoyzenXinyuan TongXinyuan Tong
 		bc8b526eda Fix: Handle empty func_name and None values in GLM MoE detectors (#15754) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-12-30 14:32:35 -08:00
Izzy Putterman 3dfff6ae3c Eagle: GPT-OSS Eagle v2 support (#14920) 
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
 2025-12-30 14:23:07 -08:00
EkiRui ad2c1ee352 doc: mooncake store add dummy client support (#16050) 
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
 2025-12-30 12:37:57 -08:00
Yineng Zhanggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Scott Lee
 		00e607111a [Auto Sync] Update request_metrics_exporter.py (20251230) (#16183) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
 2025-12-30 11:09:41 -08:00