chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
9,684 Commits 1 Branch 0 Tags
bd39de7d5e468197ddf2907cd372ebb1e853cb19
Commit Graph
119 Commits
Author SHA1 Message Date
shuwenn bd39de7d5e [Env] centralize hicache vars in environ.py (#17204) 2026-02-13 18:02:31 -08:00
Leon Gao ab0fb248fd feat: add SGLANG_DISTRIBUTED_INIT_METHOD_OVERRIDE env var (#18743) 2026-02-14 09:37:33 +08:00
Liangsheng Yin e6f7a372ef Rename request timeout env vars for waiting/running stages (#18766) 2026-02-12 22:58:40 -08:00
McZyWuandcy 4f7422f7ba [NPU] support model skywork-reward-gemma2-2-27B-v0.2 (#16947) 
Co-authored-by: cy <chenyang08056032@163.com>
 2026-02-11 15:34:53 +08:00
Zheng Liand瑀澈 44603764d6 fix(config): Support setting Mamba state dtype via config file (#18532) 
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
 2026-02-11 00:20:06 +08:00
Xinyuan TongXiaoyu ZhangBaizhou Zhang
 		e8a2c13380 Deepseekv32 compatibility with transformers v5 (#18297) 
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2026-02-10 14:50:40 +08:00
siyu 0b15f19927 [EPD] Add notification mechanism to fix server hang and add timeout env var (#18229) 2026-02-10 11:52:54 +08:00
Baizhou Zhang d279520ba5 [DeepGemm] Add a flag for fast warmup (#18111) 2026-02-04 14:12:13 +08:00
StonyPortandqiuxuan.lzw 2b3408ff14 feat: add forward timeout (#17831) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
 2026-01-30 08:52:29 +08:00
Joe Redmond 0ff0d181ca feat: add custom request header logging (#17786) 2026-01-28 19:33:08 -08:00
zackyoray d275d47973 [NIXL] Add custom NIXL backend selection for KVManager (#17146) 
Signed-off-by: Yoray Zack <yorayz@nvidia.com>
 2026-01-26 14:35:38 +08:00
Nicolas Castet 48e9daadff Support symmetric memory pre-allocation to avoid fragmentation (#17089) 2026-01-23 17:57:04 +08:00
Ke Bao 7ace64d1d8 Update mamba env setting (#17566) 2026-01-23 11:02:32 +08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Binyao Jiang
 		1fdf5cac39 [Auto Sync] Update environ.py, fp8.py (20260121) (#17486) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Binyao Jiang <byjiang1996@gmail.com>
 2026-01-21 12:04:09 -08:00
Baizhou Zhang 6ea491e439 Overlap shared experts with deepep dispatch for single batch overlap on Blackwell (#17289) 2026-01-21 02:56:55 +08:00
Baizhou Zhang 55c616427d Add flag that enables NCCL mlp sync batch for overlap scheduler (#17288) 2026-01-20 23:06:55 +08:00
Jinyan ChenandJinyan Chen e00b43442d [jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631) 
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
 2026-01-18 12:54:36 -08:00
b8zhongandVincent Zhong 4df74eb576 [Refactor] Add -fp4-gemm-backend to replace SGLANG_FLASHINFER_FP4_GEMM_BACKEND (#16534) 
Co-authored-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
 2026-01-18 23:25:46 +08:00
siyu e18e0057a4 Add an env var to allow transferring small metadata via TCP for PD (#16951) 2026-01-16 18:32:22 -08:00
StonyPortqiuxuan.lzwXiaoyu Zhang
 		3355b6e21b feat: add request queued timeout (#17143) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2026-01-16 17:55:09 +08:00
Lianmin ZhengandLiangsheng Yin e7dc85c50b Fix grammar sync across TP ranks (#17100) 
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
 2026-01-15 18:38:01 -08:00
shuwenn 48c2aca9ba [Env] centralize pd vars in environ.py (#16264) 2026-01-14 23:06:01 +08:00
Liangsheng Yin e2c8a50b38 fix grammar timeout sync across tp ranks. (#16898) 2026-01-14 10:26:31 +08:00
fzyzcjy dae6a4092a Tiny add scheduler status logging (#16872) 2026-01-10 20:12:24 +08:00
fzyzcjy c89949bbaf Tiny let soft watchdog cover initialization phase (#16853) 2026-01-10 13:20:08 +08:00
fzyzcjy cec19b56c6 Tiny add command line args for prefill delayer and unify names (#16830) 2026-01-10 07:54:25 +08:00
fzyzcjy 8eeffbe9aa Support token low usage watermark in prefill delayer (#16814) 2026-01-09 23:07:18 +08:00
siyu 6b3f93c4dd vlm: support SGLANG_MM_SKIP_COMPUTE_HASH for bypassing multimodal feature hashing (#16555) 2026-01-08 11:10:00 +08:00
Baizhou Zhang 7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
fzyzcjy 9d6029fb92 Fix TokenizerManager bottleneck for offline generation (#16456) 2026-01-05 16:28:25 +08:00
fzyzcjy 12df16607b Tiny speed up kimi detokenizer by 10x (#16427) 2026-01-05 09:12:05 +08:00
fzyzcjy 2337b1bbb0 Refactor and fix prefill delayer (scheduler enhancer) (#16269) 2026-01-04 07:15:06 +08:00
EkiRuiandTeng Ma ef4b3c0e96 Add host tensor allocator for memory_pool_host and support Mooncake standalone storage (#14873) 
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
 2025-12-28 16:28:50 -08:00
lif 5969be2f06 Apply fixture-kit mode to MMMUVLMMixin (#15615) 2025-12-28 17:22:05 +08:00
Liangsheng Yin bf90ea9c5b Unify spec v2's naming manner. (#15990) 2025-12-28 14:14:52 +08:00
Baizhou Zhang 656f4d69a1 Refactor fp8 nextn layer for DeepSeek nvfp4 checkpoint (#15353) 2025-12-28 11:57:09 +08:00
Lianmin Zheng a8380ded71 Add a test case for crash dump (#15905) 2025-12-26 19:39:28 -08:00
StonyPortqiuxuan.lzwXiaoyu Zhang
 		b6702d72cf feat: log request when e2e latency exceeds the specified value (#15759) 
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
 2025-12-25 23:12:35 +08:00
Liangsheng Yin f4e835af2f Cleanup ModelRunner (#15802) 2025-12-25 18:13:30 +08:00
Liangsheng Yin b311c43d13 Clarify None handling in sglang's environ (#15770) 2025-12-25 11:40:17 +08:00
Huaixin Chang 0c39730b18 DP: support piggyback server load report (#11469) 
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
 2025-12-25 11:35:05 +08:00
Liangsheng Yin 159b128357 Tiny add flush for CI crash locating (#15769) 2025-12-24 22:47:10 +08:00
fzyzcjy fd4a558e71 Add metrics for having prefill and decode in different ranks (#15752) 2025-12-24 21:35:35 +08:00
vincentzed ddb3970eb4 Tiny env cleanup in deepgemm (#15706) 
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
 2025-12-24 00:58:46 -08:00
Xuchun ShangTeng MaKunKunliusy58
 		3bf07c684f [Feature][MM] split the images of one request into multiparts (#11828) 
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Kun(llfl) <llfl@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
 2025-12-24 11:22:04 +08:00
Douglas Yang f9dd90ac35 fix: increasing H200 test timeout (#15600) 2025-12-23 01:00:37 -08:00
Yuan Luoandluoyuan.luo 828dec1c7c [VLM] Tiny: Unify VLM environment variables (#15572) 
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
 2025-12-22 17:32:37 +08:00
fzyzcjy d5431ff894 Tiny add stuck simulation (#15613) 2025-12-22 17:00:18 +08:00
fzyzcjy 89619a9904 Tiny avoid EnvField misuse (#15612) 2025-12-22 16:20:47 +08:00
sunxxunsandThomas Wang f2d64e6782 [amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340) 
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
 2025-12-18 23:36:03 -08:00