chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
7,655 Commits 1 Branch 0 Tags
02f1e81e2defa70b5bcdc59eb878dec415fdfd12
Commit Graph

360 Commits

Author SHA1 Message Date
Binyao Jiang
ef3f8c97e1 Add ffmpeg into sglang docker - required by transformers multimodal V… (#14679) 2025-12-08 18:00:23 -08:00
Even Zhou
60d36e7be7 [NPU] chore: bump basic software version to 8.3.rc2 (#14614) 2025-12-09 09:14:27 +08:00
yctseng0211
763888b5a8 [AMD] change fused rms quant interface for aiter upgrade (#14497) 2025-12-08 09:09:23 -08:00
sglang-bot
9a327bdfcf chore: bump SGLang version to 0.5.6.post1 (#14651) 2025-12-09 00:35:28 +08:00
sglang-bot
2de98010b5 chore: bump sgl-kernel version to 0.3.19 (#14649) 2025-12-08 22:53:08 +08:00
Xiaoyu Zhang
e5135b73f4 Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544) 2025-12-07 15:29:41 +08:00
sglang-bot
d2b42477c7 chore: bump sgl-kernel version to 0.3.18.post3 (#14518) 2025-12-06 13:15:16 -08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00
ishandhanani
498ea41ca6 dockerfile: add runtime stage + ubuntu 24.04 (#13861) 2025-12-05 00:28:36 -08:00
Kay Yan
0e6441b434 fix: Correct environment variable syntax in docker-compose configuration (#8287) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-12-04 13:03:39 -08:00
fzyzcjy
e3ab23c1a6 Try to fix B200 DeepEP error (#14399) 2025-12-04 00:41:24 -08:00
Sulfur6-L8972
20aad5b5ab Single Batch Overlap for MoE Models (#9660) 
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
Co-authored-by: Zqy11 <841971412@qq.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: TianyuZhang1214 <tianyuzhang1214@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-03 10:07:42 -08:00
sglang-bot
7ae368efde chore: bump SGLang version to 0.5.6 (#14316) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-02 17:17:13 -08:00
sglang-bot
63b9300f00 chore: bump sgl-kernel version to 0.3.18.post2 (#14244) 2025-12-01 23:14:12 -08:00
Liangsheng Yin
427a19b643 Remove cargo config also in .zshenv (#14267) 2025-12-02 11:31:53 +08:00
Baizhou Zhang
03888b9de5 [Minor] Upgrade cutedsl version in Dockerfile (#13968) 2025-12-01 17:15:26 -08:00
Xiaoyu Zhang
9c80072845 Add peak output tokens per second in bench_serving (#14165) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-01 17:47:54 +08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Baizhou Zhang
051ad83347 [chore] Arrange NV packages in Dockerfile (#13749) 2025-11-27 18:08:27 -05:00
Mohammad Miadh Angkad
63b056213f Remove disused B300 Dockerfile (#13946) 2025-11-27 09:48:00 -05:00
Thomas Wang
5a8adca900 Turn off PREBUILD aiter in MI355 (#13963) 2025-11-25 22:30:39 -08:00
sglang-bot
c53e729d45 chore: bump sgl-kernel version to 0.3.18.post1 (#13951) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-11-25 18:14:28 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-25 14:47:34 -08:00
Liwansi
432ecf841e [Ascend] qwen optimization (#12078) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-11-25 19:44:24 +08:00
Baizhou Zhang
04b52fa8d6 [chore]Upgrade flashinfer to 0.5.3 (#13751) 2025-11-23 23:38:36 -08:00
fzyzcjy
45c572c58f Support torch 12.9 + DeepEP by removing custom nvshmem (#12949) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-21 11:11:43 -08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
Thomas Wang
7dcf910d53 Add support for new aiter version (AR accuracy, is_shuffled PR) (#13554) 
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
 2025-11-19 22:17:57 -08:00
sglang-bot
bfaf0b8607 chore: bump sgl-kernel version to 0.3.17.post2 (#13570) 2025-11-19 14:02:57 -08:00
Even Zhou
d4a4dcdfb3 [NPU] Adapt pr-gate for pr-test workflow & workflows refresh (#13567) 2025-11-19 21:55:17 +08:00
Simo Lin
6b9459e86c [docker] fix dockerfile naming for diffusion (#13534) 2025-11-18 12:18:32 -08:00
Chang Su
3a6ec47b0b [model-gateway] limit opened files in docker build to fix edge case (#13536) 2025-11-18 12:17:38 -08:00
Chang Su
b8e32e7965 [model-gateway] fix gateway docker build due to recent py code change (#13532) 2025-11-18 11:24:25 -08:00
Sai Enduri
fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) 2025-11-17 18:13:24 -08:00
Sirut Buasai
a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) 2025-11-17 13:14:17 -08:00
sglang-bot
7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
b8zhong
d5fa58c4dd fix nightly docker build (#13386) 2025-11-16 11:21:09 -08:00
sglang-bot
1ca205f6da chore: bump sgl-kernel version to 0.3.17.post1 (#13358) 2025-11-15 19:11:41 -08:00
Kshiteej K
b5904999c0 docker: Fix apt-add-repository (#13213) 2025-11-13 18:41:29 -08:00
Hubert Lu
2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) 2025-11-13 17:03:41 -08:00
Edmund Suen
909d0d382f docker: fix build error in Dockerfile.diffusion (#12975) 2025-11-13 09:58:16 +08:00
sglang-bot
ebaf86d441 chore: bump SGLang version to 0.5.5.post2 (#13129) 
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
 2025-11-12 20:35:20 +08:00
sogalin
d26ec39ff2 Update aiter to v0.1.7.post1 (#13149) 2025-11-12 03:09:44 -08:00
Hubert Lu
36d147121f [AMD] Apply AITER_MXFP4_MOE_SF=1 only to gfx950 in aiter build (#13092) 2025-11-11 12:26:09 -08:00
Johnsonms
63728b1154 [Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941) 2025-11-12 00:52:02 +08:00
sglang-bot
303cc957e6 chore: bump SGLang version to 0.5.5.post1 (#13000) 2025-11-10 11:53:43 -08:00
sogalin
661c1c97ad Add pre-suffle weight for new aiter MoE support. (#12908) 
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
 2025-11-10 11:42:55 -08:00
sglang-bot
37c40a87a8 chore: bump sgl-kernel version to 0.3.17 (#12966) 2025-11-10 21:50:58 +08:00
kk
90401cf7d2 Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2025-11-09 21:48:36 -08:00