chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,116 Commits 1 Branch 0 Tags
47cb9b9d116d1c5c112e894110ec94de80f2db6b
Commit Graph

431 Commits

Author SHA1 Message Date
b8zhong
7dc3cbe7ca [Docker] Fix CUDA 13 installing wrong nvidia-nccl-cu13 due to nixl-cu13 not breaking system package (#17370) 2026-01-20 09:52:30 +08:00
Baizhou Zhang
a04675892e Update flashinfer to 0.6.1 (#15551) 2026-01-17 00:48:30 +08:00
R0CKSTAR
a1dd3d48ac [diffusion] hardware: support diffusion (single GPU, 3/N) (#17105) 
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
 2026-01-16 17:01:09 +08:00
sglang-bot
000ad42225 chore: bump sgl-kernel version to 0.3.21 (#17075) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2026-01-15 12:41:17 +08:00
Hubert Lu
8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
James
ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) 2026-01-13 09:02:10 +08:00
Baizhou Zhang
9fd2358cc2 Update Cutedsl version and pin cuda-python version (#16838) 2026-01-10 17:08:43 +08:00
Shangming Cai
4b14f622e1 [CI] Add PD Disaggregation aarch64 test (#16572) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-10 14:44:54 +08:00
Shangming Cai
0c4e155a3c chore: bump mooncake version to 0.3.8.post1 (#16792) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2026-01-09 18:42:27 +08:00
gongwei-130
65bed8382b Add google-cloud-storage into Dockerfile (#15343) 2026-01-07 16:54:45 -08:00
Thomas Wang
820e97d6c9 Upgrade aiter version (#16619) 2026-01-06 22:20:42 -08:00
Baizhou Zhang
6ffe1fc02f [Fix]Pin mooncake version to 0.3.7.post2 in grace blackwell (#16502) 2026-01-06 14:11:40 +08:00
Alison Shao
f8411ded6e ci: migrate 1-GPU model tests to test/registered/models/ (#16414) 2026-01-04 18:08:01 -08:00
Liangsheng Yin
229938805f Make personal configs optional in SGLang's official docker image. (#16365) 2026-01-04 12:27:13 +08:00
Kangyan-Zhou
9c4eb46099 Add a new branch cut GH workflow, and adopt setuptools-scm for version control (#15985) 2025-12-29 13:51:21 -08:00
Shangming Cai
41addd2e08 chore: bump mooncake version to 0.3.8 (#15886) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-12-27 23:34:24 +08:00
sglang-bot
34013d9d5a chore: bump sgl-kernel version to 0.3.20 (#15590) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-22 12:32:34 -08:00
Yuzhen Zhou
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760) 
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
 2025-12-19 15:38:46 +08:00
Yineng Zhang
0861dca81f Revert "[misc] Upgrade cutedsl to 4.3.1 (#14857)" (#15293) 2025-12-16 16:31:32 -08:00
Baizhou Zhang
0261c4aff7 [misc] Upgrade cutedsl to 4.3.1 (#14857) 2025-12-16 12:11:56 -08:00
sglang-bot
5c8bd8b51b chore: bump SGLang version to 0.5.6.post2 (#14858) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-11 12:29:52 -08:00
Binyao Jiang
ef3f8c97e1 Add ffmpeg into sglang docker - required by transformers multimodal V… (#14679) 2025-12-08 18:00:23 -08:00
Even Zhou
60d36e7be7 [NPU] chore: bump basic software version to 8.3.rc2 (#14614) 2025-12-09 09:14:27 +08:00
yctseng0211
763888b5a8 [AMD] change fused rms quant interface for aiter upgrade (#14497) 2025-12-08 09:09:23 -08:00
sglang-bot
9a327bdfcf chore: bump SGLang version to 0.5.6.post1 (#14651) 2025-12-09 00:35:28 +08:00
sglang-bot
2de98010b5 chore: bump sgl-kernel version to 0.3.19 (#14649) 2025-12-08 22:53:08 +08:00
Xiaoyu Zhang
e5135b73f4 Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544) 2025-12-07 15:29:41 +08:00
sglang-bot
d2b42477c7 chore: bump sgl-kernel version to 0.3.18.post3 (#14518) 2025-12-06 13:15:16 -08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00
ishandhanani
498ea41ca6 dockerfile: add runtime stage + ubuntu 24.04 (#13861) 2025-12-05 00:28:36 -08:00
Kay Yan
0e6441b434 fix: Correct environment variable syntax in docker-compose configuration (#8287) 
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
 2025-12-04 13:03:39 -08:00
fzyzcjy
e3ab23c1a6 Try to fix B200 DeepEP error (#14399) 2025-12-04 00:41:24 -08:00
Sulfur6-L8972
20aad5b5ab Single Batch Overlap for MoE Models (#9660) 
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
Co-authored-by: Zqy11 <841971412@qq.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: TianyuZhang1214 <tianyuzhang1214@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
 2025-12-03 10:07:42 -08:00
sglang-bot
7ae368efde chore: bump SGLang version to 0.5.6 (#14316) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-12-02 17:17:13 -08:00
sglang-bot
63b9300f00 chore: bump sgl-kernel version to 0.3.18.post2 (#14244) 2025-12-01 23:14:12 -08:00
Liangsheng Yin
427a19b643 Remove cargo config also in .zshenv (#14267) 2025-12-02 11:31:53 +08:00
Baizhou Zhang
03888b9de5 [Minor] Upgrade cutedsl version in Dockerfile (#13968) 2025-12-01 17:15:26 -08:00
Xiaoyu Zhang
9c80072845 Add peak output tokens per second in bench_serving (#14165) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-01 17:47:54 +08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Baizhou Zhang
051ad83347 [chore] Arrange NV packages in Dockerfile (#13749) 2025-11-27 18:08:27 -05:00
Mohammad Miadh Angkad
63b056213f Remove disused B300 Dockerfile (#13946) 2025-11-27 09:48:00 -05:00
Thomas Wang
5a8adca900 Turn off PREBUILD aiter in MI355 (#13963) 2025-11-25 22:30:39 -08:00
sglang-bot
c53e729d45 chore: bump sgl-kernel version to 0.3.18.post1 (#13951) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-11-25 18:14:28 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-25 14:47:34 -08:00
Liwansi
432ecf841e [Ascend] qwen optimization (#12078) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-11-25 19:44:24 +08:00
Baizhou Zhang
04b52fa8d6 [chore]Upgrade flashinfer to 0.5.3 (#13751) 2025-11-23 23:38:36 -08:00
fzyzcjy
45c572c58f Support torch 12.9 + DeepEP by removing custom nvshmem (#12949) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-21 11:11:43 -08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
Thomas Wang
7dcf910d53 Add support for new aiter version (AR accuracy, is_shuffled PR) (#13554) 
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
 2025-11-19 22:17:57 -08:00