chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
7,361 Commits 1 Branch 0 Tags
1f2b84d28d639ba251f8f4c7b6ce94dea78e6605
Commit Graph

343 Commits

Author SHA1 Message Date
Xiaoyu Zhang
9c80072845 Add peak output tokens per second in bench_serving (#14165) 
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
 2025-12-01 17:47:54 +08:00
Zaili Wang
0b0b2607ca [CPU] Apply uv as package manager (#14106) 2025-11-28 10:36:53 -08:00
Baizhou Zhang
051ad83347 [chore] Arrange NV packages in Dockerfile (#13749) 2025-11-27 18:08:27 -05:00
Mohammad Miadh Angkad
63b056213f Remove disused B300 Dockerfile (#13946) 2025-11-27 09:48:00 -05:00
Thomas Wang
5a8adca900 Turn off PREBUILD aiter in MI355 (#13963) 2025-11-25 22:30:39 -08:00
sglang-bot
c53e729d45 chore: bump sgl-kernel version to 0.3.18.post1 (#13951) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-11-25 18:14:28 -08:00
Fan Yin
36b1bcd242 [chore] update torch version to 2.9 (#12969) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-25 14:47:34 -08:00
Liwansi
432ecf841e [Ascend] qwen optimization (#12078) 
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
 2025-11-25 19:44:24 +08:00
Baizhou Zhang
04b52fa8d6 [chore]Upgrade flashinfer to 0.5.3 (#13751) 2025-11-23 23:38:36 -08:00
fzyzcjy
45c572c58f Support torch 12.9 + DeepEP by removing custom nvshmem (#12949) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-11-21 11:11:43 -08:00
Even Zhou
589d9ad55b [NPU] chore: bump to CANN 8.3.RC1 and Pytorch 2.8.0 (#13647) 2025-11-21 17:07:08 +08:00
Thomas Wang
7dcf910d53 Add support for new aiter version (AR accuracy, is_shuffled PR) (#13554) 
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
 2025-11-19 22:17:57 -08:00
sglang-bot
bfaf0b8607 chore: bump sgl-kernel version to 0.3.17.post2 (#13570) 2025-11-19 14:02:57 -08:00
Even Zhou
d4a4dcdfb3 [NPU] Adapt pr-gate for pr-test workflow & workflows refresh (#13567) 2025-11-19 21:55:17 +08:00
Simo Lin
6b9459e86c [docker] fix dockerfile naming for diffusion (#13534) 2025-11-18 12:18:32 -08:00
Chang Su
3a6ec47b0b [model-gateway] limit opened files in docker build to fix edge case (#13536) 2025-11-18 12:17:38 -08:00
Chang Su
b8e32e7965 [model-gateway] fix gateway docker build due to recent py code change (#13532) 2025-11-18 11:24:25 -08:00
Sai Enduri
fe3bbfb40c [AMD CI] Update sgl-router python path in dockerfile. (#13458) 2025-11-17 18:13:24 -08:00
Sirut Buasai
a63f433b6f extend sagemaker.Dockerfile serve script to allow all sglang serve flags (#13173) 2025-11-17 13:14:17 -08:00
sglang-bot
7b2fb3d47c chore: bump SGLang version to 0.5.5.post3 (#13366) 2025-11-16 17:55:38 -08:00
b8zhong
d5fa58c4dd fix nightly docker build (#13386) 2025-11-16 11:21:09 -08:00
sglang-bot
1ca205f6da chore: bump sgl-kernel version to 0.3.17.post1 (#13358) 2025-11-15 19:11:41 -08:00
Kshiteej K
b5904999c0 docker: Fix apt-add-repository (#13213) 2025-11-13 18:41:29 -08:00
Hubert Lu
2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) 2025-11-13 17:03:41 -08:00
Edmund Suen
909d0d382f docker: fix build error in Dockerfile.diffusion (#12975) 2025-11-13 09:58:16 +08:00
sglang-bot
ebaf86d441 chore: bump SGLang version to 0.5.5.post2 (#13129) 
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
 2025-11-12 20:35:20 +08:00
sogalin
d26ec39ff2 Update aiter to v0.1.7.post1 (#13149) 2025-11-12 03:09:44 -08:00
Hubert Lu
36d147121f [AMD] Apply AITER_MXFP4_MOE_SF=1 only to gfx950 in aiter build (#13092) 2025-11-11 12:26:09 -08:00
Johnsonms
63728b1154 [Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941) 2025-11-12 00:52:02 +08:00
sglang-bot
303cc957e6 chore: bump SGLang version to 0.5.5.post1 (#13000) 2025-11-10 11:53:43 -08:00
sogalin
661c1c97ad Add pre-suffle weight for new aiter MoE support. (#12908) 
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
 2025-11-10 11:42:55 -08:00
sglang-bot
37c40a87a8 chore: bump sgl-kernel version to 0.3.17 (#12966) 2025-11-10 21:50:58 +08:00
kk
90401cf7d2 Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2025-11-09 21:48:36 -08:00
b8zhong
55e8e3999c add back flashinfer jit cache to dev docker (#12851) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-11-07 14:51:24 -08:00
gaopengff
4e234b4cf9 [Intel XPU]Update pytorch xpu to 2.9 (#12363) 2025-11-06 10:34:23 -08:00
sglang-bot
0c006b8809 chore: bump SGLang version to 0.5.5 (#12739) 2025-11-07 00:46:19 +08:00
Baizhou Zhang
bb6a21cd99 [Fix]Tiny fix in Dockerfile (#12748) 2025-11-05 21:04:33 -08:00
Baizhou Zhang
3c0a6df82d [chore] Fix triton installation for cu13 image (#12742) 2025-11-05 20:20:18 -08:00
Baizhou Zhang
9a954982de [chore] SGLang tag management in Dockerfile (#12734) 2025-11-05 19:03:26 -08:00
Zaili Wang
cf5d27e30a [CPU] Upgrade default PT version to 2.9 (#12611) 2025-11-05 18:16:35 -08:00
Mick
7bc1dae095 WIP: initial multimodal-gen support (#12484) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
 2025-11-05 12:28:52 -08:00
Yingchun Lai
b419e20c5b [Dockerfile] Speed up docker image building (#8784) 2025-11-04 20:26:18 -08:00
sglang-bot
09938e1f82 chore: bump SGLang version to 0.5.4.post3 (#12639) 2025-11-04 18:32:11 -08:00
Shangming Cai
c2d4716da0 chore: bump mooncake version to 0.3.7.post2 (#12599) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-11-04 01:09:31 -08:00
R0CKSTAR
d36639eec7 [ROCm] Update Mooncake to v0.3.7.post1 and add -DUSE_HIP=ON to rocm.Dockerfile (#12560) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-11-03 11:33:30 -08:00
Shangming Cai
ab8b83f71d chore: upgrade mooncake 0.3.7.post1 (#12541) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-11-03 00:34:32 -08:00
sglang-bot
a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) 2025-11-02 14:08:11 +08:00
ybyang
756ad9ceb1 Reduce docker image size. mount cache when use pip/cargo build (#12238) 
Signed-off-by: ybyang <ybyang7@iflytek.com>
 2025-11-01 14:58:04 -07:00
sglang-bot
41c10e67fc chore: bump SGLang version to 0.5.4.post2 (#12439) 2025-10-31 17:38:50 -07:00
Chang Su
ecb9fa14e6 [docker] clean up main dockerfile for router and dev configurations (#12364) 
Co-authored-by: ybyang <ybyang7@iflytek.com>
 2025-10-30 07:46:09 -07:00