chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity
6,884 Commits 1 Branch 0 Tags
4a56fa5cf2e2efb7eb4e6fd730bf581b39be21fa
Commit Graph

321 Commits

Author SHA1 Message Date
Kshiteej K
b5904999c0 docker: Fix apt-add-repository (#13213) 2025-11-13 18:41:29 -08:00
Hubert Lu
2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) 2025-11-13 17:03:41 -08:00
Edmund Suen
909d0d382f docker: fix build error in Dockerfile.diffusion (#12975) 2025-11-13 09:58:16 +08:00
sglang-bot
ebaf86d441 chore: bump SGLang version to 0.5.5.post2 (#13129) 
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
 2025-11-12 20:35:20 +08:00
sogalin
d26ec39ff2 Update aiter to v0.1.7.post1 (#13149) 2025-11-12 03:09:44 -08:00
Hubert Lu
36d147121f [AMD] Apply AITER_MXFP4_MOE_SF=1 only to gfx950 in aiter build (#13092) 2025-11-11 12:26:09 -08:00
Johnsonms
63728b1154 [Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941) 2025-11-12 00:52:02 +08:00
sglang-bot
303cc957e6 chore: bump SGLang version to 0.5.5.post1 (#13000) 2025-11-10 11:53:43 -08:00
sogalin
661c1c97ad Add pre-suffle weight for new aiter MoE support. (#12908) 
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
 2025-11-10 11:42:55 -08:00
sglang-bot
37c40a87a8 chore: bump sgl-kernel version to 0.3.17 (#12966) 2025-11-10 21:50:58 +08:00
kk
90401cf7d2 Fix the run-time error when calling fused_rms_mxfp4_quant that change return output number (#12803) 
Co-authored-by: wunhuang <wunhuang@amd.com>
 2025-11-09 21:48:36 -08:00
b8zhong
55e8e3999c add back flashinfer jit cache to dev docker (#12851) 
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
 2025-11-07 14:51:24 -08:00
gaopengff
4e234b4cf9 [Intel XPU]Update pytorch xpu to 2.9 (#12363) 2025-11-06 10:34:23 -08:00
sglang-bot
0c006b8809 chore: bump SGLang version to 0.5.5 (#12739) 2025-11-07 00:46:19 +08:00
Baizhou Zhang
bb6a21cd99 [Fix]Tiny fix in Dockerfile (#12748) 2025-11-05 21:04:33 -08:00
Baizhou Zhang
3c0a6df82d [chore] Fix triton installation for cu13 image (#12742) 2025-11-05 20:20:18 -08:00
Baizhou Zhang
9a954982de [chore] SGLang tag management in Dockerfile (#12734) 2025-11-05 19:03:26 -08:00
Zaili Wang
cf5d27e30a [CPU] Upgrade default PT version to 2.9 (#12611) 2025-11-05 18:16:35 -08:00
Mick
7bc1dae095 WIP: initial multimodal-gen support (#12484) 
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: JiLi <leege233@gmail.com>
Co-authored-by: CHEN Xi <78632976+RubiaCx@users.noreply.github.com>
Co-authored-by: laixin <xielx@shanghaitech.edu.cn>
Co-authored-by: SolitaryThinker <wlsaidhi@gmail.com>
Co-authored-by: jzhang38 <a1286225768@gmail.com>
Co-authored-by: BrianChen1129 <yongqichcd@gmail.com>
Co-authored-by: Kevin Lin <42618777+kevin314@users.noreply.github.com>
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: rlsu9 <r3su@ucsd.edu>
Co-authored-by: Jinzhe Pan <48981407+eigensystem@users.noreply.github.com>
Co-authored-by: foreverpiano <pianoqwz@qq.com>
Co-authored-by: RandNMR73 <notomatthew31@gmail.com>
Co-authored-by: PorridgeSwim <yz3883@columbia.edu>
Co-authored-by: Jiali Chen <90408393+gary-chenjl@users.noreply.github.com>
 2025-11-05 12:28:52 -08:00
Yingchun Lai
b419e20c5b [Dockerfile] Speed up docker image building (#8784) 2025-11-04 20:26:18 -08:00
sglang-bot
09938e1f82 chore: bump SGLang version to 0.5.4.post3 (#12639) 2025-11-04 18:32:11 -08:00
Shangming Cai
c2d4716da0 chore: bump mooncake version to 0.3.7.post2 (#12599) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-11-04 01:09:31 -08:00
R0CKSTAR
d36639eec7 [ROCm] Update Mooncake to v0.3.7.post1 and add -DUSE_HIP=ON to rocm.Dockerfile (#12560) 
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
 2025-11-03 11:33:30 -08:00
Shangming Cai
ab8b83f71d chore: upgrade mooncake 0.3.7.post1 (#12541) 
Signed-off-by: Shangming Cai <csmthu@gmail.com>
 2025-11-03 00:34:32 -08:00
sglang-bot
a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) 2025-11-02 14:08:11 +08:00
ybyang
756ad9ceb1 Reduce docker image size. mount cache when use pip/cargo build (#12238) 
Signed-off-by: ybyang <ybyang7@iflytek.com>
 2025-11-01 14:58:04 -07:00
sglang-bot
41c10e67fc chore: bump SGLang version to 0.5.4.post2 (#12439) 2025-10-31 17:38:50 -07:00
Chang Su
ecb9fa14e6 [docker] clean up main dockerfile for router and dev configurations (#12364) 
Co-authored-by: ybyang <ybyang7@iflytek.com>
 2025-10-30 07:46:09 -07:00
Baizhou Zhang
621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
Chang Su
db15148c8a [router] update router docker to use maturin and build from local (#12350) 2025-10-29 13:00:57 -07:00
sogalin
0da9845ef1 Modify rocm.Dockerfile (#12274) 2025-10-28 08:36:32 -07:00
ishandhanani
285a8e6986 docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517) 
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
 2025-10-27 22:00:54 -07:00
sglang-bot
55d75e11bd chore: bump SGLang version to 0.5.4.post1 (#12169) 2025-10-27 09:35:20 +08:00
ishandhanani
cadfae666d fix broken deepep/flashmla install in container by adding --no-build-isolation (#12170) 2025-10-26 16:39:51 -07:00
Simo Lin
22cbc9c086 [bugs] docker file name should be <name>.Dockerfile so it can properly render (#11869) 2025-10-25 08:34:43 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-24 22:04:14 -07:00
fzyzcjy
0f0c430e93 Install numactl in Dockerfile for GH200/GB200/GB300 (#11853) 2025-10-23 21:39:10 -07:00
sglang-bot
1053e1be17 chore: bump SGLang version to 0.5.4 (#12027) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-23 18:01:40 -07:00
nvjullin
9a71500cfb Fixed aarch64 flash-mla (#12009) 2025-10-23 17:47:04 -07:00
HAI
65d376b491 aiter update to v0.1.6.post1 (#12004) 2025-10-22 23:53:05 -07:00
fzyzcjy
8612811d85 Bump grace blackwell DeepEP version (#11990) 2025-10-22 21:08:12 -07:00
Baizhou Zhang
ebff4ee648 Update sgl-kernel and remove fast hadamard depedency (#11844) 2025-10-21 13:13:54 -07:00
Meng, Hengyu
b113c72e7a Init attention backend for Intel XPU (#10656) 
Co-authored-by: guangyey <guangye.yu@intel.com>
Co-authored-by: DiweiSun <105627594+DiweiSun@users.noreply.github.com>
 2025-10-21 11:41:28 +08:00
fzyzcjy
9e3be1fa2a Tiny bump DeepEP version in ARM blackwell (#11810) 2025-10-20 08:15:14 +08:00
kyleliang-nv
fda0cb2a30 Fix Dockerfile not installing correct version of DeepEP for arm build (#11773) 2025-10-18 15:06:05 -07:00
sglang-bot
85ebeecf06 chore: bump SGLang version to 0.5.3.post3 (#11693) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-16 13:14:55 -07:00
Even Zhou
3cceaa381a [Bugfix] Fix Qwen3/DSV3/DSV3.2 model support (#11510) 2025-10-16 15:14:09 +08:00
DiweiSun
4c03dbaaef [CI][XPU]enable sglang CI on Intel XPU (#9493) 
Co-authored-by: huaiyuzh <huaiyu.zheng@intel.com>
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
 2025-10-15 17:13:19 -07:00
sglang-bot
baf277a9bf chore: bump SGLang version to 0.5.3.post2 (#11680) 
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
 2025-10-15 16:49:14 -07:00
Yineng Zhang
86373b9e48 fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633) 2025-10-14 14:45:28 -07:00