Commit Graph

113 Commits

Author SHA1 Message Date
Yingchun Lai
b419e20c5b [Dockerfile] Speed up docker image building (#8784) 2025-11-04 20:26:18 -08:00
Shangming Cai
c2d4716da0 chore: bump mooncake version to 0.3.7.post2 (#12599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-04 01:09:31 -08:00
Shangming Cai
ab8b83f71d chore: upgrade mooncake 0.3.7.post1 (#12541)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-03 00:34:32 -08:00
sglang-bot
a920b9dace chore: bump sgl-kernel version to 0.3.16.post5 (#12511) 2025-11-02 14:08:11 +08:00
ybyang
756ad9ceb1 Reduce docker image size. mount cache when use pip/cargo build (#12238)
Signed-off-by: ybyang <ybyang7@iflytek.com>
2025-11-01 14:58:04 -07:00
Chang Su
ecb9fa14e6 [docker] clean up main dockerfile for router and dev configurations (#12364)
Co-authored-by: ybyang <ybyang7@iflytek.com>
2025-10-30 07:46:09 -07:00
Baizhou Zhang
621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
ishandhanani
285a8e6986 docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-27 22:00:54 -07:00
ishandhanani
cadfae666d fix broken deepep/flashmla install in container by adding --no-build-isolation (#12170) 2025-10-26 16:39:51 -07:00
sglang-bot
a04212f128 chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-10-24 22:04:14 -07:00
fzyzcjy
0f0c430e93 Install numactl in Dockerfile for GH200/GB200/GB300 (#11853) 2025-10-23 21:39:10 -07:00
nvjullin
9a71500cfb Fixed aarch64 flash-mla (#12009) 2025-10-23 17:47:04 -07:00
fzyzcjy
8612811d85 Bump grace blackwell DeepEP version (#11990) 2025-10-22 21:08:12 -07:00
Baizhou Zhang
ebff4ee648 Update sgl-kernel and remove fast hadamard depedency (#11844) 2025-10-21 13:13:54 -07:00
fzyzcjy
9e3be1fa2a Tiny bump DeepEP version in ARM blackwell (#11810) 2025-10-20 08:15:14 +08:00
kyleliang-nv
fda0cb2a30 Fix Dockerfile not installing correct version of DeepEP for arm build (#11773) 2025-10-18 15:06:05 -07:00
Yineng Zhang
86373b9e48 fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633) 2025-10-14 14:45:28 -07:00
Baizhou Zhang
8b85926a6e Remove tilelang dependency in Dockerfile (#11455) 2025-10-10 23:17:53 -07:00
gongwei-130
4aeb193fbd disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274) 2025-10-06 14:48:31 -07:00
Baizhou Zhang
292a867ad9 Add flashmla and fast hadamard transform to Dockerfile (#11235) 2025-10-05 21:31:28 -07:00
gongwei-130
0618ad6dd5 fix: shoudn't include CUDA_ARCH 100 and 120 for cuda12.6.1 (#11176) 2025-10-02 13:24:23 -07:00
ishandhanani
47488cc353 docker: x86 dev builds for hopper and blackwell (#11075) 2025-10-01 00:06:38 -07:00
ishandhanani
adba172fd1 ci: free space on workers for build (#10786)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-09-24 02:58:22 -07:00
ishandhanani
1c82d9db28 feat: unify dockerfiles (#10705)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-09-22 23:23:48 -07:00
Shangming Cai
74cd6e3902 chore: upgrade mooncake 0.3.6.post1 to fix gb200 dockerfile (#10681)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-09-20 00:12:26 -07:00
Baizhou Zhang
3fa3c22ae2 Fix fast decode plan for flashinfer v0.4.0rc1 and upgrade sgl-kernel 0.3.11 (#10634)
Co-authored-by: zhyncs <me@zhyncs.com>
2025-09-19 01:25:29 -07:00
Yi Zhang
e07b21ceaf update deepep version for qwen3-next deepep moe (#10624) 2025-09-18 11:35:22 -07:00
Shangming Cai
60fc5b51f6 chore: upgrade mooncake 0.3.6 (#10596)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-09-18 00:19:30 -07:00
Yineng Zhang
c0c6f543e4 chore: upgrade sgl-kernel 0.3.10 (#10500) 2025-09-16 02:00:53 -07:00
Yineng Zhang
b0d25e72c4 chore: bump v0.5.2 (#10221) 2025-09-11 16:09:20 -07:00
Yineng Zhang
bfe01a5eef chore: upgrade v0.3.9.post2 sgl-kernel (#10297) 2025-09-11 04:10:29 -07:00
Lianmin Zheng
bcf1955f7e Revert "chore: upgrade v0.3.9 sgl-kernel" (#10245) 2025-09-09 19:05:20 -07:00
Yineng Zhang
d3ee70985f chore: upgrade v0.3.9 sgl-kernel (#10220) 2025-09-09 03:16:25 -07:00
Liangsheng Yin
6e95f5e5bd Simplify Router arguments passing and build it in docker image (#9964) 2025-09-05 12:13:55 +08:00
JieXin Liang
1db649ac02 [feat] apply deep_gemm compile_mode to skip launch (#9879) 2025-09-02 03:20:30 -07:00
Yineng Zhang
9970e3bf32 chore: upgrade sgl-kernel 0.3.7.post1 with deepgemm fix (#9822) 2025-08-30 04:02:25 -07:00
Yineng Zhang
9c99949ef3 chore: update Dockerfile (#9820) 2025-08-30 03:08:14 -07:00
Yineng Zhang
bc80dc4ce0 chore: bump v0.5.1.post3 (#9716) 2025-08-27 15:42:42 -07:00
fzyzcjy
44ffe2cb72 Install py-spy by default for containers for easier debugging (#9649) 2025-08-26 10:40:52 -07:00
Yineng Zhang
bf863e3bbf fix: use sgl-kernel 0.3.5 (#9565) 2025-08-24 15:46:47 -07:00
gongwei-130
fb107cfd75 feat: allow use local branch to build image (#9546) 2025-08-23 16:38:30 -07:00
Yineng Zhang
b6b2287e4b chore: bump sgl-kernel v0.3.6.post2 (#9475) 2025-08-21 23:02:08 -07:00
Yineng Zhang
a1c7f742f9 chore: bump sgl-kernel v0.3.6.post1 (#9286) 2025-08-17 16:26:17 -07:00
Yineng Zhang
87dab54824 Revert "chore: bump sgl-kernel v0.3.6 (#9220)" (#9247) 2025-08-15 17:24:36 -07:00
Yineng Zhang
c186feed7f chore: bump sgl-kernel v0.3.6 (#9220) 2025-08-15 02:50:50 -07:00
fzyzcjy
f8644a5632 Tiny update tmux history limit on dev container (#9218) 2025-08-15 00:22:08 -07:00
fzyzcjy
392de007cb Minor fix docker container DeepEP on multi platforms (#9205) 2025-08-14 17:41:49 -07:00
Yineng Zhang
1fea998a45 chore: bump sgl-kernel v0.3.5 (#9185) 2025-08-14 03:20:48 -07:00
fzyzcjy
b3363cc1aa Fix docker container DeepEP error on Blackwell (#9171) 2025-08-13 21:06:48 -07:00
Yineng Zhang
71fb8c9527 feat: update fa3 (#9126) 2025-08-13 20:07:08 +08:00