Xiaoyu Zhang
|
9c80072845
|
Add peak output tokens per second in bench_serving (#14165)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-12-01 17:47:54 +08:00 |
|
Baizhou Zhang
|
051ad83347
|
[chore] Arrange NV packages in Dockerfile (#13749)
|
2025-11-27 18:08:27 -05:00 |
|
sglang-bot
|
c53e729d45
|
chore: bump sgl-kernel version to 0.3.18.post1 (#13951)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-11-25 18:14:28 -08:00 |
|
Fan Yin
|
36b1bcd242
|
[chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-25 14:47:34 -08:00 |
|
Baizhou Zhang
|
04b52fa8d6
|
[chore]Upgrade flashinfer to 0.5.3 (#13751)
|
2025-11-23 23:38:36 -08:00 |
|
fzyzcjy
|
45c572c58f
|
Support torch 12.9 + DeepEP by removing custom nvshmem (#12949)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-21 11:11:43 -08:00 |
|
sglang-bot
|
bfaf0b8607
|
chore: bump sgl-kernel version to 0.3.17.post2 (#13570)
|
2025-11-19 14:02:57 -08:00 |
|
Chang Su
|
b8e32e7965
|
[model-gateway] fix gateway docker build due to recent py code change (#13532)
|
2025-11-18 11:24:25 -08:00 |
|
sglang-bot
|
7b2fb3d47c
|
chore: bump SGLang version to 0.5.5.post3 (#13366)
|
2025-11-16 17:55:38 -08:00 |
|
b8zhong
|
d5fa58c4dd
|
fix nightly docker build (#13386)
|
2025-11-16 11:21:09 -08:00 |
|
sglang-bot
|
1ca205f6da
|
chore: bump sgl-kernel version to 0.3.17.post1 (#13358)
|
2025-11-15 19:11:41 -08:00 |
|
Kshiteej K
|
b5904999c0
|
docker: Fix apt-add-repository (#13213)
|
2025-11-13 18:41:29 -08:00 |
|
sglang-bot
|
ebaf86d441
|
chore: bump SGLang version to 0.5.5.post2 (#13129)
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
|
2025-11-12 20:35:20 +08:00 |
|
Johnsonms
|
63728b1154
|
[Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941)
|
2025-11-12 00:52:02 +08:00 |
|
sglang-bot
|
303cc957e6
|
chore: bump SGLang version to 0.5.5.post1 (#13000)
|
2025-11-10 11:53:43 -08:00 |
|
sglang-bot
|
37c40a87a8
|
chore: bump sgl-kernel version to 0.3.17 (#12966)
|
2025-11-10 21:50:58 +08:00 |
|
b8zhong
|
55e8e3999c
|
add back flashinfer jit cache to dev docker (#12851)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-11-07 14:51:24 -08:00 |
|
sglang-bot
|
0c006b8809
|
chore: bump SGLang version to 0.5.5 (#12739)
|
2025-11-07 00:46:19 +08:00 |
|
Baizhou Zhang
|
bb6a21cd99
|
[Fix]Tiny fix in Dockerfile (#12748)
|
2025-11-05 21:04:33 -08:00 |
|
Baizhou Zhang
|
3c0a6df82d
|
[chore] Fix triton installation for cu13 image (#12742)
|
2025-11-05 20:20:18 -08:00 |
|
Baizhou Zhang
|
9a954982de
|
[chore] SGLang tag management in Dockerfile (#12734)
|
2025-11-05 19:03:26 -08:00 |
|
Yingchun Lai
|
b419e20c5b
|
[Dockerfile] Speed up docker image building (#8784)
|
2025-11-04 20:26:18 -08:00 |
|
Shangming Cai
|
c2d4716da0
|
chore: bump mooncake version to 0.3.7.post2 (#12599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-04 01:09:31 -08:00 |
|
Shangming Cai
|
ab8b83f71d
|
chore: upgrade mooncake 0.3.7.post1 (#12541)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-03 00:34:32 -08:00 |
|
sglang-bot
|
a920b9dace
|
chore: bump sgl-kernel version to 0.3.16.post5 (#12511)
|
2025-11-02 14:08:11 +08:00 |
|
ybyang
|
756ad9ceb1
|
Reduce docker image size. mount cache when use pip/cargo build (#12238)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-11-01 14:58:04 -07:00 |
|
Chang Su
|
ecb9fa14e6
|
[docker] clean up main dockerfile for router and dev configurations (#12364)
Co-authored-by: ybyang <ybyang7@iflytek.com>
|
2025-10-30 07:46:09 -07:00 |
|
Baizhou Zhang
|
621dfb8886
|
Import flash_mla from sgl-kernel (#12135)
|
2025-10-29 23:54:21 -07:00 |
|
ishandhanani
|
285a8e6986
|
docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-27 22:00:54 -07:00 |
|
ishandhanani
|
cadfae666d
|
fix broken deepep/flashmla install in container by adding --no-build-isolation (#12170)
|
2025-10-26 16:39:51 -07:00 |
|
sglang-bot
|
a04212f128
|
chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-24 22:04:14 -07:00 |
|
fzyzcjy
|
0f0c430e93
|
Install numactl in Dockerfile for GH200/GB200/GB300 (#11853)
|
2025-10-23 21:39:10 -07:00 |
|
nvjullin
|
9a71500cfb
|
Fixed aarch64 flash-mla (#12009)
|
2025-10-23 17:47:04 -07:00 |
|
fzyzcjy
|
8612811d85
|
Bump grace blackwell DeepEP version (#11990)
|
2025-10-22 21:08:12 -07:00 |
|
Baizhou Zhang
|
ebff4ee648
|
Update sgl-kernel and remove fast hadamard depedency (#11844)
|
2025-10-21 13:13:54 -07:00 |
|
fzyzcjy
|
9e3be1fa2a
|
Tiny bump DeepEP version in ARM blackwell (#11810)
|
2025-10-20 08:15:14 +08:00 |
|
kyleliang-nv
|
fda0cb2a30
|
Fix Dockerfile not installing correct version of DeepEP for arm build (#11773)
|
2025-10-18 15:06:05 -07:00 |
|
Yineng Zhang
|
86373b9e48
|
fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633)
|
2025-10-14 14:45:28 -07:00 |
|
Baizhou Zhang
|
8b85926a6e
|
Remove tilelang dependency in Dockerfile (#11455)
|
2025-10-10 23:17:53 -07:00 |
|
gongwei-130
|
4aeb193fbd
|
disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274)
|
2025-10-06 14:48:31 -07:00 |
|
Baizhou Zhang
|
292a867ad9
|
Add flashmla and fast hadamard transform to Dockerfile (#11235)
|
2025-10-05 21:31:28 -07:00 |
|
gongwei-130
|
0618ad6dd5
|
fix: shoudn't include CUDA_ARCH 100 and 120 for cuda12.6.1 (#11176)
|
2025-10-02 13:24:23 -07:00 |
|
ishandhanani
|
47488cc353
|
docker: x86 dev builds for hopper and blackwell (#11075)
|
2025-10-01 00:06:38 -07:00 |
|
ishandhanani
|
adba172fd1
|
ci: free space on workers for build (#10786)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-09-24 02:58:22 -07:00 |
|
ishandhanani
|
1c82d9db28
|
feat: unify dockerfiles (#10705)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-09-22 23:23:48 -07:00 |
|
Shangming Cai
|
74cd6e3902
|
chore: upgrade mooncake 0.3.6.post1 to fix gb200 dockerfile (#10681)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-20 00:12:26 -07:00 |
|
Baizhou Zhang
|
3fa3c22ae2
|
Fix fast decode plan for flashinfer v0.4.0rc1 and upgrade sgl-kernel 0.3.11 (#10634)
Co-authored-by: zhyncs <me@zhyncs.com>
|
2025-09-19 01:25:29 -07:00 |
|
Yi Zhang
|
e07b21ceaf
|
update deepep version for qwen3-next deepep moe (#10624)
|
2025-09-18 11:35:22 -07:00 |
|
Shangming Cai
|
60fc5b51f6
|
chore: upgrade mooncake 0.3.6 (#10596)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 00:19:30 -07:00 |
|
Yineng Zhang
|
c0c6f543e4
|
chore: upgrade sgl-kernel 0.3.10 (#10500)
|
2025-09-16 02:00:53 -07:00 |
|