Xiaoyu Zhang
|
e5135b73f4
|
Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544)
|
2025-12-07 15:29:41 +08:00 |
|
sglang-bot
|
d2b42477c7
|
chore: bump sgl-kernel version to 0.3.18.post3 (#14518)
|
2025-12-06 13:15:16 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|
ishandhanani
|
498ea41ca6
|
dockerfile: add runtime stage + ubuntu 24.04 (#13861)
|
2025-12-05 00:28:36 -08:00 |
|
fzyzcjy
|
e3ab23c1a6
|
Try to fix B200 DeepEP error (#14399)
|
2025-12-04 00:41:24 -08:00 |
|
Sulfur6-L8972
|
20aad5b5ab
|
Single Batch Overlap for MoE Models (#9660)
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
Co-authored-by: Zqy11 <841971412@qq.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: TianyuZhang1214 <tianyuzhang1214@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-12-03 10:07:42 -08:00 |
|
sglang-bot
|
7ae368efde
|
chore: bump SGLang version to 0.5.6 (#14316)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-12-02 17:17:13 -08:00 |
|
sglang-bot
|
63b9300f00
|
chore: bump sgl-kernel version to 0.3.18.post2 (#14244)
|
2025-12-01 23:14:12 -08:00 |
|
Liangsheng Yin
|
427a19b643
|
Remove cargo config also in .zshenv (#14267)
|
2025-12-02 11:31:53 +08:00 |
|
Baizhou Zhang
|
03888b9de5
|
[Minor] Upgrade cutedsl version in Dockerfile (#13968)
|
2025-12-01 17:15:26 -08:00 |
|
Xiaoyu Zhang
|
9c80072845
|
Add peak output tokens per second in bench_serving (#14165)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-12-01 17:47:54 +08:00 |
|
Baizhou Zhang
|
051ad83347
|
[chore] Arrange NV packages in Dockerfile (#13749)
|
2025-11-27 18:08:27 -05:00 |
|
sglang-bot
|
c53e729d45
|
chore: bump sgl-kernel version to 0.3.18.post1 (#13951)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-11-25 18:14:28 -08:00 |
|
Fan Yin
|
36b1bcd242
|
[chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-25 14:47:34 -08:00 |
|
Baizhou Zhang
|
04b52fa8d6
|
[chore]Upgrade flashinfer to 0.5.3 (#13751)
|
2025-11-23 23:38:36 -08:00 |
|
fzyzcjy
|
45c572c58f
|
Support torch 12.9 + DeepEP by removing custom nvshmem (#12949)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-11-21 11:11:43 -08:00 |
|
sglang-bot
|
bfaf0b8607
|
chore: bump sgl-kernel version to 0.3.17.post2 (#13570)
|
2025-11-19 14:02:57 -08:00 |
|
Chang Su
|
b8e32e7965
|
[model-gateway] fix gateway docker build due to recent py code change (#13532)
|
2025-11-18 11:24:25 -08:00 |
|
sglang-bot
|
7b2fb3d47c
|
chore: bump SGLang version to 0.5.5.post3 (#13366)
|
2025-11-16 17:55:38 -08:00 |
|
b8zhong
|
d5fa58c4dd
|
fix nightly docker build (#13386)
|
2025-11-16 11:21:09 -08:00 |
|
sglang-bot
|
1ca205f6da
|
chore: bump sgl-kernel version to 0.3.17.post1 (#13358)
|
2025-11-15 19:11:41 -08:00 |
|
Kshiteej K
|
b5904999c0
|
docker: Fix apt-add-repository (#13213)
|
2025-11-13 18:41:29 -08:00 |
|
sglang-bot
|
ebaf86d441
|
chore: bump SGLang version to 0.5.5.post2 (#13129)
Include the critical fix https://github.com/sgl-project/sglang/pull/12915.
|
2025-11-12 20:35:20 +08:00 |
|
Johnsonms
|
63728b1154
|
[Bug] Login shell error: bash: /root/.cargo/env: No such file or directory (#12941)
|
2025-11-12 00:52:02 +08:00 |
|
sglang-bot
|
303cc957e6
|
chore: bump SGLang version to 0.5.5.post1 (#13000)
|
2025-11-10 11:53:43 -08:00 |
|
sglang-bot
|
37c40a87a8
|
chore: bump sgl-kernel version to 0.3.17 (#12966)
|
2025-11-10 21:50:58 +08:00 |
|
b8zhong
|
55e8e3999c
|
add back flashinfer jit cache to dev docker (#12851)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-11-07 14:51:24 -08:00 |
|
sglang-bot
|
0c006b8809
|
chore: bump SGLang version to 0.5.5 (#12739)
|
2025-11-07 00:46:19 +08:00 |
|
Baizhou Zhang
|
bb6a21cd99
|
[Fix]Tiny fix in Dockerfile (#12748)
|
2025-11-05 21:04:33 -08:00 |
|
Baizhou Zhang
|
3c0a6df82d
|
[chore] Fix triton installation for cu13 image (#12742)
|
2025-11-05 20:20:18 -08:00 |
|
Baizhou Zhang
|
9a954982de
|
[chore] SGLang tag management in Dockerfile (#12734)
|
2025-11-05 19:03:26 -08:00 |
|
Yingchun Lai
|
b419e20c5b
|
[Dockerfile] Speed up docker image building (#8784)
|
2025-11-04 20:26:18 -08:00 |
|
Shangming Cai
|
c2d4716da0
|
chore: bump mooncake version to 0.3.7.post2 (#12599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-04 01:09:31 -08:00 |
|
Shangming Cai
|
ab8b83f71d
|
chore: upgrade mooncake 0.3.7.post1 (#12541)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-11-03 00:34:32 -08:00 |
|
sglang-bot
|
a920b9dace
|
chore: bump sgl-kernel version to 0.3.16.post5 (#12511)
|
2025-11-02 14:08:11 +08:00 |
|
ybyang
|
756ad9ceb1
|
Reduce docker image size. mount cache when use pip/cargo build (#12238)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-11-01 14:58:04 -07:00 |
|
Chang Su
|
ecb9fa14e6
|
[docker] clean up main dockerfile for router and dev configurations (#12364)
Co-authored-by: ybyang <ybyang7@iflytek.com>
|
2025-10-30 07:46:09 -07:00 |
|
Baizhou Zhang
|
621dfb8886
|
Import flash_mla from sgl-kernel (#12135)
|
2025-10-29 23:54:21 -07:00 |
|
ishandhanani
|
285a8e6986
|
docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-10-27 22:00:54 -07:00 |
|
ishandhanani
|
cadfae666d
|
fix broken deepep/flashmla install in container by adding --no-build-isolation (#12170)
|
2025-10-26 16:39:51 -07:00 |
|
sglang-bot
|
a04212f128
|
chore: bump sgl-kernel version to 0.3.16.post4 (#12103)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-24 22:04:14 -07:00 |
|
fzyzcjy
|
0f0c430e93
|
Install numactl in Dockerfile for GH200/GB200/GB300 (#11853)
|
2025-10-23 21:39:10 -07:00 |
|
nvjullin
|
9a71500cfb
|
Fixed aarch64 flash-mla (#12009)
|
2025-10-23 17:47:04 -07:00 |
|
fzyzcjy
|
8612811d85
|
Bump grace blackwell DeepEP version (#11990)
|
2025-10-22 21:08:12 -07:00 |
|
Baizhou Zhang
|
ebff4ee648
|
Update sgl-kernel and remove fast hadamard depedency (#11844)
|
2025-10-21 13:13:54 -07:00 |
|
fzyzcjy
|
9e3be1fa2a
|
Tiny bump DeepEP version in ARM blackwell (#11810)
|
2025-10-20 08:15:14 +08:00 |
|
kyleliang-nv
|
fda0cb2a30
|
Fix Dockerfile not installing correct version of DeepEP for arm build (#11773)
|
2025-10-18 15:06:05 -07:00 |
|
Yineng Zhang
|
86373b9e48
|
fix: Update SGL_KERNEL_VERSION to 0.3.15 (#11633)
|
2025-10-14 14:45:28 -07:00 |
|
Baizhou Zhang
|
8b85926a6e
|
Remove tilelang dependency in Dockerfile (#11455)
|
2025-10-10 23:17:53 -07:00 |
|
gongwei-130
|
4aeb193fbd
|
disable sm100 for FlashMLA and fast-hadamard-transform in cuda12.6.1 (#11274)
|
2025-10-06 14:48:31 -07:00 |
|