Commit Graph
61 Commits
Author SHA1 Message Date
Alison Shao b880607108 Add 5090 dry run stage to PR test workflow (#17022) 2026-01-13 14:12:33 -08:00
Shangming Cai 0c4e155a3c chore: bump mooncake version to 0.3.8.post1 (#16792)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-01-09 18:42:27 +08:00
Prozac614 f253f43c9d [diffusion] CI: fix LoRA downloading issues and respect offline flag (#15813) 2025-12-30 11:39:27 +08:00
Shangming Cai 41addd2e08 chore: bump mooncake version to 0.3.8 (#15886)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-12-27 23:34:24 +08:00
Lianmin Zheng 9d64a7b24f Minor style fixes to the scheduler.py (#15218) 2025-12-16 17:09:44 -08:00
Kangyan-Zhou e7157c9b77 Add cache for flashinfer installation (#15153) 2025-12-15 10:37:34 -08:00
gongwei-130 94e1251131 enable flashinfer-jit-cache in image build and ci install to speed up model launch (#14959) 2025-12-11 23:20:44 -08:00
Lianmin Zheng 18bd8e8d6d Improve CI by trying a warmup before unit tests (#14669) 2025-12-09 15:17:59 -08:00
Yuhao Yang f72a77038f modify the sgl-kernel to be compatible with transformers 5.x. (#14625) 2025-12-08 00:39:00 -08:00
sglang-botandLianmin Zheng b5d3998508 Rename secrets.WHL_TOKEN -> secrets.GH_PAT_FOR_WHL_RELEASE (#14421)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2025-12-04 18:24:54 -08:00
Cheng Wan b12c9e5c0a Fix installation for nvidia-nvshmem-cu12 (#14033) 2025-11-26 18:27:12 -08:00
Fan YinandBaizhou Zhang 36b1bcd242 [chore] update torch version to 2.9 (#12969)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-25 14:47:34 -08:00
Adarsh ShirawalmathandMick af373636da CI: add server performance test for SGLang diffusion (#13091)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-15 10:11:19 +08:00
Kangyan-Zhou 4b1d163bfd Add HF cleanup logic in ci_install_dependency.sh (#12895) 2025-11-08 22:56:25 -08:00
Baizhou Zhang e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
alisonshao 0b88d520a0 Add nightly performance test for GPT-OSS 4GPU models (#12805) 2025-11-07 16:54:07 -08:00
Shangming Cai c2d4716da0 chore: bump mooncake version to 0.3.7.post2 (#12599)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-04 01:09:31 -08:00
Shangming Cai ab8b83f71d chore: upgrade mooncake 0.3.7.post1 (#12541)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-11-03 00:34:32 -08:00
Baizhou Zhang 6e29446e45 [hotfix] Remove flashinfer-jit-cache from pyproject (#12530) 2025-11-02 22:11:05 -08:00
Yineng ZhangandBaizhou Zhang 0c3543d7d5 chore: upgrade flashinfer 0.5.0 (#12523)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-02 20:54:12 -08:00
Baizhou Zhang 566ade0388 [CI] Build aarch64 kernels for sgl-kernel test (#12480) 2025-11-01 11:55:42 -07:00
Baizhou Zhang 5f98b7fe61 [CI] Fix kernel installation on aarch runners (#12475) 2025-10-31 14:25:27 -07:00
Lianmin Zheng 2d5605e89b Fix ci install to allow prerelease (#12449) 2025-10-31 02:22:15 -07:00
Keyang Ru 72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Kaixi Hou c0d02cf4d1 [NVIDIA] Add CI workloads for GB200 (#12242) 2025-10-30 14:32:03 -07:00
Lianmin Zheng 6a63a9852e minor code sync (#12403) 2025-10-30 12:49:31 -07:00
Baizhou Zhang 621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
Simo Lin 5259becd3c [bug] fix router installation to include additional dependency (#12348) 2025-10-29 12:45:18 -07:00
Baizhou Zhang 587deb15a7 [hotfix] Fix pytest not found in CI (#12311) 2025-10-29 11:07:36 +08:00
fzyzcjy 2a3763c335 Tiny fix sgl-kernel related CI installing the wrong binary (#12283) 2025-10-28 10:29:06 -07:00
ishandhananiandBaizhou Zhang 285a8e6986 docker: add CUDA13 support in dockerfile and update GDRCopy/NVSHMEM for blackwell support (#11517)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-27 22:00:54 -07:00
e7aa4664b3 [NVIDIA] Build CUDA 13 (#11299)
Co-authored-by: ishandhanani <ishandhanani@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-22 20:03:12 -07:00
jiahanc eec9e471ca [NVIDIA] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#11563)
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
2025-10-22 13:11:16 -07:00
Baizhou Zhang ebff4ee648 Update sgl-kernel and remove fast hadamard depedency (#11844) 2025-10-21 13:13:54 -07:00
Shangming Cai f3cd5d2510 [CI] Fix b200 flashinfer installation (#11915)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-21 22:28:50 +08:00
Shangming Cai 05d3667ab9 [CI] disable glm4.1v and fix the flashinfer installation (#11902)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-21 18:38:35 +08:00
Hank Han c1e1600373 [fix] fix ci uv install dependency (#11895) 2025-10-21 16:23:34 +08:00
b8zhong f4f8a1b4d8 ci: update lmms-eval to speed up multimodal CI (#11000) 2025-10-19 02:51:19 +08:00
Fan Yin 3289da5b41 [sgl-kernel] support hadamard (#11663) 2025-10-15 19:00:44 -07:00
Lianmin Zheng cd7e1bd591 Sync code and test CI; rename some env vars (#11686) 2025-10-15 18:37:03 -07:00
Baizhou Zhang 9f1f699a7a [CI] Add Basic Test for DeepSeek V3.2 (#11308) 2025-10-13 11:41:02 -07:00
Yineng Zhang 05f015f65f chore: remove flashinfer cleanup cache (#11514) 2025-10-12 14:56:33 -07:00
Lianmin Zheng 5a6ec8f999 Fix unit tests (#11503) 2025-10-12 07:45:57 -07:00
Yineng Zhang d8467db727 fix: reinstall torch in deps install (#11414) 2025-10-09 22:58:18 -07:00
Yineng Zhang 44cb060785 chore: upgrade flashinfer 0.4.0 (#11364) 2025-10-09 14:17:54 -07:00
Lianmin Zheng 366a603e95 Use cu128 for torch audio to fix some CI tests (#11251) 2025-10-05 19:52:32 -07:00
Lianmin Zheng d645ae90a3 Rename runner labels (#11228) 2025-10-05 18:05:41 -07:00
Mick fff7fbabe6 ci: fix rate-limit of huggingface with hf auth login (#10947) 2025-09-26 11:02:44 -07:00
Lianmin Zhengandcctry 38c00ed7a1 Fix multimodal registry and code sync scripts (#10759)
Co-authored-by: cctry <shiyang@x.ai>
2025-09-22 15:36:01 -07:00
Shangming Cai 74cd6e3902 chore: upgrade mooncake 0.3.6.post1 to fix gb200 dockerfile (#10681)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-09-20 00:12:26 -07:00