Commit Graph
10843 Commits
Author SHA1 Message Date
Yilong Zhao 343998865a perf: pad max-num-requests in decode cuda graph for higher coverage (#20978) 2026-03-22 17:06:16 -07:00
Ziang Li ce0541404f [FlashInfer v0.6.6][RL] Support fp8-last-n-bf16 RL for flashinfer_trtllm_routed moe backend (#20214) 2026-03-22 11:17:01 -07:00
Xiaoyu Zhangandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> c1fe5de69c [Diffusion] Clean up diffusion Triton kernels and modernize custom op registration (#21122)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-03-22 22:38:57 +08:00
Ke Bao 2406ddfdb8 Add ut guide to test skills (#21130) 2026-03-22 20:55:37 +08:00
Brayden Zhong 009eee85a0 CUTLASS FP8 Blockwise GEMM improvement of SM120 (#20887) 2026-03-22 17:55:54 +08:00
Xiaoyu Zhang 766d225fcc Add SGLang CUDA crash API logging inspired by FlashInfer (#20910) 2026-03-22 16:39:40 +08:00
bb737d7a82 Support Qwen3 MoE context parallel (#18233)
Co-authored-by: Shunkang <182541032+Shunkangz@users.noreply.github.co>
Co-authored-by: Jiying Dong <87510204+dongjiyingdjy@users.noreply.github.com>
2026-03-22 01:27:20 -07:00
kpham-sgl 6d160b42bb [Spec][Ngram] 1/N: Reference based Speculative Decoding refactor (#20393) 2026-03-22 00:55:10 -07:00
Liangsheng Yin d9f5c2179c ci(slash-cmd): allow write-permission users to /rerun-ut on fork PRs (#21121) 2026-03-22 00:45:48 -07:00
Xiaoyu ZhangandMick 1b65c0d259 [Diffusion] Fix torch.compile RMSNorm fallback for Z-Image (#20962)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-03-22 15:38:22 +08:00
Liangsheng Yin 1e97864d75 ci(slash-cmd): allow repo write-permission users to /rerun-ut (#21120) 2026-03-22 00:32:29 -07:00
Bowen Liandkinza99 3bc595acbc [FlashAttn] Add fused triton kernel for normal_decode_set_metadata (#20778)
Co-authored-by: kinza99 <dh18324568312@163.com>
2026-03-22 15:12:29 +08:00
Mick f7fc2c8592 [diffusion] fix: fix accuracy for some image models (#20679) 2026-03-22 15:11:57 +08:00
Liangsheng Yin 47d36d73f7 Update write-sglang-test skill: CUDA-only for common tests + prefer mock (#21119) 2026-03-21 22:54:43 -07:00
Lianmin Zheng 3343a79466 Fix jit-kernel unit test CI dependency install in pr-test workflow (#21089) 2026-03-21 22:13:06 -07:00
shuwenn 2fba2bdad1 refactor: Remove dead code from utils/common.py (#20668) 2026-03-21 21:54:17 -07:00
Lianmin Zheng 1ff0ee95e3 Update pr-test.yml to remove the temp hack - cron: '15 8 * * *' (#21115) 2026-03-21 21:53:31 -07:00
Lianmin ZhengandClaude Opus 4.6 76e4a8662c Replace clamp_position with JIT kernel + platform dispatch (#20999)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-21 21:26:26 -07:00
c1794e2944 [diffusion] fix: fix Sana corrupted output by removing spurious QK norm layers (#20656)
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-03-22 12:06:49 +08:00
Yuhao Yang c32e35a2a5 [diffusion] CI: fix picklingerror for diffusion models using diffusers backend (#20854) 2026-03-22 11:51:03 +08:00
Mick 6dfa8a40bc [diffusion] CI: make auxiliary coverage explicit and simplify testcases (#20983) 2026-03-21 20:18:23 +08:00
KnightLTCandMcZyWu a0862f00c2 dbrx instruct npu support (#17121)
Co-authored-by: McZyWu <zhuoyun.wu.23@ucl.ac.uk>
2026-03-21 17:10:35 +08:00
Liangsheng Yin ff921a2ed3 Update cron schedule for PR test workflow (#21090) 2026-03-21 01:03:45 -07:00
Alison ShaoandAlison Shao 852e112ebf [Qwen3.5] Fix broken pipeline parallelism layer splitting (#21070)
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
2026-03-21 01:02:51 -07:00
Baizhou Zhang 9ca68a5904 Remove flaky test for test_lora_update.py (#21088) 2026-03-21 00:52:40 -07:00
Lianmin Zheng 9b98d55ba4 Change PR test schedule time to 7:50 AM UTC (#21087) 2026-03-21 00:36:05 -07:00
Lianmin Zheng f2c9d5696f Change daily cron job time in pr-test.yml (#21084) 2026-03-21 00:24:53 -07:00
Qiaolin Yu 3f883ebf2e Fix test_qwen35_models (#21081) 2026-03-21 00:22:38 -07:00
Lianmin Zheng dba6fb3d30 Fix streaming logprobs corruption caused by shared mutable list reference (#21030) 2026-03-21 00:18:48 -07:00
Lianmin Zheng d089db0563 ci: add daily PR Test schedule at 12:18am PDT (#21083) 2026-03-21 00:15:48 -07:00
Lianmin Zheng 182dd20d57 ci: bypass maintenance gate for PR Test on main (#21082) 2026-03-21 00:08:47 -07:00
Alison ShaoandAlison Shao b7a1ae4fac Fix /rerun-stage dispatch failure for non-AMD stages (#21076)
Co-authored-by: Alison Shao <alison.shao@Mac.attlocal.net>
2026-03-20 23:48:29 -07:00
Lianmin Zheng 507db41504 Add CI maintenance mode gate to nightly-test-nvidia.yml (#21079) 2026-03-20 23:44:37 -07:00
3f0ba021fc [AMD] Improve openai/gpt-oss performance (#21020)
Co-authored-by: root <root@smci355-ccs-aus-m15-21.cs-aus.dcgpu>
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-03-20 23:16:47 -07:00
Baizhou Zhang 67cad3e69e Revert "Support CuteDSL mm_fp4 backend" (#21077) 2026-03-20 22:47:47 -07:00
Xiaoyu Zhang c076968c52 [CI] Remove obsolete AOT-only jit-kernel benchmarks after sgl-kernel 4.0 (#21075) 2026-03-21 13:40:42 +08:00
Baizhou Zhang 5f3393c04c Fix deepseek-v32-fp4 b200 ci (#21072) 2026-03-20 22:28:40 -07:00
Liangsheng Yin 9614271ae4 [Test] Fix flaky multi-instance memory occupation test (#21074) 2026-03-20 22:19:03 -07:00
Lianmin Zheng 427442304a Add CI maintenance mode gate to nightly-test-nvidia.yml (#21073) 2026-03-20 22:07:34 -07:00
Lianmin Zheng 50404e0d1f ci: refactor CUDA dependency install script (#21017) 2026-03-20 21:36:58 -07:00
Lianmin Zheng d5473f87c4 Add CI maintenance mode gate to pr-test.yml (#21069) 2026-03-20 21:27:38 -07:00
Alison Shao 048d90e165 Revert "[AMD] Add MoE weights and scales padding" (#21067) 2026-03-20 20:26:17 -07:00
Lianmin Zheng a75e74b534 Add revocation of permissions section (#21066) 2026-03-20 20:22:24 -07:00
3798a8c88d docs: add out-of-tree model integration guide (#21050)
Co-authored-by: Yixiao Zeng <yixiao.zeng@xiaopeng.com>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2026-03-20 20:07:46 -07:00
shuwenn 6c91590e1b [HiCache] refactor: hicache normalization flow and compatibility checks (#19669) 2026-03-20 18:38:44 -07:00
mqhc2020 9419453713 [AMD] Add MoE weights and scales padding (#18684) 2026-03-20 14:55:09 -07:00
YC Yen-Ching Tsengandwunhuang f97c09dac1 [AMD] Enable aiter unified attention for non-SWA models (Qwen3-VL) (#20897)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-03-20 12:07:41 -07:00
Zijun Gao 576e397b6e [Test] Add unit tests for srt/sampling (#20891) 2026-03-20 23:38:48 +08:00
fzyzcjy 146700db68 Add e2e demo test in dump comparator (#21031) 2026-03-20 22:41:01 +08:00
fzyzcjy 6703cc4484 Enhance output formatting in dump comparator (#21029) 2026-03-20 22:04:50 +08:00