Commit Graph

21 Commits

Author SHA1 Message Date
Binyao Jiang
38c233fd04 [Piecewise] Support PCG weak_ref_tensor cuda kernel on AMD (#17291) 2026-01-20 14:05:32 -08:00
Qiaolin Yu
206db66f5c tiny refactor pcg split op registration (#16863) 2026-01-10 23:45:28 +08:00
Yuwei An
145bd54f1b Piecewise Cuda Graph Memory Usage (#15927)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-01-10 19:29:13 +08:00
Yuwei An
5c243ba588 Custom All Reduce for Piecewise Cuda Graph (#15356)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-12-25 23:55:15 +08:00
Yuwei An
9d0347b33a EP Support for Piecewise Cuda Graph (#14164)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-12-20 01:59:27 +08:00
Vladimir221
27032cecd9 [Ascend]Support of piecewise graph compilation for prefill on NPU (#12287)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
2025-12-11 21:10:07 +08:00
Lianmin Zheng
6df1e8d628 [Auto Sync] Update backend.py (20251130) (#14153)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
Co-authored-by: Byron Hsu <byronhsu1230@gmail.com>
2025-11-30 22:15:02 -08:00
Stefan He
9f340ab1fb [Piecewise] support disable decode cuda graph when enable piecewise cuda graph (#13965) 2025-11-26 18:35:59 -08:00
Chen1022
d64bf6c6ce Support piecewise cuda graph for Qwen3-next (#13081) 2025-11-25 21:01:27 +08:00
Binyao Jiang
b29769f3b6 Move unnecessary input_addr capture under debug mode flag for speed-up (#13690) 2025-11-22 11:42:26 -08:00
Stefan He
d754ce973e [Piecewise Cuda Graph] rename, refactor and add more logging (#13675)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-11-21 13:28:38 +08:00
Xiaoyu Zhang
95f43669b5 [2 / 2] apply sgl-kernel weak_ref_tensor (#12978)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-16 21:24:35 +08:00
Yuwei An
eae59b337e Piecewise Cuda Graph Support for gpt-oss model (#13045)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-11-15 09:28:00 +08:00
Lianmin Zheng
22f641ab4f [minor] remove debug code in python/sglang/srt/compilation/weak_ref_tensor_jit.py (#13235)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-14 12:22:24 -08:00
Lianmin Zheng
7a2254b260 [Auto Sync] Update backend.py, forward_batch_info.py, piece... (20251113) (#13221)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-13 18:54:11 -08:00
Xiaoyu Zhang
9caca6a45c [PieceWise CUDA Graph] Support awq/gptq model in piecewise cudagraph (#12518) 2025-11-11 11:56:15 +08:00
Ke Bao
db24d34603 Support piecewise cuda graph for MLA (#11812) 2025-11-10 09:13:48 +08:00
zyksir
96a5a949f6 [Fix] fix allreduce bug in Piecewise Graph (#12106) 2025-10-26 21:15:48 +08:00
Yuwei An
1d726528f7 Eager Compiler for Torch Compile (#11803)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-10-18 15:18:52 +08:00
Chang Su
627974405d [Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685) 2025-10-17 16:49:46 -07:00
Yuwei An
932e263725 Compilation Folder Reset (#11539)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-10-14 09:19:12 +08:00