Commit Graph
7 Commits
Author SHA1 Message Date
Shangming Cai 25ef53f05f [PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-08-20 19:29:10 -07:00
Shangming Cai d8ed60f254 [CI] Fix disaggregation failure tolerance CI (#9378)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-08-19 23:31:08 -07:00
384f8ab5ce [PD] Support PD disaggregation with Prefill PP (#8846)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>
2025-08-16 18:31:31 -07:00
Shangming Cai 8ca07bd948 [CI] Fix sgl-router disaggregation test (#9222)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-08-15 02:24:44 -07:00
Shangming Cai 4caca4f6b4 Fix typo in REVIEWERS (#9113)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-08-12 11:55:49 -07:00
Shangming Cai eb429b88a4 [PD] Respect sampling_params.max_new_tokens when PD disaggregation is activated (#7598)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-06-27 22:22:01 -07:00
shangmingc 89a554181f [PD] Fix unclosed prefill connection warning of mini_lb (#5155)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
2025-04-08 09:15:06 -07:00