 Shangming Cai
|
70e4b21853
|
Fix flaky logprobs test (#10728)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-22 00:46:26 -07:00 |
|
|
Shangming Cai
|
74cd6e3902
|
chore: upgrade mooncake 0.3.6.post1 to fix gb200 dockerfile (#10681)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-20 00:12:26 -07:00 |
|
|
Shangming Cai
|
60fc5b51f6
|
chore: upgrade mooncake 0.3.6 (#10596)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-18 00:19:30 -07:00 |
|
|
Shangming Cai
|
a13dd1e492
|
[PD] Improve disaggregation common backend and refactor mooncake backend (#10273)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-17 22:58:07 -07:00 |
|
|
Shangming Cai
|
edd6a07bc0
|
Minor fix lint introduced by #10466 (#10507)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-16 01:38:25 -07:00 |
|
|
Shangming Cai
|
f5f6b3b4b5
|
Refactor fused_add_rmsnorm import logic (#10207)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-09 00:23:58 -07:00 |
|
|
Shangming Cai
|
00974e4f6e
|
[CI] Refactor disaggregation tests (#10068)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-06 22:14:46 +08:00 |
|
|
Shangming Cai
|
a25e8e42eb
|
Move multi-tokenizer event loop to better place (#9902)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-09-01 23:12:21 -07:00 |
|
|
Shangming Cai
|
25ef53f05f
|
[PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-20 19:29:10 -07:00 |
|
|
Shangming Cai
|
d8ed60f254
|
[CI] Fix disaggregation failure tolerance CI (#9378)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-19 23:31:08 -07:00 |
|
|
|
384f8ab5ce
|
[PD] Support PD disaggregation with Prefill PP (#8846)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: root <huzhiyuan@xiaohongshu.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Francis <38564764+ssssnow@users.noreply.github.com>
Co-authored-by: zitto <zhjc1124@gmail.com>
|
2025-08-16 18:31:31 -07:00 |
|
|
Shangming Cai
|
8ca07bd948
|
[CI] Fix sgl-router disaggregation test (#9222)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-15 02:24:44 -07:00 |
|
|
Shangming Cai
|
4caca4f6b4
|
Fix typo in REVIEWERS (#9113)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-08-12 11:55:49 -07:00 |
|
|
Shangming Cai
|
eb429b88a4
|
[PD] Respect sampling_params.max_new_tokens when PD disaggregation is activated (#7598)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-06-27 22:22:01 -07:00 |
|
|
shangmingc
|
89a554181f
|
[PD] Fix unclosed prefill connection warning of mini_lb (#5155)
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
|
2025-04-08 09:15:06 -07:00 |
|