[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
This commit is contained in:
Leon Gao
2026-02-27 18:11:05 -08:00
committed by GitHub
parent 8c0f2d40bd
commit b5a8e4179e
7 changed files with 87 additions and 42 deletions

View File

@@ -685,6 +685,7 @@ class TboForwardBatchPreparer:
for key in [
"forward_mode",
"is_extend_in_batch",
"all_extend_in_batch",
"return_logprob",
"req_to_token_pool",
"token_to_kv_pool",