[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> Co-authored-by: ispobock <ispobaoke@gmail.com>
This commit is contained in:
@@ -685,6 +685,7 @@ class TboForwardBatchPreparer:
|
||||
for key in [
|
||||
"forward_mode",
|
||||
"is_extend_in_batch",
|
||||
"all_extend_in_batch",
|
||||
"return_logprob",
|
||||
"req_to_token_pool",
|
||||
"token_to_kv_pool",
|
||||
|
||||
Reference in New Issue
Block a user