[Bugfix] Add rids to the batch filtering for two batch overlap (#19418)
This commit is contained in:
@@ -653,6 +653,7 @@ class TboForwardBatchPreparer:
|
||||
"extend_seq_lens_cpu",
|
||||
"extend_logprob_start_lens_cpu",
|
||||
"lora_ids",
|
||||
"rids",
|
||||
]:
|
||||
old_value = getattr(batch, key)
|
||||
if old_value is None:
|
||||
|
||||
Reference in New Issue
Block a user