[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com> Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com> Co-authored-by: Hanming Lu <hanming@x.ai>
This commit is contained in:
co-authored by
github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Hanming Lu
Hanming Lu
parent
63b9300f00
commit
64092c8b55
@@ -569,7 +569,7 @@ class DecodePreallocQueue:
|
||||
else 0
|
||||
)
|
||||
|
||||
if self.scheduler.model_config.is_hybrid:
|
||||
if self.scheduler.model_config.is_hybrid_swa:
|
||||
available_size = min(
|
||||
self.token_to_kv_pool_allocator.full_available_size(),
|
||||
self.token_to_kv_pool_allocator.swa_available_size(),
|
||||
|
||||
Reference in New Issue
Block a user