Split the __init__ of scheduler as smaller functions. Improve the eagle tests (#4128)
This commit is contained in:
@@ -482,6 +482,7 @@ class BatchEmbeddingOut:
|
||||
embeddings: List[List[float]]
|
||||
# Token counts
|
||||
prompt_tokens: List[int]
|
||||
cached_tokens: List[int]
|
||||
|
||||
|
||||
@dataclass
|
||||
|
||||
Reference in New Issue
Block a user