chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Fix idle batch predict dtype in spec v2 (#18379)

Browse Source
This commit is contained in:
Qiaolin Yu
2026-02-10 10:29:13 +08:00
committed by GitHub
parent df733c5ee5
commit 4a1b50bb2d
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/speculative/eagle_info_v2.py
+1 -1
View File
@@ -267,7 +267,7 @@ class EagleVerifyInputV2Mixin:
(which contains spec decoding information). (which contains spec decoding information).
""" """
if batch.forward_mode.is_idle(): if batch.forward_mode.is_idle():
predict = torch.empty(0, dtype=torch.long, device=batch.input_ids.device) predict = torch.empty(0, dtype=torch.int32, device=batch.input_ids.device)
accept_length = torch.empty( accept_length = torch.empty(
0, dtype=torch.int32, device=batch.input_ids.device 0, dtype=torch.int32, device=batch.input_ids.device
) )