model: support qwen3-vl series (#10323)

Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
This commit is contained in:
Zheng Li
2025-09-23 10:15:52 -07:00
committed by GitHub
co-authored by ocss884 cao1zhg yhyang201 yhyang201 瑀澈 Mick Yineng Zhang
parent 98c3b04ff2
commit 4f564b9e83
7 changed files with 1898 additions and 8 deletions
+1 -1
View File
@@ -1187,7 +1187,7 @@ class MRotaryEmbedding(RotaryEmbedding):
time_tensor_long = time_tensor.long()
t_index = time_tensor_long.flatten()
elif model_type == "qwen2_vl":
elif model_type in ("qwen2_vl", "qwen3_vl", "qwen3_vl_moe"):
t_index = (
torch.arange(llm_grid_t)
.view(-1, 1)