Commit Graph
23 Commits
Author SHA1 Message Date
ShirakSyouya ce694b2b9e Fix the problem where Qwen3VL raises an "object has no attribute 'mod… (#15677) 2026-01-06 08:45:13 +08:00
fy 25fa2ac290 Convert cu_seqlens to CPU for npu_flash_attention_unpad operator (#15434) 2026-01-04 08:16:42 +08:00
Nan JiangandXinyuan Tong 7254986342 [VLM] feat: true on policy for vlm + fsdp (#14636)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-01-01 16:54:39 -08:00
Vitaly Tuzov 1048803c1f Reworked fast_pos_embed_interpolate() using torch (#10959) 2025-12-30 14:45:34 +08:00
Yuan Luoandluoyuan.luo 828dec1c7c [VLM] Tiny: Unify VLM environment variables (#15572)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-22 17:32:37 +08:00
Yuan Luoandluoyuan.luo 019517a356 [VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-20 21:00:07 +08:00
Yuan Luoandluoyuan.luo 8fa3dc36c5 [VLM] Support cos sin cache for Qwen3-VL & GLM-4.1V (#15205)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-18 08:39:50 +08:00
LHXuuuandPeng Zhang 712f44ee2b fix qwenvl compressed tensors quantization weight loader (#11914)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
2025-12-17 18:01:43 +08:00
45a959d3e9 [PP] Add pp support for Qwen3-VL (#12333)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Kun(llfl) <llfl@linux.alibaba.com>
Co-authored-by: kun-llfl <i@imux.top>
Co-authored-by: Kun(llfl) <llfl@linux.alibaba.com>
2025-12-17 16:03:58 +08:00
Yuan Luoandluoyuan.luo 3912ee4991 [VLM] feat: support chunked vit attention (#14907)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-15 12:11:02 +08:00
9acb21ae27 feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
2025-12-14 22:30:08 +08:00
Yuan Luoandluoyuan.luo b2b09f5f24 [VLM] Introduce Cache for positional embedding ids for Qwen-VL family (#14292)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-12-04 12:32:00 +08:00
Lzhang-hub ea1e9f6b3c feat: support qwen3_vl vision model dp (#13724) 2025-11-28 17:29:07 +08:00
Yuan Luoandluoyuan.luo 5625e32cae [VLM] Replace torch.repeat_interleave with faster np.repeat for Qwen-VL series (#13736)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-22 22:45:32 +08:00
b1c688fba2 refactor: cleanup vision attention related codes (#13228)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-16 22:44:40 +08:00
Jonah Bernard a209fb05c1 [Qwen3 VL] Add LoRA support for Qwen 3 VL (#12165) 2025-11-03 20:32:54 -08:00
Chang Su 627974405d [Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685) 2025-10-17 16:49:46 -07:00
MickandXinyuan Tong 86b04d25b3 model: qwen3-omni (thinker-only) (#10911)
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2025-10-16 13:20:38 -07:00
Zheng Wengang b2c8566920 [BugFix][Qwen3-VL]: fix cu_seqlens in qwen3-vl (#11458) 2025-10-14 22:16:49 -07:00
Vincent Zhong be740acdb0 [smol] [perf] Qwen3-VL in place op. (#11481)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
2025-10-12 20:25:30 +08:00
Yuan Luoandluoyuan.luo b5044fbf12 Replace pad with cat for better performance (#11388)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-10-10 12:03:17 +08:00
fzyzcjy fdc4e1e570 Tiny move files to utils folder (#11166) 2025-10-03 22:40:06 +08:00
4f564b9e83 model: support qwen3-vl series (#10323)
Co-authored-by: ocss884 <ocss.lin@gmail.com>
Co-authored-by: cao1zhg <653506626@qq.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-09-23 10:15:52 -07:00