Commit Graph
41 Commits
Author SHA1 Message Date
Lifu Huang 0a9bfc20ab [Minor] Always append newline after image token when parsing chat message (#6797) 2025-05-31 20:50:33 -07:00
Lifu Huang 094fbdacd5 Fix incorrect LoRA weight loading for fused gate_up_proj (#6734) 2025-05-31 13:41:44 -07:00
Xinyuan Tong d6864ce6d6 [New Model] Devstral support (#6547)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
2025-05-26 19:27:48 -07:00
Lifu Huang 022012aae8 Support Phi-4 Multi-Modal (text + vision only) (#6494) 2025-05-24 21:43:38 -07:00
Yury SulskyandYury Sulsky 24161c5913 The Gemma template is missing a newline after the user role. (#6331)
Co-authored-by: Yury Sulsky <ysulsky@tesla.com>
2025-05-18 01:57:27 -07:00
Kiv Chen 5380cd7ea3 model(vlm): pixtral (#5084) 2025-05-13 00:16:10 -07:00
XinyuanTong 9d8ec2e67e Fix and Clean up chat-template requirement for VLM (#6114)
Signed-off-by: Xinyuan Tong <justinning0323@outlook.com>
2025-05-11 00:14:09 +08:00
Lifu Huang 2b63798c7d [Minor] Fix duplicate method definitions in conversation.py (#6012)
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
2025-05-04 13:02:53 -07:00
3409aaab32 Support InternVL3 (#5350)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-05-01 22:38:59 -07:00
liwenju0andwenju.li 8fefdd32c7 [Feature] add support kimi vl model (#5383)
Co-authored-by: wenju.li <wenju.li@deepctr.cn>
2025-04-29 21:31:19 -07:00
woodx 2c3ea29476 [Feature] support auto chat template (#4949) 2025-04-28 22:34:18 -07:00
ZXNandbppps 04d0123fd9 [Fix]: support deepseek-vl2-tiny model (#5552)
Co-authored-by: bppps <zouyu.zzx@alibaba-inc.com>
2025-04-26 17:52:53 +08:00
f04c80dc42 Add Llama4 support (#5092)
Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>
2025-04-07 00:29:36 -07:00
Mick 1e86457c90 model: Minicpmo (#3023) 2025-03-24 20:08:40 -07:00
Mick 11577cedb7 refactor: bug fixes and refactor for vlm (#4661) 2025-03-22 22:48:49 -07:00
d6d21640d3 [Feature] Support Deepseek-VL2 (#2798)
Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>
2025-03-16 23:07:59 -07:00
Mick 9d02bb3e2a Urgent model support: support gemma-3-it (#4424) 2025-03-16 17:37:32 -07:00
Mick 01090e8ac3 model: Support Janus-pro (#3203) 2025-03-12 11:02:11 -07:00
Mick ff2ce0b86f refactor: move image processors to separate files (#4229) 2025-03-11 12:35:35 -07:00
Pan Lyu 361971b859 Add Support for Qwen2-VL Multi-modal Embedding Models (#3694) 2025-03-06 16:46:20 -08:00
3d93f84a00 [Feature] Support minicpmv v2.6 (#2785)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: yizhang2077 <1109276519@qq.com>
2025-01-18 14:14:19 -08:00
Xuehai Pan 62a4a339eb docs: fix module docstrings and copyright headers (#2077) 2024-11-22 22:16:53 +08:00
Liangsheng Yin 94cde10920 Llama3.2 vision model support (#1551) 2024-10-21 15:01:21 -07:00
cbbc82b7b8 Support qwen2 vl model (#1721)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: ispobock <ISPObaoke@163.com>
2024-10-19 21:44:38 -07:00
Lianmin Zhengandyizhang2077 f13d86f920 Add image_token in conversation.py (#1632)
Co-authored-by: yizhang2077 <1109276519@qq.com>
2024-10-11 05:07:51 -07:00
Lianmin Zheng 3a6e8b6d78 [Minor] move triton attention kernels into a separate folder (#1379) 2024-09-10 15:15:08 -07:00
Kaichen Zhang - NTU 662ecd9368 [Feat] Add modalities for vision server when handling pixel values for llava (#1346) 2024-09-09 02:07:34 -07:00
Christopher Chou 51c554d812 Allow more flexible assistant and system response (#1256) 2024-08-30 11:51:44 -07:00
Kaichen Zhang - NTUandBo Li a5b14ad043 [Feat/WIP] add llava-onevision, with support for (1) siglip encoder, (2) qwen2 decoder (3) openai api compatible server. (#1123)
Co-authored-by: Bo Li <drluodian@gmail.com>
2024-08-23 14:11:16 -07:00
Yineng Zhang 3d1cb0af83 feat: add chat template for internlm2-chat (#802) 2024-07-30 03:18:03 +08:00
Yineng Zhang dd7e8b9421 chore: add copyright for srt (#790) 2024-07-28 23:07:12 +10:00
Mingyi e3046ea3a8 Update OpenAI API (#667) 2024-07-19 23:20:54 -07:00
Ying Sheng fb9296f0ed Higher priority for user input of max_prefill_tokens & format (#540) 2024-06-12 21:48:40 -07:00
Lianmin Zheng f6dbd24043 Improve doc strings (#518) 2024-06-08 02:39:32 -07:00
Lianmin Zheng abc548c707 Minor fix for the import path (#428) 2024-05-12 05:10:35 -07:00
Lianmin Zheng ba67101f99 Fix chatml template (#406) 2024-04-30 15:53:39 -07:00
Lianmin Zheng c51020cf0c Fix the chat template for llava-v1.6-34b & format code (#177) 2024-02-11 05:50:13 -08:00
Keith Stevens 1d0fbe8e43 [Feature] Adds basic support for image content in OpenAI chat routes (#113) 2024-01-30 06:12:33 -08:00
Lianmin Zheng f30abd090a Improve error message & Add vicuna template (#57) 2024-01-19 17:03:33 -08:00
Lianmin Zheng 199e82a15d Format code & Improve readme (#52) 2024-01-18 23:51:19 -08:00
Cody Yu 23471f9aa3 Support v1/chat/completions (#50) 2024-01-18 23:43:09 -08:00