Commit Graph

73 Commits

Author SHA1 Message Date
Liangsheng Yin
87e8c090e9 Organize code (rename, movement) (#953) 2024-08-06 20:50:32 -07:00
Ke Bao
e1eae1fd15 Support MLA for DeepSeek-V2 with Triton - step 1 (#905) 2024-08-05 03:40:33 +10:00
Ying Sheng
5e7dd984fe Fix llama for classification (#855) 2024-07-31 15:48:31 -07:00
Liangsheng Yin
cdcbde5fc3 Code structure refactor (#807) 2024-07-29 23:04:48 -07:00
Yineng Zhang
dd7e8b9421 chore: add copyright for srt (#790) 2024-07-28 23:07:12 +10:00
Lianmin Zheng
30db99b3d9 Rename prefill_token_logprobs -> input_token_logprobs; decode_token_logprobs -> output_token_logprobs (#776) 2024-07-27 19:50:34 -07:00
Liangsheng Yin
679ebcbbdc Deepseek v2 support (#693) 2024-07-26 17:10:07 -07:00
Yineng Zhang
e17deb27b5 fix: llama 3.1 405b fp8 (#714) 2024-07-24 09:37:41 -07:00
Ying Sheng
444a02441a Update vllm version to support llama3.1 (#705) 2024-07-23 13:49:34 -07:00
Ke Bao
5303c1ed22 Support Mistral-Nemo (#691) 2024-07-22 03:36:53 +10:00
Liangsheng Yin
eedc12e12e Support Deepseek MoE Model (#689) 2024-07-21 03:09:29 -07:00
Liangsheng Yin
caaad53b52 Support gpt-bigcode model class (#681) 2024-07-20 18:34:37 -07:00
Ying Sheng
06487f126e refactor model loader: initial refactor (#664) 2024-07-20 02:18:22 -07:00
zhyncs
2e341cd493 misc: add pre-commit config (#637) 2024-07-17 11:55:39 -07:00
zhyncs
a8552cb18b feat: support internlm2 (#636) 2024-07-16 22:40:03 -07:00
ylying
fe3be1595d Add qwen2 tie word embedding (#630) 2024-07-16 11:48:49 -07:00
Liangsheng Yin
c9ee3d3559 Fix model forward grad (#628) 2024-07-15 22:09:09 -07:00
Liangsheng Yin
564a898ad9 Optimize mem indices mangement (#619) 2024-07-13 23:39:37 -07:00
Tommy Yang
740c46a152 Add Qwen2 MoE support (#603) 2024-07-08 23:44:59 -07:00
Pan Lyu
710f614ebe add minicpm support (#602) 2024-07-08 23:27:04 -07:00
Liangsheng Yin
f25b76c02a add LogitsMetadata (#604) 2024-07-08 17:46:55 -07:00
Mingyi
c0982ac553 Fix Llava model (#594) 2024-07-06 00:58:46 -07:00
Ying Sheng
dc1b8bcfaa Format (#593) 2024-07-05 10:06:17 -07:00
Ying Sheng
5a57b8addd Add Gemma2 (#592) 2024-07-05 09:48:54 -07:00
Chen Xuechen Li
441cca773d support gptj style rope in llama 2024-07-03 22:06:58 +00:00
Daniel Hernandez Garcia
95dc093b19 [BugFix] gemma loading weights "lm_head.weight" key error (#577) 2024-07-01 22:10:07 -07:00
sglang
11616fc6bd Minor fix in compiler & format (#545) 2024-06-29 23:42:14 -07:00
Lianmin Zheng
1fa15099d8 Add LlamaForClassification (#559) 2024-06-22 00:49:31 -07:00
Ying Sheng
fb9296f0ed Higher priority for user input of max_prefill_tokens & format (#540) 2024-06-12 21:48:40 -07:00
Lianmin Zheng
94aead9e8d Fix dependency (#538) 2024-06-12 13:17:35 -07:00
Qubitium
a8c787d2b3 Add ChatGLM Model Support (#516)
Co-authored-by: ZX <zx@lbx.dev>
2024-06-11 16:39:52 -07:00
Amos You
651a23ee7c remove redundant pad_input_ids function (#500) 2024-06-07 12:23:29 -07:00
Lianmin Zheng
bf3e271fe0 Update vllm to v0.4.3 (#511)
Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>
2024-06-07 12:11:31 -07:00
Ying Sheng
0463f7fb52 Support data parallelism (static) (#480)
Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2024-05-27 21:24:10 -07:00
Lianmin Zheng
09de730dee Improve benchmark scripts & add more models (#484) 2024-05-27 14:13:26 -07:00
Li Bo
2b605ab1d7 [Feat/Fix] Refactoring Llava models into single file (#475) 2024-05-26 12:29:51 -07:00
Lianmin Zheng
0fafc5606b port fp8 mixtral (#460) 2024-05-21 11:46:35 -07:00
Lianmin Zheng
19d2135cb8 Use model loader from vllm (#459) 2024-05-21 09:13:37 -07:00
Liangsheng Yin
690d162d97 Format code (#441) 2024-05-14 22:40:46 +08:00
Kaichen Zhang - NTU
664287b2a7 [Feat] Add llava qwen, llava mistral (#419)
Co-authored-by: Bo Li <drluodian@gmail.com>
2024-05-13 22:17:50 -07:00
Yuanhan Zhang
0992d85f92 support llava video (#426) 2024-05-13 16:57:00 -07:00
Qubitium
33b242df30 Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380)
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
2024-05-11 16:37:49 -07:00
Liangsheng Yin
150d7020ed Revert removing the unused imports (#385) 2024-04-23 22:36:33 +08:00
Liangsheng Yin
9acc6e3504 add .isort.cfg (#378) 2024-04-22 22:38:09 +08:00
Lianmin Zheng
65501a9cf1 Fix commandr import; format code 2024-04-16 18:10:12 +00:00
ZhouXingg
db611066ad support command-r (#369) 2024-04-16 10:36:51 -07:00
Ying Sheng
b0890631a0 fix gemma import error 2024-04-01 07:36:52 +00:00
Liangsheng Yin
2af565b3bb [model] DBRX-instruct support (#337) 2024-03-28 10:05:19 -07:00
Jani Monoses
b57abe1663 Add StableLM model. (#301) 2024-03-22 13:24:08 -07:00
Lianmin Zheng
faba293a0d Improve gemma and documentations (#278) 2024-03-11 04:43:39 -07:00