Commit Graph

6 Commits

Author SHA1 Message Date
Ying Sheng
0909bb0d2f [Feat] Add window attention for gemma-2 (#1056) 2024-08-13 17:01:26 -07:00
Yineng Zhang
65e89baea9 fix: not use the default port (#1068) 2024-08-13 15:12:56 +10:00
Ying Sheng
32f6144323 fix: Fix returned prefill logits and add output str test (#1046) 2024-08-12 06:13:45 +00:00
Ying Sheng
7599badeaf Support embedding input as a list (#1014) 2024-08-10 08:39:05 -07:00
Ying Sheng
e040a2450b Add e5-mistral embedding model - step 3/3 (#988) 2024-08-08 16:31:19 -07:00
Ying Sheng
70cc0749ce Add model accuracy test - step 1 (#866) 2024-08-03 18:20:50 -07:00