prophe d557e9f3b7 Update chat template for qwen and yi-1.5. (#530)

2024-07-08 23:55:44 -07:00

..

backend

Fix streaming (#600)

2024-07-07 01:55:58 -07:00

lang

Update chat template for qwen and yi-1.5. (#530)

2024-07-08 23:55:44 -07:00

srt

Add Qwen2 MoE support (#603)

2024-07-08 23:44:59 -07:00

test

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00

__init__.py

bump version to 0.1.18

2024-07-04 06:27:29 +00:00

api.py

[Minor] Correct Optional type hints in api (#526)

2024-06-11 16:37:27 -07:00

bench_latency.py

Format (#593)

2024-07-05 10:06:17 -07:00

global_config.py

Format (#593)

2024-07-05 10:06:17 -07:00

launch_server_llavavid.py

Minor fix in compiler & format (#545)

2024-06-29 23:42:14 -07:00

launch_server.py

Multi-node Tensor Parallelism (#550)

2024-06-17 20:41:24 -07:00

utils.py

Higher priority for user input of max_prefill_tokens & format (#540)

2024-06-12 21:48:40 -07:00