Lianmin Zheng 6d0fa73ece Simplify flashinfer utilities (#1704)

2024-10-17 22:54:14 -07:00

..

configs

…

constrained

[FIX] Catch syntax error of Regex Guide to avoid crash (#1521)

2024-09-28 12:42:06 -07:00

layers

Simplify flashinfer utilities (#1704)

2024-10-17 22:54:14 -07:00

lora

Use is_flashinfer_available to replace is_hip for flashinfer check (#1596)

2024-10-06 22:54:05 -07:00

managers

Simplify flashinfer utilities (#1704)

2024-10-17 22:54:14 -07:00

mem_cache

feat: radix tree code optimize (#1697)

2024-10-17 08:01:27 -07:00

model_executor

Simplify flashinfer utilities (#1704)

2024-10-17 22:54:14 -07:00

models

Fix mixed batch for multi modal models (#1702)

2024-10-17 10:27:26 -07:00

openai_api

Add matched_stop token or str to distinguish between eos or stop str finish_reason generation (#1684)

2024-10-17 18:06:52 +00:00

sampling

[Minor] Add some utility functions (#1671)

2024-10-14 20:08:03 -07:00

conversation.py

Add image_token in conversation.py (#1632)

2024-10-11 05:07:51 -07:00

hf_transformers_utils.py

…

mm_utils.py

…

server_args.py

Returning a per request metric for number of cached_tokens read (#1599)

2024-10-16 11:49:22 -07:00

server.py

Fix engine unit test (#1701)

2024-10-17 09:53:32 -07:00

utils.py

Add date to logging messages (#1623) (#1679)

2024-10-16 18:54:55 -07:00