Liangsheng Yin 3520f75fb1 Remove inf value for chunked prefill size (#812)

2024-07-29 18:34:25 -07:00

..

constrained

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

layers

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

managers

Remove inf value for chunked prefill size (#812)

2024-07-29 18:34:25 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

openai_api

Add support for OpenAI API : offline batch(file) processing (#699)

2024-07-29 13:07:18 -07:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

flush_cache.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

hf_transformers_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

memory_pool.py

Chunked prefill (#800)

2024-07-29 03:32:58 -07:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

sampling_params.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

server_args.py

Remove inf value for chunked prefill size (#812)

2024-07-29 18:34:25 -07:00

server.py

Add support for OpenAI API : offline batch(file) processing (#699)

2024-07-29 13:07:18 -07:00

utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00