Liangsheng Yin a6c7ebbbcb Add req slots leaking check (#842)

2024-07-30 18:29:01 -07:00

..

constrained

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

layers

Adjust default mem fraction to avoid OOM (#823)

2024-07-30 01:58:31 -07:00

managers

Add req slots leaking check (#842)

2024-07-30 18:29:01 -07:00

mem_cache

Code structure refactor (#807)

2024-07-29 23:04:48 -07:00

model_executor

Add --max-total-tokens (#840)

2024-07-30 13:33:55 -07:00

model_loader

Fix logging (#796)

2024-07-28 23:01:45 -07:00

models

Code structure refactor (#807)

2024-07-29 23:04:48 -07:00

openai_api

Fix List input bug (#838)

2024-07-30 13:40:51 -07:00

conversation.py

feat: add chat template for internlm2-chat (#802)

2024-07-30 03:18:03 +08:00

hf_transformers_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

mm_utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

model_config.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

sampling_params.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00

server_args.py

Add --max-total-tokens (#840)

2024-07-30 13:33:55 -07:00

server.py

Code structure refactor (#807)

2024-07-29 23:04:48 -07:00

utils.py

chore: add copyright for srt (#790)

2024-07-28 23:07:12 +10:00