Yineng Zhang 85e1a6f3aa Update model_loader deps and qqq quantization deps (#2220) (#2318) ...

Co-authored-by: HandH1998 <1335248067@qq.com>

2024-12-02 23:22:13 +08:00

..

configs

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

constrained

Feat: upgrade outlines & support compatibility with the old version (#2292)

2024-12-01 02:07:27 -08:00

distributed

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

layers

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

lora

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

managers

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

mem_cache

Update docs (#1839)

2024-10-30 02:49:08 -07:00

metrics

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_executor

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

model_loader

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

models

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

openai_api

Fix logprob for completions (#2301)

2024-12-01 05:17:05 -08:00

sampling

[Fix] Avoid calling fill_vocab_mask for terminated requests (#2175)

2024-11-25 17:31:25 +08:00

_custom_ops.py

adapt vllm distributed module to sglang (#2244)

2024-12-01 15:54:52 +08:00

conversation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

hf_transformers_utils.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

mm_utils.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

model_parallel.py

[minor] Clean up unused imports (#2122)

2024-11-22 01:50:42 -08:00

server_args.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

server.py

[Minor] Fix code style (#2311)

2024-12-02 02:27:36 -08:00

utils.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00