Mick 583d6af71b example: add vlm to token in & out example (#3941) ...

Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>

2025-03-04 22:18:26 -08:00

..

__init__.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

loader.py

example: add vlm to token in & out example (#3941)

2025-03-04 22:18:26 -08:00

utils.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

weight_utils.py

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)

2025-03-03 00:12:04 -08:00