4 people b045841bae Feature/function calling update (#2700) ...

Co-authored-by: Mingyuan Ma <mamingyuan2001@berkeley.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: shuaills <shishuaiuoe@gmail.com>

2025-01-26 09:57:51 -08:00

..

configs

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

constrained

Move sgl.Runtime under sglang/lang (#2990)

2025-01-19 17:10:29 -08:00

distributed

[Fix] Not skip NVML Check on AMD Platform (#3135)

2025-01-25 21:33:51 -08:00

entrypoints

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

layers

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

lora

…

managers

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

mem_cache

Fix perf regression on small batch sizes (#3008)

2025-01-20 03:39:49 -08:00

metrics

Improve metrics, logging, and importing orders (#2992)

2025-01-19 18:36:59 -08:00

model_executor

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

model_loader

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

models

enable kv_scale for Gemma2 (#3113)

2025-01-25 18:29:14 -08:00

openai_api

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

sampling

Fix repetition penalty (#3139)

2025-01-25 21:48:58 -08:00

speculative

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

_custom_ops.py

Roll back to use vllm custom allreduce (#3006)

2025-01-20 04:03:15 -08:00

aio_rwlock.py

…

conversation.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

function_call_parser.py

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

hf_transformers_utils.py

…

mm_utils.py

…

model_parallel.py

…

server_args.py

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

server.py

Misc fixes for eagle (flush_cache, CPU overhead) (#3014)

2025-01-20 20:27:38 -08:00

torch_memory_saver_adapter.py

…

utils.py

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00