Lianmin Zheng 53cef81587 Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

..

cache_controller.py

Cache controller for hierarchical caching (#2804)

2025-01-10 20:22:01 -08:00

configure_logging.py

Fix the request loggings to make it fully able to be easily replayed (#2973)

2025-01-18 21:45:00 -08:00

data_parallel_controller.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

detokenizer_manager.py

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

image_processor.py

[Feature] Support minicpmv v2.6 (#2785)

2025-01-18 14:14:19 -08:00

io_struct.py

Feature/function calling update (#2700)

2025-01-26 09:57:51 -08:00

schedule_batch.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

schedule_policy.py

Query remaining memory dynamically for PrefillAdder (#2941)

2025-01-17 20:20:26 -08:00

scheduler.py

Improve weight loading and code style (#3174)

2025-01-27 03:00:41 -08:00

session_controller.py

[Feature] Add sampler custom logits processor (#2396)

2025-01-19 14:46:53 -08:00

tokenizer_manager.py

Return more infos for computing average acceptance length (#3152)

2025-01-26 04:51:54 -08:00

tp_worker_overlap_thread.py

Enable CPU device on SGLang (#2806)

2025-01-16 21:22:53 -08:00

tp_worker.py

fix missing revision arg when loading tokenizer (#2982)

2025-01-19 11:36:07 -08:00

utils.py

Frontend: better error message handling for FINISH_ABORT in scheduler.py (#2956)

2025-01-18 19:37:30 -08:00