Lifu Huang 49538d111b Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

..

backend

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

triton_ops

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

layers.py

Eliminate stream sync to speed up LoRA batch init (#6960)

2025-06-09 00:22:45 -07:00

lora_config.py

[Fix] Fix bugs and refactor codes in lora for better scalability. (#3652)

2025-02-20 11:51:57 -08:00

lora_manager.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

lora.py

Support dynamic LoRA loading / unloading in engine/server API (#7446)

2025-06-27 21:00:27 -07:00

mem_pool.py

Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic LoRA loading support (#7412)

2025-06-21 16:09:19 -07:00

utils.py

Refactor LoRAManager and LoRAMemoryPool state management logic for dynamic LoRA loading support (#7412)

2025-06-21 16:09:19 -07:00