Commit Graph

5 Commits

Author SHA1 Message Date
ishandhanani
1a5c313f97 feat(engine): add rid parameter to methods in Engine class (#13095) 2025-11-11 22:37:54 -08:00
Lifu Huang
49538d111b Support dynamic LoRA loading / unloading in engine/server API (#7446) 2025-06-27 21:00:27 -07:00
ishandhanani
f1569876d5 feat: add direct routing strategy to DP worker (#6884) 2025-06-09 11:44:05 -07:00
Junrong Lin
f3bf611054 feat: add flush cache to EngineBase and HttpServerEngineAdapter (#6009) 2025-05-14 19:15:02 -07:00
tianlian yi
bc92107b03 Support server based rollout in Verlengine (#4848)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jinn <47354855+jhinpan@users.noreply.github.com>
2025-04-12 10:07:52 -07:00