Commit Graph
13 Commits
Author SHA1 Message Date
Simo Lin 828a4fe944 [router] Implement HTTP Dependency Injection Pattern for Router System (#8714) 2025-08-02 19:16:47 -07:00
Simo Lin 6d4fd8826e [router] minor code clean up and and refactoring (#8711) 2025-08-02 13:46:31 -07:00
Simo Lin ab9b893e61 [bug] limit bootstrap room to to [0, 2^63 - 1] (#8684) 2025-08-01 14:41:01 -07:00
Simo Lin 66a398f49d [router] migrate router from actix to axum (#8479) 2025-07-30 17:47:19 -07:00
Rui Chen a730ce8162 [feature] [sgl-router] Add a dp-aware routing strategy (#6869) 2025-07-30 05:58:48 -07:00
Simo Lin fe6a445d1e [router] improve router logs and request id header (#8415) 2025-07-27 19:30:19 -07:00
Simo Lin 2ab97023e3 [router] add different policies for p node and d node (#8395) 2025-07-27 00:39:20 -07:00
Simo Lin f6e07f2796 [router] fix pd model completion request (#8303) 2025-07-23 23:18:29 -07:00
Rui Chen c33499a67b fix: sgl-router remove dead code (#8257) 2025-07-22 08:41:23 -07:00
Simo Lin 5c8365a051 [router] add ut for pd router (#8208) 2025-07-20 23:12:52 -07:00
Simo Lin 1fc455e8b6 [router] add ut for pd request, metrics and config (#8184) 2025-07-20 10:53:42 -07:00
Simo Lin 8fcc55cfa1 [router] router metrics cleanup (#8158) 2025-07-18 22:09:17 -07:00
c8f31042a8 [router] Refactor router and policy traits with dependency injection (#7987)
Co-authored-by: Jin Pan <jpan236@wisc.edu>
Co-authored-by: Keru Yang <rukeyang@gmail.com>
Co-authored-by: Yingyi Huang <yingyihuang2000@outlook.com>
Co-authored-by: Philip Zhu <phlipzhux@gmail.com>
2025-07-18 14:24:24 -07:00