Commit Graph
18 Commits
Author SHA1 Message Date
Simo Lin ce9cf35327 [router] update pyo3 version to 0.25.1 (#9022) 2025-08-10 06:45:51 -07:00
Simo Lin 473400e452 [router] upgrade kube version to latest (#9018) 2025-08-09 22:49:45 -07:00
Simo Lin dd665f967f [router] upgrade rand to latest version (#9017) 2025-08-09 22:49:30 -07:00
Tien Nguyen fd05b56750 refactor(sgl-router): Replace once_cell with LazyLock in worker.rs and remove once_cell dependency from Cargo.toml (#8698) 2025-08-07 06:14:03 -07:00
Simo Lin 66a398f49d [router] migrate router from actix to axum (#8479) 2025-07-30 17:47:19 -07:00
Simo Lin 6f8f4aeea4 [router] add common ut infra to mock worker and app (#8295) 2025-07-23 10:07:51 -07:00
Simo Lin f2d5c4920e [router] add worker abstraction (#7960) 2025-07-11 20:17:48 -07:00
Simo Lin c071198c1d [router] add centralized configuration module for sgl-router (#7588) 2025-06-27 15:42:02 -07:00
Simo Lin 3abc30364d [ci] add router benchmark script and CI (#7498) 2025-06-25 01:28:25 -07:00
Simo Lin 30f2a44a96 [misc] Add PD service discovery support in router (#7361) 2025-06-22 17:54:14 -07:00
Simo Lin 09ae5b20f3 Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) 2025-06-19 02:28:15 +08:00
Arthur ChengandSimo Lin ff91474825 [Router] Fix k8s Service Discovery (#6766)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-06-02 16:57:23 -07:00
Chao Yang 1a39979993 Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) 2025-05-24 22:28:15 -07:00
Simo Lin 771669cbe0 [fix]: PyO3 macOS linking and consolidate on tracing for logging 2025-04-29 11:26:38 -07:00
Simo Lin 1468769bde [Misc] add service discovery for sgl router 2025-04-29 10:21:19 -07:00
Simo Lin f0365820e8 [Misc] add structure logging, write to file and log tracing for SGL Router 2025-04-27 16:54:10 -07:00
Michael Feil 37373ef2bb sgl-router - issues on routing and project build. (#3870) (#3948) 2025-03-04 04:06:30 -08:00
Ata Fatahi e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00