Commit Graph
15 Commits
Author SHA1 Message Date
Simo Lin f2d5c4920e [router] add worker abstraction (#7960) 2025-07-11 20:17:48 -07:00
Shuaiyi Zhang 7590f5224b [router] Update metrics when request completes (#7899) 2025-07-09 08:18:09 -07:00
finetune b3cff3651e Fix sgl-router startup crash (#7619) 2025-06-29 14:41:34 -07:00
Simo Lin 30f2a44a96 [misc] Add PD service discovery support in router (#7361) 2025-06-22 17:54:14 -07:00
Simo Lin 09ae5b20f3 Merge PDLB (Prefill-Decode Load Balancer) into SGLang Router (#7096) 2025-06-19 02:28:15 +08:00
Chao Yang 1a39979993 Sgl-router Prometheus metrics endpoint and usage track metrics (#6537) 2025-05-24 22:28:15 -07:00
Simo Lin 771669cbe0 [fix]: PyO3 macOS linking and consolidate on tracing for logging 2025-04-29 11:26:38 -07:00
Simo Lin 1468769bde [Misc] add service discovery for sgl router 2025-04-29 10:21:19 -07:00
Byron Hsu 8cc300f536 Fix router test (#4483) 2025-03-16 22:49:47 -07:00
Michael Feil 37373ef2bb sgl-router - issues on routing and project build. (#3870) (#3948) 2025-03-04 04:06:30 -08:00
Byron Hsu 9a0cc2e90e [router] Forward all request headers from router to workers (#3070) 2025-01-23 20:30:31 -08:00
Byron Hsu 5de50653cd [router] make error actionable (#3063) 2025-01-22 17:56:21 -08:00
Byron Hsu 3a8428ecaa [router] Expose worker startup interval (#3019) 2025-01-20 14:36:54 -08:00
Byron Hsu 0311ce8e1c [router] Expose worker startup secs & Return error instead of panic for router init (#3016) 2025-01-20 12:45:13 -08:00
Ata Fatahi e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00