Commit Graph
13 Commits
Author SHA1 Message Date
Chang Su e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) 2025-11-12 02:29:20 -08:00
Chang Su 2ca25a8aab Revert "fix: display served_model_name in /v1/models" (#13093) 2025-11-11 15:58:46 -08:00
Edmund Suen a06c44f905 fix: display served_model_name in /v1/models (#13063) 2025-11-12 00:13:58 +08:00
syy-hw 611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
wyx 3651cfbf62 [router] fix: validate HTTP status codes in health check (#12631) 2025-11-05 13:37:17 -08:00
Keyang Ru 9288544180 [router] Fix type unmatch during validation (#12257) 2025-10-28 06:04:54 -07:00
Simo Lin d85d6dba3b [router] configure workflow retries and timeout based on routerConfig (#12252) 2025-10-28 00:41:20 -07:00
Simo Lin 212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Simo Lin 5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Simo LinandChang Su dbf17a8313 [router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-23 23:14:09 -07:00
Simo Lin 5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Simo Lin 1111030395 [router] clean up workflow logs to debug for implementation details logs (#11886) 2025-10-20 18:24:55 -07:00
Simo Lin ddcba74b4d [router] Worker Management Workflow Engine (#11868) 2025-10-20 17:00:22 -07:00