Commit Graph
18 Commits
Author SHA1 Message Date
Simo Lin 388151053d [model-gateway] use worker crate in openai router (#14330) 2025-12-03 13:36:32 -08:00
Simo Lin 5dad1ff1b6 [model-gateway] add workflow for external model providers (#14323) 2025-12-02 16:47:06 -08:00
Simo Lin 57f933fd7d [model-gateway] Migrate Worker trait to model-aware methods (#14250) 2025-12-01 14:32:09 -08:00
Simo Lin 9188feccca [model-gateway] use worker startup time out for worker registration (#13473) 2025-11-17 19:28:21 -08:00
Edmund Suen c2d69e8b56 fix: display served_model_name in /v1/models (#13155) 2025-11-13 17:07:55 +09:00
Chang Su e5e65e3d2a [router][grpc] Support vllm backend for grpc router (#13120) 2025-11-12 02:29:20 -08:00
Chang Su 2ca25a8aab Revert "fix: display served_model_name in /v1/models" (#13093) 2025-11-11 15:58:46 -08:00
Edmund Suen a06c44f905 fix: display served_model_name in /v1/models (#13063) 2025-11-12 00:13:58 +08:00
syy-hw 611a4fd08b [router] bucket policy (#11719) 2025-11-10 02:02:53 -08:00
wyx 3651cfbf62 [router] fix: validate HTTP status codes in health check (#12631) 2025-11-05 13:37:17 -08:00
Keyang Ru 9288544180 [router] Fix type unmatch during validation (#12257) 2025-10-28 06:04:54 -07:00
Simo Lin d85d6dba3b [router] configure workflow retries and timeout based on routerConfig (#12252) 2025-10-28 00:41:20 -07:00
Simo Lin 212f5e4822 [router] MCP Manager Refactoring - Flat Architecture with Connection Pooling (#12097) 2025-10-25 21:26:28 -07:00
Simo Lin 5983e5bd1b [router] migrate app context to builder pattern 1/n (#12086) 2025-10-24 13:35:22 -07:00
Simo LinandChang Su dbf17a8313 [router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-10-23 23:14:09 -07:00
Simo Lin 5dccf69713 [router] create worker removal step and clean up worker manager (#11921) 2025-10-22 13:26:06 -07:00
Simo Lin 1111030395 [router] clean up workflow logs to debug for implementation details logs (#11886) 2025-10-20 18:24:55 -07:00
Simo Lin ddcba74b4d [router] Worker Management Workflow Engine (#11868) 2025-10-20 17:00:22 -07:00