Commit Graph
13 Commits
Author SHA1 Message Date
Chang Su d8ac5eecf7 [model-gateway] bug fix on module name (#16332) 2026-01-02 21:56:18 -08:00
fzyzcjy 00562ee14a Support cache eviction for Manual Policy (#16263) 2026-01-02 08:52:01 +08:00
Simo Lin 9884c9fd4c [model-gateway] Organize Rust CLI arguments into logical groups for better --help output (#16036) 2025-12-28 20:25:38 -08:00
Simo Lin 3645ed0f73 [model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935) 2025-12-27 05:58:05 -05:00
Simo Lin 4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
Simo Lin caa95c7eb4 [model-gateway] update ManualPolicy with header-based routing (#15847) 2025-12-25 13:04:43 -08:00
Arthur Cheng f65fa04748 [model-gateway]Enable IGW mode with gRPC router and auto enable IGW when service discovery is turned on (#15459) 2025-12-24 00:27:58 -08:00
Simo Lin 50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
ratish 0e4108ba29 feat(gateway): Add server-side TLS support (#15052) 2025-12-14 15:37:55 -08:00
fzyzcjy 617e9b3bf8 [model-gateway] support customizing Prometheus duration buckets (#14716) 2025-12-10 08:30:03 -08:00
Simo Lin aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00