Commit Graph

14 Commits

Author SHA1 Message Date
Simo Lin
0ff3747ca1 [model-gateway]: move unit tests to bindings/python/tests/ (#16430) 2026-01-04 18:10:35 -08:00
Chang Su
d8ac5eecf7 [model-gateway] bug fix on module name (#16332) 2026-01-02 21:56:18 -08:00
fzyzcjy
00562ee14a Support cache eviction for Manual Policy (#16263) 2026-01-02 08:52:01 +08:00
Simo Lin
3645ed0f73 [model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935) 2025-12-27 05:58:05 -05:00
Simo Lin
171912a9e3 [model-gateway] Add consistent hashing for ManualPolicy routing (#15907) 2025-12-26 22:53:03 -08:00
Simo Lin
4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
fzyzcjy
45adad37d0 Add manual routing policy for router (#15586) 2025-12-25 11:27:36 +08:00
Simo Lin
50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
ratish
0e4108ba29 feat(gateway): Add server-side TLS support (#15052) 2025-12-14 15:37:55 -08:00
fzyzcjy
617e9b3bf8 [model-gateway] support customizing Prometheus duration buckets (#14716) 2025-12-10 08:30:03 -08:00
Wenyi Xu
d7f6320bb8 [model-gateway] Dynamically Populate Tool Call Parser Choices (#14807) 2025-12-10 06:04:22 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00