Commit Graph

16 Commits

Author SHA1 Message Date
Simo Lin
41a1d16b02 [model-gateway] Organize CLI arguments into logical groups for better --help output (#16035)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-28 20:25:53 -08:00
Simo Lin
3645ed0f73 [model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935) 2025-12-27 05:58:05 -05:00
Simo Lin
171912a9e3 [model-gateway] Add consistent hashing for ManualPolicy routing (#15907) 2025-12-26 22:53:03 -08:00
Simo Lin
4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
fzyzcjy
45adad37d0 Add manual routing policy for router (#15586) 2025-12-25 11:27:36 +08:00
Simo Lin
5454d2a7ae [model-gateway] release smg 0.3.0 (#15781) 2025-12-24 13:23:57 -08:00
Simo Lin
50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
ratish
0e4108ba29 feat(gateway): Add server-side TLS support (#15052) 2025-12-14 15:37:55 -08:00
fzyzcjy
617e9b3bf8 [model-gateway] support customizing Prometheus duration buckets (#14716) 2025-12-10 08:30:03 -08:00
Wenyi Xu
d7f6320bb8 [model-gateway] Dynamically Populate Tool Call Parser Choices (#14807) 2025-12-10 06:04:22 -08:00
Simo Lin
390406c46c [model-gateway] release gateway 0.2.4 (#14763) 2025-12-09 16:34:29 -08:00
fzyzcjy
a2ca9bd4f1 Super tiny fix unused code in router (#14618) 2025-12-07 23:12:09 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Alison Shao
cee93a6f26 [Bug fix] Add /model_info endpoint to mini_lb (#14535) 2025-12-06 11:34:03 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00