Simo Lin 3645ed0f73 [model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

..

__init__.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

__main__.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

cli.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

launch_router.py

[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)

2025-12-06 05:59:04 -08:00

launch_server.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

mini_lb.py

[Bug fix] Add /model_info endpoint to mini_lb (#14535)

2025-12-06 11:34:03 -08:00

router_args.py

[model-gateway] add JWT/OIDC authentication for control plane APIs (#15850)

2025-12-26 18:30:00 -08:00

router.py

[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

version.py

[model-gateway] release smg 0.3.0 (#15781)

2025-12-24 13:23:57 -08:00