fzyzcjy 00562ee14a Support cache eviction for Manual Policy (#16263)

2026-01-02 08:52:01 +08:00

..

__init__.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

__main__.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

cli.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

launch_router.py

[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)

2025-12-06 05:59:04 -08:00

launch_server.py

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

mini_lb.py

[Bug fix] Add /model_info endpoint to mini_lb (#14535)

2025-12-06 11:34:03 -08:00

router_args.py

Support cache eviction for Manual Policy (#16263)

2026-01-02 08:52:01 +08:00

router.py

[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

version.py

[model-gateway] release smg 0.3.0 (#15781)

2025-12-24 13:23:57 -08:00