Simo Lin 3645ed0f73 [model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

..

conversations

…

grpc

[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

http

[model-gateway] Add PrefixHash load balancing policy for KV cache-aware routing (#15935)

2025-12-27 05:58:05 -05:00

openai

[model-gateway] return 503 when all workers are circuit-broken (#15611)

2025-12-22 04:06:09 -10:00

parse

[model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782)

2025-12-24 10:54:48 -08:00

tokenize

[model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702)

2025-12-23 17:32:07 -08:00

error.rs

[model-gateway] Simplify error response creation (#15079)

2025-12-13 10:28:24 -08:00

factory.rs

[model-gateway] Fix IGW routing and optimize RouterManager (#15741)

2025-12-24 11:28:53 -05:00

header_utils.rs

[model-gateway] update ManualPolicy with header-based routing (#15847)

2025-12-25 13:04:43 -08:00

mod.rs

[model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782)

2025-12-24 10:54:48 -08:00

router_manager.rs

[model-gateway] Fix IGW routing and optimize RouterManager (#15741)

2025-12-24 11:28:53 -05:00