Simo Lin aa6ac96635 [model-gateway] Fix tokenizer caching and improve error handling (#15695)

2025-12-23 10:33:38 -08:00

..

conversations

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

grpc

[model-gateway] Fix tokenizer caching and improve error handling (#15695)

2025-12-23 10:33:38 -08:00

http

Tiny add back missing router per attempt response metric (#15621)

2025-12-22 09:59:10 -08:00

openai

[model-gateway] return 503 when all workers are circuit-broken (#15611)

2025-12-22 04:06:09 -10:00

parse

[model-gateway] minor code clean up (#15578)

2025-12-21 11:00:32 -10:00

error.rs

[model-gateway] Simplify error response creation (#15079)

2025-12-13 10:28:24 -08:00

factory.rs

[model-gateway] change sgl-router to sgl-model-gateway (#14312)

2025-12-05 12:04:48 -08:00

header_utils.rs

[model-gateway] reducing cpu overhead in various of places (#14658)

2025-12-08 09:44:40 -08:00

mod.rs

[model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568)

2025-12-21 07:39:24 -10:00

router_manager.rs

[model-gateway] Optimize router selection with lock-free snapshots (#15672)

2025-12-23 09:09:30 -08:00