Commit Graph
14 Commits
Author SHA1 Message Date
fzyzcjy ba88f1cace Tiny clean router load report logic (#14889) 2025-12-11 06:50:32 -08:00
Simo Lin bcc5483ed7 [model-gateway] fix import order in oai conversation (#14851) 2025-12-10 15:36:42 -08:00
Simo Lin ccf2602773 [model-gateway] code clean up on oai router (#14850) 2025-12-10 15:34:27 -08:00
Simo Lin c032b559a8 [model-gateway] adds default implementations to RouterTrait in mod.rs (#14841) 2025-12-10 11:46:35 -08:00
fzyzcjy 3d82c0f17f [model-gateway] support engine response http status statistics in router (#14712) 2025-12-10 08:30:53 -08:00
Simo Lin edde5e5d40 [model-gateway] add OTEL integration to grpc router (#14671) 2025-12-08 14:45:05 -08:00
Simo Lin 8550822d6b [model-gateway] Optimize memory usage in HTTP router (#14667) 2025-12-08 13:10:31 -08:00
Simo Lin 39f9a9c2a5 [model-gateway] reduce cpu overhead in grpc router (#14663) 2025-12-08 11:54:56 -08:00
Simo Lin d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) 2025-12-08 09:44:40 -08:00
Simo Lin 8fbf7dd56f [model-gateway] refactor otel to be more efficient (#14604) 2025-12-07 20:09:25 -08:00
Simo Lin aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Simo Lin b0bbc7f53d [model-gateway] extra accumulator and tool handler in oai router (#14587) 2025-12-07 15:52:12 -08:00
Feng Su e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00