Commit Graph

17 Commits

Author SHA1 Message Date
Simo Lin
8550822d6b [model-gateway] Optimize memory usage in HTTP router (#14667) 2025-12-08 13:10:31 -08:00
Simo Lin
7bf16c6339 [model-gateway] fix WASM arbitrary file read security vol (#14664) 2025-12-08 12:11:16 -08:00
Simo Lin
39f9a9c2a5 [model-gateway] reduce cpu overhead in grpc router (#14663) 2025-12-08 11:54:56 -08:00
Simo Lin
d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) 2025-12-08 09:44:40 -08:00
fzyzcjy
cb4cdb43a4 Fix dp-aware incompatible with service-discovery (#14629) 2025-12-08 06:39:27 -08:00
Simo Lin
2970f22917 [model-gateway] fix WASM unbounded request/response body read vuln (#14612) 2025-12-07 20:47:25 -08:00
fzyzcjy
c08b780fe0 Super tiny remove unused select_worker_pair (#14609) 2025-12-07 20:32:38 -08:00
Simo Lin
8fbf7dd56f [model-gateway] refactor otel to be more efficient (#14604) 2025-12-07 20:09:25 -08:00
fzyzcjy
85d0ccfac0 Tiny fix missing policy decision recording (#14605) 2025-12-07 19:24:27 -08:00
Simo Lin
a4ffd665c0 [model-gateway] fix WASM memory limit per module (#14600) 2025-12-07 19:15:19 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Simo Lin
5e2cda6158 [model-gateway] Fixed WASM Security Vulnerability - Execution Timeout (#14588) 2025-12-07 16:05:53 -08:00
Simo Lin
b0bbc7f53d [model-gateway] extra accumulator and tool handler in oai router (#14587) 2025-12-07 15:52:12 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
09376fd738 [model-gateway] fix logs in smg workflow (#14513) 2025-12-05 12:50:50 -08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00