Commit Graph
25 Commits
Author SHA1 Message Date
Simo Lin ed75136e85 remove self managed wasm as it has been replaced with official smg wa… (#17746) 2026-01-25 22:56:33 -08:00
Tony LuandKun 5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
2026-01-13 17:03:39 -08:00
Praneth Paruchuri bd1afeb568 [model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804) 2026-01-09 09:29:22 -08:00
Simo Lin 4436dc0f6c [model-gateway] improve lock contention and allocation in middleware (#16405) 2026-01-04 10:40:07 -08:00
fzyzcjy c88aaf22c7 Support in-flight request age metrics for router (#16341) 2026-01-04 07:38:53 +08:00
Chang Su b23e7ed13c refactor(gateway): shorten logging targets from sgl_model_gateway to smg (#16328) 2026-01-02 21:12:33 -08:00
Simo Lin 643aeefe6d [model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782) 2025-12-24 10:54:48 -08:00
fzyzcjy d6108166bc Fix smg_http_requests_total semantics (#15655) 2025-12-24 17:41:01 +08:00
Simo Lin ba72e759ca [model-gateway] Improve logging across core modules (#15497) 2025-12-19 13:35:28 -08:00
Simo Lin 50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
Simo Lin d747147a26 [model-gateway] reduce cpu overhead (#15316) 2025-12-17 09:42:01 -08:00
Simo Lin 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) 2025-12-15 04:57:42 -08:00
Simo Lin f9bceea064 [model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121) 2025-12-14 09:39:15 -08:00
fzyzcjy 9a5d6a84ab Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036) 2025-12-13 13:28:32 +08:00
fzyzcjy 05325db349 Super tiny remove unused log_request (#15035) 2025-12-13 13:21:24 +08:00
fzyzcjy b47adb807e Tiny add e2e http request arrival metric (#14893) 2025-12-12 13:18:23 +08:00
fzyzcjy b2b5bdb06e Tiny add router e2e duration histogram (#14892) 2025-12-12 13:18:13 +08:00
fzyzcjy af20657cd4 Tiny support sgl-router http response status code metrics (#14689) 2025-12-08 19:54:35 -08:00
Jimmy 6f657070ef [SMG]feat: implement TokenGuardBody for managing token return (#14653) 2025-12-08 16:44:46 -08:00
Simo Lin d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) 2025-12-08 09:44:40 -08:00
Simo Lin 2970f22917 [model-gateway] fix WASM unbounded request/response body read vuln (#14612) 2025-12-07 20:47:25 -08:00
Simo Lin aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00