Simo Lin
|
ed75136e85
|
remove self managed wasm as it has been replaced with official smg wa… (#17746)
|
2026-01-25 22:56:33 -08:00 |
|
 Tony LuandKun
|
5938c3b06a
|
[model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
|
2026-01-13 17:03:39 -08:00 |
|
Praneth Paruchuri
|
bd1afeb568
|
[model-gateway] Restore response streaming by optimizing WASM middleware buffering (#16804)
|
2026-01-09 09:29:22 -08:00 |
|
Simo Lin
|
4436dc0f6c
|
[model-gateway] improve lock contention and allocation in middleware (#16405)
|
2026-01-04 10:40:07 -08:00 |
|
fzyzcjy
|
c88aaf22c7
|
Support in-flight request age metrics for router (#16341)
|
2026-01-04 07:38:53 +08:00 |
|
Chang Su
|
b23e7ed13c
|
refactor(gateway): shorten logging targets from sgl_model_gateway to smg (#16328)
|
2026-01-02 21:12:33 -08:00 |
|
Simo Lin
|
643aeefe6d
|
[model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782)
|
2025-12-24 10:54:48 -08:00 |
|
fzyzcjy
|
d6108166bc
|
Fix smg_http_requests_total semantics (#15655)
|
2025-12-24 17:41:01 +08:00 |
|
Simo Lin
|
ba72e759ca
|
[model-gateway] Improve logging across core modules (#15497)
|
2025-12-19 13:35:28 -08:00 |
|
Simo Lin
|
50cad014dc
|
[model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491)
|
2025-12-19 12:35:50 -08:00 |
|
Simo Lin
|
d747147a26
|
[model-gateway] reduce cpu overhead (#15316)
|
2025-12-17 09:42:01 -08:00 |
|
Simo Lin
|
3518b33178
|
[model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160)
|
2025-12-15 04:57:42 -08:00 |
|
Simo Lin
|
f9bceea064
|
[model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121)
|
2025-12-14 09:39:15 -08:00 |
|
fzyzcjy
|
9a5d6a84ab
|
Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036)
|
2025-12-13 13:28:32 +08:00 |
|
fzyzcjy
|
05325db349
|
Super tiny remove unused log_request (#15035)
|
2025-12-13 13:21:24 +08:00 |
|
fzyzcjy
|
b47adb807e
|
Tiny add e2e http request arrival metric (#14893)
|
2025-12-12 13:18:23 +08:00 |
|
fzyzcjy
|
b2b5bdb06e
|
Tiny add router e2e duration histogram (#14892)
|
2025-12-12 13:18:13 +08:00 |
|
fzyzcjy
|
af20657cd4
|
Tiny support sgl-router http response status code metrics (#14689)
|
2025-12-08 19:54:35 -08:00 |
|
Jimmy
|
6f657070ef
|
[SMG]feat: implement TokenGuardBody for managing token return (#14653)
|
2025-12-08 16:44:46 -08:00 |
|
Simo Lin
|
d69ecc19b8
|
[model-gateway] reducing cpu overhead in various of places (#14658)
|
2025-12-08 09:44:40 -08:00 |
|
Simo Lin
|
2970f22917
|
[model-gateway] fix WASM unbounded request/response body read vuln (#14612)
|
2025-12-07 20:47:25 -08:00 |
|
Simo Lin
|
aff1238ef2
|
[model-gateway] reorganize metrics, logging, and otel to its own module (#14590)
|
2025-12-07 16:50:39 -08:00 |
|
Feng Su
|
e12c6b320f
|
[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)
|
2025-12-06 05:59:04 -08:00 |
|
Simo Lin
|
aed835e32d
|
[model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512)
|
2025-12-05 12:41:48 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|