Commit Graph
14 Commits
Author SHA1 Message Date
Simo Lin 0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Simo Lin 46bc53a81b [smg] import db crate to replace self managed one (#17727) 2026-01-25 16:54:52 -08:00
Ziwen Zhao cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Tony LuandKun 5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
2026-01-13 17:03:39 -08:00
Simo Lin ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
fzyzcjy c88aaf22c7 Support in-flight request age metrics for router (#16341) 2026-01-04 07:38:53 +08:00
Arthur Cheng dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) 2025-12-23 07:58:47 -08:00
Simo Lin 1354063a48 [model-gateway] add WorkerService abstraction for worker business logic (#15580) 2025-12-21 14:35:35 -08:00
Simo Lin 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) 2025-12-15 04:57:42 -08:00
Simo Lin 7b9156c773 [model-gateway] add mcp and discovery metrics (#15156) 2025-12-14 22:54:53 -08:00
Simo Lin 0fa044ad63 [model-gateway] Add circuit breaker and discovery watcher metrics (#15094) 2025-12-13 20:47:04 -08:00
Simo Lin 7d8e42c979 [model-gateway] Fix metric emission gaps and name mismatch (#15093) 2025-12-13 20:16:30 -08:00
fzyzcjy cb4cdb43a4 Fix dp-aware incompatible with service-discovery (#14629) 2025-12-08 06:39:27 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00