Commit Graph
12 Commits
Author SHA1 Message Date
jeff.ye c020d30045 [Model-Gateway: grpc]: create tokenizer with chat template (#17052)
Signed-off-by: jeff.ye <jeff.ye@novita.ai>
2026-01-14 17:56:08 -08:00
Ziwen Zhao cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Simo Lin ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Simo Lin fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) 2026-01-12 10:06:36 -08:00
Simo Lin 846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) 2025-12-23 17:32:07 -08:00
Simo Lin 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) 2025-12-15 04:57:42 -08:00
Simo Lin 74ea45cc4b [model-gateway] optimize metric labels to avoid unnecessary allocations (#15095) 2025-12-13 21:10:45 -08:00
Simo Lin fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Simo Lin 9a56273ad2 [model-gateway] refactor: unify worker management into modular workflow structure (#15010) 2025-12-12 15:25:35 -08:00
Simo Lin 10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Simo Lin aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00