Commit Graph
23 Commits
Author SHA1 Message Date
Chang Su 4229de3b13 [model-gateway] Refine TokenizerRegisty.load() to handle duplication (#17230) 2026-01-16 13:53:21 -08:00
Chang Su a7f5677abe refactor: unify registration through tokenizer_registration workflow (#17187) 2026-01-16 10:53:36 -08:00
jeff.ye c020d30045 [Model-Gateway: grpc]: create tokenizer with chat template (#17052)
Signed-off-by: jeff.ye <jeff.ye@novita.ai>
2026-01-14 17:56:08 -08:00
Ziwen Zhao cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Simo Lin ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Simo Lin fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) 2026-01-12 10:06:36 -08:00
Chang Su b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
Ratish P f02d82211a [model-gateway]: move PD configuration conflict checks to model gateway (#16088) 2026-01-05 14:16:07 +08:00
Chang Su 24c91001cf [model-gateway] code clean up in tokenizer register step workflow (#16316) 2026-01-02 16:05:10 -08:00
Chang Su c4edcac6d7 refactor(core): remove get_by_model_fast alias in worker_registry (#16313) 2026-01-02 16:04:23 -08:00
Chang Su e93433892b refactor(steps): consolidate duplicate strip_protocol function (#16318) 2026-01-02 16:02:42 -08:00
Simo LinandChang Su 162d1cf9be [model-gateway] Add classification model support infrastructure (#16061)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2025-12-29 08:34:05 -08:00
Simo Lin 846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) 2025-12-23 17:32:07 -08:00
Arthur Cheng dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) 2025-12-23 07:58:47 -08:00
shuwenn 1d90b194b2 [model-gateway] bugfix: backward compatibility for GET endpoints (#15413) 2025-12-20 10:37:53 -10:00
Simo Lin 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) 2025-12-15 04:57:42 -08:00
Simo Lin 7b9156c773 [model-gateway] add mcp and discovery metrics (#15156) 2025-12-14 22:54:53 -08:00
Simo Lin fb96669ff9 [model-gateway] Add Layer 3 worker metrics (smg_worker_*) (#15130) 2025-12-14 20:25:46 -08:00
Simo Lin 7d8e42c979 [model-gateway] Fix metric emission gaps and name mismatch (#15093) 2025-12-13 20:16:30 -08:00
Simo Lin fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Simo Lin 9a56273ad2 [model-gateway] refactor: unify worker management into modular workflow structure (#15010) 2025-12-12 15:25:35 -08:00
Simo Lin 306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin 10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00