Commit Graph

21 Commits

Author SHA1 Message Date
Simo Lin
c31f62722c [model-gateway] fix tokenizer to match transformers special token handling (#16087) 2025-12-29 08:13:03 -08:00
Simo Lin
4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
Simo Lin
caa95c7eb4 [model-gateway] update ManualPolicy with header-based routing (#15847) 2025-12-25 13:04:43 -08:00
fzyzcjy
6ef543f99d Use X-SMG-Routing-Key header instead of json body and add tests (#15826) 2025-12-25 09:58:14 -08:00
fzyzcjy
45adad37d0 Add manual routing policy for router (#15586) 2025-12-25 11:27:36 +08:00
fzyzcjy
1ba897f330 Tiny refactor select_workers API for future passing more information (#15596) 2025-12-25 10:31:10 +08:00
ratish
5f3a47d8a7 [model-gateway]: add gRPC router embeddings endpoint implementation (#15273) 2025-12-23 09:12:22 -08:00
Arthur Cheng
dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) 2025-12-23 07:58:47 -08:00
Simo Lin
e1dcd0df3e [model-gateway] minor code clean up (#15578) 2025-12-21 11:00:32 -10:00
Haoran Wang
ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) 2025-12-21 07:39:24 -10:00
Haoran Wang
26704c23c0 [model-gateway]: Tool parser for glm47 (#15520) 2025-12-20 18:07:51 -10:00
Simo Lin
5529ab5895 [model-gateway] Implement RAII load guard with response body attachment (#15507) 2025-12-19 19:14:52 -08:00
Simo Lin
0adfc42b99 [model-gateway] Optimize workflow engine with pre-computed dependency graph (#15503) 2025-12-19 15:44:57 -08:00
Simo Lin
306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin
10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Simo Lin
8b98bb768c [model-gateway] optimize core modules (#14751) 2025-12-09 10:54:07 -08:00
Simo Lin
edde5e5d40 [model-gateway] add OTEL integration to grpc router (#14671) 2025-12-08 14:45:05 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00