Commit Graph

49 Commits

Author SHA1 Message Date
Simo Lin
0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Simo Lin
ac16d4450e [smg][mesh] extract mesh to mesh crate to reduce compile time (#17907) 2026-01-28 17:58:42 -08:00
Simo Lin
6756cf18c6 remove multimodal as this is completely dead code (#17750) 2026-01-26 00:07:40 -08:00
Simo Lin
ed75136e85 remove self managed wasm as it has been replaced with official smg wa… (#17746) 2026-01-25 22:56:33 -08:00
Simo Lin
52d0ca944b [smg] import official wfaas crate to replace self managed one (#17724) 2026-01-25 15:20:58 -08:00
Simo Lin
97a36a72b7 [smg] remove dead tokenizer code (#17722) 2026-01-25 14:04:48 -08:00
Simo Lin
2c1e2674cc [misc] replace existing tool call code with new crate package (#17720) 2026-01-25 13:07:39 -08:00
fzyzcjy
9c2530642c Change routing policy API to be async to support more policies (#17048) 2026-01-17 17:12:51 +08:00
fzyzcjy
a7b5f75d88 Support integration tests with Redis binary (#17045) 2026-01-17 11:59:04 +08:00
Ziwen Zhao
cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Tony Lu
5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
2026-01-13 17:03:39 -08:00
fzyzcjy
ff3ddb9d9b Support min num routing keys in key-based load balancing policy (#16564) 2026-01-12 21:38:03 -08:00
fzyzcjy
9d3018f484 Support min load besides random routing key assignment policy in ManualPolicy (#16767) 2026-01-12 18:31:18 -08:00
fzyzcjy
1f0e3d7fd8 Support tracking worker routing key loads in gateway (#16765) 2026-01-13 08:07:17 +08:00
Simo Lin
e0ac559ae1 feat(workflow): add scheduled/delayed steps and conditional branching (#16980) 2026-01-12 15:06:12 -08:00
Simo Lin
6620548fd8 [model-gateway] make StateStore trait async for external persistence (#16979) 2026-01-12 12:55:59 -08:00
Simo Lin
6e158e55b4 [model-gateway] improve workflow engine code quality (#16977) 2026-01-12 12:14:46 -08:00
Simo Lin
ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Simo Lin
fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) 2026-01-12 10:06:36 -08:00
ybyang
503c3d9566 [model-gateway]: add qwen coder tool parser support xml format for qwen3 coder and microthinker (#12909) 2026-01-11 16:09:41 -08:00
fzyzcjy
9e3a032ad6 [smg] cleanup router RAII guards (#16560) 2026-01-08 16:39:53 -08:00
Chang Su
b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
fzyzcjy
1e41069ad1 Fix age bucket rendering issue (#16492) 2026-01-05 09:29:14 -08:00
Simo Lin
e53160bb31 [model-gateway] reorganize integration tests into logical subdirectories (#16451) 2026-01-04 21:49:20 -08:00
Simo Lin
f84487af59 [model-gateway] : Rust integration tests for integration_mock replacement (#16441) 2026-01-04 21:01:47 -08:00
fzyzcjy
c88aaf22c7 Support in-flight request age metrics for router (#16341) 2026-01-04 07:38:53 +08:00
fzyzcjy
877c8e3a96 Tiny refactor router test contexts (#16340) 2026-01-03 09:44:10 -08:00
Chang Su
d8ac5eecf7 [model-gateway] bug fix on module name (#16332) 2026-01-02 21:56:18 -08:00
Simo Lin
c31f62722c [model-gateway] fix tokenizer to match transformers special token handling (#16087) 2025-12-29 08:13:03 -08:00
Simo Lin
4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
Simo Lin
caa95c7eb4 [model-gateway] update ManualPolicy with header-based routing (#15847) 2025-12-25 13:04:43 -08:00
fzyzcjy
6ef543f99d Use X-SMG-Routing-Key header instead of json body and add tests (#15826) 2025-12-25 09:58:14 -08:00
fzyzcjy
45adad37d0 Add manual routing policy for router (#15586) 2025-12-25 11:27:36 +08:00
fzyzcjy
1ba897f330 Tiny refactor select_workers API for future passing more information (#15596) 2025-12-25 10:31:10 +08:00
ratish
5f3a47d8a7 [model-gateway]: add gRPC router embeddings endpoint implementation (#15273) 2025-12-23 09:12:22 -08:00
Arthur Cheng
dd620987d1 [model-gateway] Replace tokenizer with tokenizer registry for dynamic tokenizer loading in gRPC router (#12968) 2025-12-23 07:58:47 -08:00
Simo Lin
e1dcd0df3e [model-gateway] minor code clean up (#15578) 2025-12-21 11:00:32 -10:00
Haoran Wang
ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) 2025-12-21 07:39:24 -10:00
Haoran Wang
26704c23c0 [model-gateway]: Tool parser for glm47 (#15520) 2025-12-20 18:07:51 -10:00
Simo Lin
5529ab5895 [model-gateway] Implement RAII load guard with response body attachment (#15507) 2025-12-19 19:14:52 -08:00
Simo Lin
0adfc42b99 [model-gateway] Optimize workflow engine with pre-computed dependency graph (#15503) 2025-12-19 15:44:57 -08:00
Simo Lin
306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin
10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Simo Lin
8b98bb768c [model-gateway] optimize core modules (#14751) 2025-12-09 10:54:07 -08:00
Simo Lin
edde5e5d40 [model-gateway] add OTEL integration to grpc router (#14671) 2025-12-08 14:45:05 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
aed835e32d [model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512) 2025-12-05 12:41:48 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00