Commit Graph

16 Commits

Author SHA1 Message Date
Simo Lin
9a56273ad2 [model-gateway] refactor: unify worker management into modular workflow structure (#15010) 2025-12-12 15:25:35 -08:00
Simo Lin
306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin
10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
JinYan Su
22fe5da13e Fix negative duration panic in token bucket wait time calculation (#14941)
Signed-off-by: xiaguan <751080330@qq.com>
2025-12-11 21:16:47 -08:00
Praneth Paruchuri
1834401e7c [model-gateway] optimize worker selection (#14894) 2025-12-11 21:15:12 -08:00
Simo Lin
6f99dc97f7 [model-gateway] fix imports and delete unused code (#14911) 2025-12-11 07:42:47 -08:00
Simo Lin
cd1c1fa5bc [model-gateway] fix annotation error and code formating (#14910) 2025-12-11 07:06:32 -08:00
fzyzcjy
60560c07a2 [model-gateway] refactor cleanup WorkflowContext.get_or_err (#14890) 2025-12-11 06:48:30 -08:00
Simo Lin
2543666c8e [model-gateway] add anthropic message api spec (#14834) 2025-12-10 08:26:51 -08:00
fzyzcjy
6634f67bd5 Fix router keep nonzero metrics after worker is deleted (#14819) 2025-12-10 22:29:30 +08:00
Simo Lin
8b98bb768c [model-gateway] optimize core modules (#14751) 2025-12-09 10:54:07 -08:00
Simo Lin
7bf16c6339 [model-gateway] fix WASM arbitrary file read security vol (#14664) 2025-12-08 12:11:16 -08:00
Simo Lin
d69ecc19b8 [model-gateway] reducing cpu overhead in various of places (#14658) 2025-12-08 09:44:40 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Simo Lin
09376fd738 [model-gateway] fix logs in smg workflow (#14513) 2025-12-05 12:50:50 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00