Commit Graph
16 Commits
Author SHA1 Message Date
Simo Lin b9d786059f [model-gateway] refactor WorkerManager with fan_out helper and thin handlers (#15583) 2025-12-21 15:29:37 -08:00
Simo Lin 1354063a48 [model-gateway] add WorkerService abstraction for worker business logic (#15580) 2025-12-21 14:35:35 -08:00
Simo Lin e1dcd0df3e [model-gateway] minor code clean up (#15578) 2025-12-21 11:00:32 -10:00
shuwenn 1d9ba2ce4d [model-gateway] Use UUIDs for router-managed worker resources (#15540) 2025-12-21 07:40:03 -10:00
Haoran Wang ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) 2025-12-21 07:39:24 -10:00
Simo Lin ba72e759ca [model-gateway] Improve logging across core modules (#15497) 2025-12-19 13:35:28 -08:00
Simo Lin d72e908ba5 [model-gateway] refactor: extract common graceful shutdown code before TLS branch (#15494) 2025-12-19 12:56:33 -08:00
Simo Lin 50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
ratish 0e4108ba29 feat(gateway): Add server-side TLS support (#15052) 2025-12-14 15:37:55 -08:00
Simo Lin f9bceea064 [model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121) 2025-12-14 09:39:15 -08:00
Simo Lin fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Simo Lin 306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin 10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Simo Lin aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00