Commit Graph

33 Commits

Author SHA1 Message Date
Jonathan Lee
e58391dd7d Add --json-log flag to enable structured JSON logging (#19968)
Co-authored-by: github_username <github_email>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-05 11:24:12 -08:00
Simo Lin
0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Simo Lin
ac16d4450e [smg][mesh] extract mesh to mesh crate to reduce compile time (#17907) 2026-01-28 17:58:42 -08:00
Chang Su
4229de3b13 [model-gateway] Refine TokenizerRegisty.load() to handle duplication (#17230) 2026-01-16 13:53:21 -08:00
Chang Su
a7f5677abe refactor: unify registration through tokenizer_registration workflow (#17187) 2026-01-16 10:53:36 -08:00
Ziwen Zhao
cf25852a1d [model-gateway] add --disable-health-check option to skip worker health probes (#17002) 2026-01-13 17:28:32 -08:00
Tony Lu
5938c3b06a [model-gateway] HA - Lightweight State Layer + gRPC Mesh (#14108)
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
2026-01-13 17:03:39 -08:00
Simo Lin
ed729d22b3 [model-gateway] refactor workflow engine from type erasure to typed engines (#16973) 2026-01-12 10:47:00 -08:00
Simo Lin
fa51b85466 [model-gateway] convert workflow system to type-safe workflow data (#16970) 2026-01-12 10:06:36 -08:00
Chang Su
b98bd9a5fb [model-gateway] Tighten visibility in modules and remove unused re-exports (#16524) 2026-01-05 17:38:50 -08:00
fzyzcjy
c88aaf22c7 Support in-flight request age metrics for router (#16341) 2026-01-04 07:38:53 +08:00
Chang Su
b23e7ed13c refactor(gateway): shorten logging targets from sgl_model_gateway to smg (#16328) 2026-01-02 21:12:33 -08:00
Ratish P
2af955e16c [model-gateway]: remove unnecessary comment (#15947) 2025-12-27 13:33:02 -05:00
Ratish P
ca740a41f3 [model-gateway]: fix grpc embedding test (#15934) 2025-12-27 05:56:54 -05:00
Simo Lin
4edee6954a [model-gateway] add JWT/OIDC authentication for control plane APIs (#15850) 2025-12-26 18:30:00 -08:00
Simo Lin
643aeefe6d [model-gateway] Fix logging module name, parse endpoint context, and tokenizer factory (#15782) 2025-12-24 10:54:48 -08:00
Simo Lin
846953d9f1 [model-gateway] Add tokenize/detokenize HTTP endpoints and tokenizer management (#15702) 2025-12-23 17:32:07 -08:00
Simo Lin
b9d786059f [model-gateway] refactor WorkerManager with fan_out helper and thin handlers (#15583) 2025-12-21 15:29:37 -08:00
Simo Lin
1354063a48 [model-gateway] add WorkerService abstraction for worker business logic (#15580) 2025-12-21 14:35:35 -08:00
Simo Lin
e1dcd0df3e [model-gateway] minor code clean up (#15578) 2025-12-21 11:00:32 -10:00
shuwenn
1d9ba2ce4d [model-gateway] Use UUIDs for router-managed worker resources (#15540) 2025-12-21 07:40:03 -10:00
Haoran Wang
ef001fb811 [model-gateway] /parse/easoning and parse/function_call for sgl-model-gateway (#15568) 2025-12-21 07:39:24 -10:00
Simo Lin
ba72e759ca [model-gateway] Improve logging across core modules (#15497) 2025-12-19 13:35:28 -08:00
Simo Lin
d72e908ba5 [model-gateway] refactor: extract common graceful shutdown code before TLS branch (#15494) 2025-12-19 12:56:33 -08:00
Simo Lin
50cad014dc [model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491) 2025-12-19 12:35:50 -08:00
ratish
0e4108ba29 feat(gateway): Add server-side TLS support (#15052) 2025-12-14 15:37:55 -08:00
Simo Lin
f9bceea064 [model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121) 2025-12-14 09:39:15 -08:00
Simo Lin
fd37cc5d38 [model-gateway] Refactor worker steps and add update workflow (#15085) 2025-12-13 15:00:16 -08:00
Simo Lin
306e5b8d0b [model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999) 2025-12-12 08:31:12 -08:00
Simo Lin
10c68f6236 [model-gateway] refactor: extract workflow engine to src/workflow module (#14996) 2025-12-12 06:29:12 -08:00
Simo Lin
aff1238ef2 [model-gateway] reorganize metrics, logging, and otel to its own module (#14590) 2025-12-07 16:50:39 -08:00
Feng Su
e12c6b320f [model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897) 2025-12-06 05:59:04 -08:00
Simo Lin
49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00