Haoran Wang
|
26704c23c0
|
[model-gateway]: Tool parser for glm47 (#15520)
|
2025-12-20 18:07:51 -10:00 |
|
shuwenn
|
1d90b194b2
|
[model-gateway] bugfix: backward compatibility for GET endpoints (#15413)
|
2025-12-20 10:37:53 -10:00 |
|
Praneth Paruchuri
|
537ef18d17
|
[model-gateway] Optimize WASM Runtime with Instance Pooling and Component Caching (#15515)
|
2025-12-20 10:27:02 -10:00 |
|
Simo Lin
|
5529ab5895
|
[model-gateway] Implement RAII load guard with response body attachment (#15507)
|
2025-12-19 19:14:52 -08:00 |
|
kun-llfl
|
3c116d5e5a
|
[router] bugfix: cache_aware in grpc inbalance forward (#15473)
Signed-off-by: Kun(llfl) <i@imux.top>
|
2025-12-19 16:25:46 -08:00 |
|
Simo Lin
|
71a602883a
|
[model-gateway] simplify workflow engine backoff and reduce duplicate reads (#15505)
|
2025-12-19 16:23:02 -08:00 |
|
Simo Lin
|
61405b3d00
|
[model-gateway] Run workflow event subscribers concurrently (#15504)
|
2025-12-19 15:49:51 -08:00 |
|
Simo Lin
|
0adfc42b99
|
[model-gateway] Optimize workflow engine with pre-computed dependency graph (#15503)
|
2025-12-19 15:44:57 -08:00 |
|
Simo Lin
|
ba72e759ca
|
[model-gateway] Improve logging across core modules (#15497)
|
2025-12-19 13:35:28 -08:00 |
|
Simo Lin
|
bd16244d93
|
[model-gateway] Improve logging in policies module (#15496)
|
2025-12-19 13:02:57 -08:00 |
|
Simo Lin
|
b5eb0214ca
|
[model-gateway] Improve logging in data_connector module (#15495)
|
2025-12-19 12:57:18 -08:00 |
|
Simo Lin
|
d72e908ba5
|
[model-gateway] refactor: extract common graceful shutdown code before TLS branch (#15494)
|
2025-12-19 12:56:33 -08:00 |
|
Simo Lin
|
50cad014dc
|
[model-gateway] fix graceful shutdown for TLS/Non-TLS server (#15491)
|
2025-12-19 12:35:50 -08:00 |
|
Simo Lin
|
70607e55e8
|
[model-gateway] Replace PolicyRegistry RwLock with DashMap for lock-free policy lookups (#15361)
|
2025-12-18 00:11:20 -08:00 |
|
Simo Lin
|
53e151945a
|
[model-gateway] optimize worker registry and reduce lock contention in grpc client fetch (#15336)
|
2025-12-17 08:49:10 -10:00 |
|
Simo Lin
|
d747147a26
|
[model-gateway] reduce cpu overhead (#15316)
|
2025-12-17 09:42:01 -08:00 |
|
fzyzcjy
|
c4aed389da
|
Super tiny rename failure_count for consistency (#15186)
|
2025-12-17 21:21:07 +08:00 |
|
Simo Lin
|
3518b33178
|
[model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160)
|
2025-12-15 04:57:42 -08:00 |
|
fzyzcjy
|
89ad390843
|
Fix num running requests (load) wrong cleared for ongoing requests (#15116)
|
2025-12-15 17:40:04 +08:00 |
|
Simo Lin
|
7b9156c773
|
[model-gateway] add mcp and discovery metrics (#15156)
|
2025-12-14 22:54:53 -08:00 |
|
Simo Lin
|
bd9c3a47d6
|
[model-gateway] Add streaming metrics for harmony gRPC router (#15147)
|
2025-12-14 20:54:43 -08:00 |
|
Simo Lin
|
fb96669ff9
|
[model-gateway] Add Layer 3 worker metrics (smg_worker_*) (#15130)
|
2025-12-14 20:25:46 -08:00 |
|
fzyzcjy
|
62b3fdae43
|
Fix cache aware wrong routing caused by incorrect load tracking (#15101)
|
2025-12-15 10:03:54 +08:00 |
|
fzyzcjy
|
4449c17011
|
[model-gateway] fix circuit breaker metrics (#15099)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-14 15:43:04 -08:00 |
|
fzyzcjy
|
5ca962ce7f
|
[model-gateway] extract circuit breaker state struct (#15098)
|
2025-12-14 15:40:23 -08:00 |
|
Praneth Paruchuri
|
bab20a849e
|
[model-gateway] Parallelize metrics requests (#14953)
|
2025-12-14 15:38:45 -08:00 |
|
ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|
Simo Lin
|
0612175ce1
|
[model-gateway] add streaming metrics (TTFT, TPOT, tokens, duration) for gRPC router (#15125)
|
2025-12-14 14:39:10 -08:00 |
|
Simo Lin
|
b11af135eb
|
[model-gateway] feat(metrics): implement Layer 2 router metrics (smg_router_*) (#15124)
|
2025-12-14 10:34:12 -08:00 |
|
Simo Lin
|
f9bceea064
|
[model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121)
|
2025-12-14 09:39:15 -08:00 |
|
Simo Lin
|
47633c191f
|
[model-gateway] Add new SMG metrics architecture with 6 layers (#15106)
|
2025-12-14 08:37:19 -08:00 |
|
fzyzcjy
|
54df514bac
|
Avoid confusing zero value metric when worker is removed (#15096)
|
2025-12-14 13:57:20 +08:00 |
|
fzyzcjy
|
681c68cfbf
|
Fix issue not reported when load decrement is incorrect (#15061)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-14 13:17:35 +08:00 |
|
Simo Lin
|
74ea45cc4b
|
[model-gateway] optimize metric labels to avoid unnecessary allocations (#15095)
|
2025-12-13 21:10:45 -08:00 |
|
Simo Lin
|
0fa044ad63
|
[model-gateway] Add circuit breaker and discovery watcher metrics (#15094)
|
2025-12-13 20:47:04 -08:00 |
|
Simo Lin
|
7d8e42c979
|
[model-gateway] Fix metric emission gaps and name mismatch (#15093)
|
2025-12-13 20:16:30 -08:00 |
|
Simo Lin
|
20ce9938b5
|
[model-gateway] Remove unused TokenizerMetrics to reduce CPU overhead (#15087)
|
2025-12-13 18:54:18 -08:00 |
|
Simo Lin
|
fd37cc5d38
|
[model-gateway] Refactor worker steps and add update workflow (#15085)
|
2025-12-13 15:00:16 -08:00 |
|
Wenyi Xu
|
2285affffa
|
[model-gateway] Avoid MCP Server Initialization Issue (#15065)
|
2025-12-13 11:20:16 -08:00 |
|
Simo Lin
|
e048ee90fc
|
[model-gateway] Simplify error response creation (#15079)
|
2025-12-13 10:28:24 -08:00 |
|
fzyzcjy
|
993278b488
|
Fix double decrease load (#15060)
|
2025-12-13 22:12:35 +08:00 |
|
fzyzcjy
|
9e9d910744
|
Fix load metric not updated when using guard (#15059)
|
2025-12-13 22:11:52 +08:00 |
|
fzyzcjy
|
bf17e769fe
|
Add sgl_router_attempt_http_responses_total for single attempt information (#15037)
|
2025-12-13 13:29:18 +08:00 |
|
fzyzcjy
|
9a5d6a84ab
|
Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036)
|
2025-12-13 13:28:32 +08:00 |
|
fzyzcjy
|
31c23e5fe3
|
Provide more fine grained error reason for reqwest error (#15032)
|
2025-12-13 13:27:06 +08:00 |
|
fzyzcjy
|
06617a9ec8
|
Tiny change http router response format to unify (#15031)
|
2025-12-13 13:25:45 +08:00 |
|
fzyzcjy
|
e79ca95961
|
Tiny unify grpc existing error responses into new format (#15030)
|
2025-12-13 13:25:10 +08:00 |
|
fzyzcjy
|
9d3b411c56
|
Add code field and unify error responses for router (#15028)
|
2025-12-13 13:21:34 +08:00 |
|
fzyzcjy
|
05325db349
|
Super tiny remove unused log_request (#15035)
|
2025-12-13 13:21:24 +08:00 |
|
Simo Lin
|
9a56273ad2
|
[model-gateway] refactor: unify worker management into modular workflow structure (#15010)
|
2025-12-12 15:25:35 -08:00 |
|