Commit Graph
17 Commits
Author SHA1 Message Date
Simo Lin 0236522214 refactor: remove crate re-export aliases from lib.rs (#18737) 2026-02-12 09:17:24 -08:00
Chang Su fb5b71d015 [router][openai] Rename prepare_mcp_payload_for_streaming and patch_streaming_response_json (#16596) 2026-01-06 16:33:29 -08:00
Chang Su 9bf76c11a9 [responses API] Add list_tools_for_servers and threading server_keys in routers (#16540) 2026-01-05 22:42:22 -08:00
Chang Su 51541404f8 [grpc] Refactor openai module (#16511) 2026-01-05 11:39:33 -08:00
Simo Lin cf6800f6cc [model-gateway] optimize Vec and HashMap allocations in responses api (#16406) 2026-01-04 10:07:55 -08:00
Chang Su 8d58b3dcdd [model-gateway] Clear architectual debt in responses API (#16359) 2026-01-03 21:35:28 -08:00
Simo Lin 2142881b7e [model-gateway] return 503 when all workers are circuit-broken (#15611) 2025-12-22 04:06:09 -10:00
Simo Lin 1167867e8d [model-gateway] add retry support to OpenAI router chat endpoint (#15589) 2025-12-21 20:28:51 -08:00
Simo Lin d747147a26 [model-gateway] reduce cpu overhead (#15316) 2025-12-17 09:42:01 -08:00
Simo Lin 3518b33178 [model-gateway] Remove legacy RouterMetrics and Rename SmgMetrics to Metrics and smg_labels to metrics_labels (#15160) 2025-12-15 04:57:42 -08:00
Simo Lin b11af135eb [model-gateway] feat(metrics): implement Layer 2 router metrics (smg_router_*) (#15124) 2025-12-14 10:34:12 -08:00
Simo Lin 5b0872d2d7 [model-gateway] code clean up on oai router in responses (#14852) 2025-12-11 06:55:09 -08:00
Simo Lin bcc5483ed7 [model-gateway] fix import order in oai conversation (#14851) 2025-12-10 15:36:42 -08:00
Simo Lin ccf2602773 [model-gateway] code clean up on oai router (#14850) 2025-12-10 15:34:27 -08:00
Simo Lin c032b559a8 [model-gateway] adds default implementations to RouterTrait in mod.rs (#14841) 2025-12-10 11:46:35 -08:00
Simo Lin b0bbc7f53d [model-gateway] extra accumulator and tool handler in oai router (#14587) 2025-12-07 15:52:12 -08:00
Simo Lin 49dfa1d891 [model-gateway] change sgl-router to sgl-model-gateway (#14312) 2025-12-05 12:04:48 -08:00