Simo Lin
e7d6027e4a
[model-gateway] add ModelCard support to WorkerMetadata ( #14243 )
2025-12-01 13:04:09 -08:00
Simo Lin
9325f94534
[model-gateway] add ModelCard and ProviderType for model configuration ( #14237 )
2025-12-01 09:47:51 -08:00
Simo Lin
92ca629582
[model-gateway] add ModelType bitflags and Endpoint enum for worker ( #14230 )
2025-12-01 08:14:44 -08:00
Chang Su
ec92d7f14e
[model-gateway] fix v1/models response format to be oai compatible ( #13693 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-12-01 07:20:38 -08:00
Simo Lin
79b389da6b
[model-gateway] refactor oai router 1/n ( #14228 )
2025-12-01 07:16:35 -08:00
Wenyi Xu
e55731b6e8
[model-gateway] Avoid logging MCP connection token ( #13887 )
2025-12-01 04:44:31 -08:00
Lianmin Zheng
bc3d2a85af
[Minor] update docs ( #14212 )
2025-12-01 02:33:58 -08:00
ooapex
f138ae5789
[model-gateway] support VL models in router ( #14140 )
2025-11-30 17:50:22 -08:00
Tony Lu
6bad6a3655
[model-gateway] Add version command support to SMG ( #12558 )
2025-11-28 12:34:19 -08:00
Simo Lin
e9e90460ed
[model-gateway] allow refill rate to be zero ( #14030 )
2025-11-26 17:15:27 -08:00
Xinyue Zhang
44d0a848da
[model-gateway] Fix flaky test_circuit_breaker_half_open_failure_reopens ( #14019 )
2025-11-26 14:52:10 -08:00
Wenyi Xu
67c8c86722
[model-gateway][doc] Update transport terminology to protocol in README.md ( #13872 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:44:59 -08:00
Simo Lin
69a03bc3f7
[ci] allow manual label to trigger ci in rust, change ci order ( #14016 )
2025-11-26 11:38:50 -08:00
Chang Su
66f242b98f
[model gateway][grpc] Add tojson filter to override minijinja's tojson ( #14013 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:05:01 -08:00
Simo Lin
a0d9f6cdd8
[model-gateway] fix xpu ci ( #14012 )
2025-11-26 10:33:59 -08:00
Wenyi Xu
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Siyuan Chen
a164259efd
[Router bugfix] Fix router_manager selecting the wrong router when enable-igw. ( #13572 )
2025-11-24 18:51:41 -08:00
Xinyue Zhang
a3b578fc60
[model-gateway] Refactor router e2e responses tests ( #13745 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-24 10:58:53 -08:00
Liangsheng Yin
981ca8313f
[misc] Rename minilb install env & remove files & fix lint ( #13831 )
2025-11-24 13:50:00 +08:00
Simo Lin
5354d7b7fd
[model-gateway] clean up router manager function order ( #13776 )
2025-11-22 16:16:20 -08:00
Lianmin Zheng
99e13d189b
Fix url: use https://roadmap.sglang.io for roadmap ( #13733 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-21 05:42:32 -08:00
Chang Su
c4db77f8a9
[model-gateway] fix gateway cli arg parser to not use = ( #13685 )
2025-11-20 17:57:17 -08:00
Simo Lin
3ae664d786
[model-gateway] add both python and rust cli alias ( #13678 )
2025-11-20 17:00:28 -08:00
Chang Su
0d2d687812
[router][grpc] Support num_reasoning_tokens in haromy models ( #13047 )
2025-11-18 16:40:32 -08:00
Simo Lin
9188feccca
[model-gateway] use worker startup time out for worker registration ( #13473 )
2025-11-17 19:28:21 -08:00
Simo Lin
b436113fc2
[model-gateway] Add Gateway Release Tooling ( #13420 )
2025-11-17 03:26:48 -08:00
Rivers
2a5773440e
refactor: replace worker pool with semaphore-based concurrency in jobqueue ( #13383 )
2025-11-16 17:57:59 -08:00
ybyang
3b18fd4cf5
[router] bindings for go ( #13384 )
...
Signed-off-by: ybyang <ybyang7@iflytek.com >
2025-11-16 10:12:10 -08:00
Simo Lin
efc5d8f5ed
[model-gateway] fix SDist step readme path ( #13373 )
2025-11-16 03:16:52 -08:00
Simo Lin
37c8761567
[model-gateway] remove grpc feature flag and mark as default ( #13330 )
2025-11-15 03:16:57 -08:00
Xinyue Zhang
4a10e37ba7
[router] Fix flaky router e2e tests ( #13306 )
2025-11-15 02:00:25 -08:00
Simo Lin
b732ffa404
[model-gateway] move python to binding folder ( #13295 )
2025-11-15 00:32:21 -08:00
Simo Lin
172c71a23d
[model-gateway] smg release 0.2.3 ( #13312 )
2025-11-14 19:04:20 -08:00
Xinyue Zhang
14dc052382
[router]Replace requests lib with openai in e2e_response_api ( #13293 )
2025-11-14 16:56:40 -08:00
fzyzcjy
1f134f850a
fix outdated router doc ( #13255 )
2025-11-14 14:00:42 +09:00
Chang Su
c9e5799bd1
[router][grpc] Refine docs in minimax_m2 to match other parsers ( #13218 )
2025-11-14 06:47:24 +09:00
Edmund Suen
c2d69e8b56
fix: display served_model_name in /v1/models ( #13155 )
2025-11-13 17:07:55 +09:00
Simo Lin
4c1e909a80
[router] minmax-m2 xml tool parser ( #13148 )
2025-11-12 23:24:54 -08:00
Simo Lin
6d21392b0e
[router] remove worker url requirement ( #13172 )
2025-11-12 17:32:58 -08:00
Xinyue Zhang
2cdde3d46d
[router] Fix Flaky test_circuit_breaker_opens_and_recovers ( #13164 )
2025-11-12 12:07:42 -08:00
Keyang Ru
401ed0c594
[router] Add comprehensive validation to Responses API ( #13127 )
2025-11-12 11:19:27 -08:00
Siyuan Chen
4ef4390540
bugfix: multi-model routing for /generate api ( #12979 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-12 11:13:27 -08:00
Chang Su
e5e65e3d2a
[router][grpc] Support vllm backend for grpc router ( #13120 )
2025-11-12 02:29:20 -08:00
Simo Lin
3cdec20c6b
[router] add minmax m2 reasoning parser ( #13137 )
2025-11-12 18:27:05 +09:00
Danylo Vashchilenko
d28caaf60a
[router] Support complex assistant and tool messages in /chat/completions ( #12860 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-12 00:14:15 -08:00
Simo Lin
ae68158f2e
[router] move radix tree to policy crate and addreses some code styles ( #13131 )
2025-11-11 23:36:04 -08:00
Ziwen Zhao
7b877ab83d
[Router] use call_id instead of id for matching function calls in Responses API for Harmony ( #13056 )
2025-11-11 17:16:47 -08:00
Chang Su
2ca25a8aab
Revert "fix: display served_model_name in /v1/models" ( #13093 )
2025-11-11 15:58:46 -08:00
Edmund Suen
a06c44f905
fix: display served_model_name in /v1/models ( #13063 )
2025-11-12 00:13:58 +08:00
rongfu.leng
2fe4e69fca
[router] add postgres databases data connector ( #12218 )
2025-11-10 16:51:50 -08:00
