 Simo Lin
|
cd4151abc7
|
[model-gateway] add audio and moderation in model card (#14263)
|
2025-12-01 18:36:38 -08:00 |
|
|
Simo Lin
|
57f933fd7d
|
[model-gateway] Migrate Worker trait to model-aware methods (#14250)
|
2025-12-01 14:32:09 -08:00 |
|
|
Simo Lin
|
e7d6027e4a
|
[model-gateway] add ModelCard support to WorkerMetadata (#14243)
|
2025-12-01 13:04:09 -08:00 |
|
|
Simo Lin
|
9325f94534
|
[model-gateway] add ModelCard and ProviderType for model configuration (#14237)
|
2025-12-01 09:47:51 -08:00 |
|
|
Simo Lin
|
92ca629582
|
[model-gateway] add ModelType bitflags and Endpoint enum for worker (#14230)
|
2025-12-01 08:14:44 -08:00 |
|
|
Chang SuandSimo Lin
|
ec92d7f14e
|
[model-gateway] fix v1/models response format to be oai compatible (#13693)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-01 07:20:38 -08:00 |
|
|
Simo Lin
|
79b389da6b
|
[model-gateway] refactor oai router 1/n (#14228)
|
2025-12-01 07:16:35 -08:00 |
|
|
Wenyi Xu
|
e55731b6e8
|
[model-gateway] Avoid logging MCP connection token (#13887)
|
2025-12-01 04:44:31 -08:00 |
|
|
ooapex
|
f138ae5789
|
[model-gateway] support VL models in router (#14140)
|
2025-11-30 17:50:22 -08:00 |
|
|
Tony Lu
|
6bad6a3655
|
[model-gateway] Add version command support to SMG (#12558)
|
2025-11-28 12:34:19 -08:00 |
|
|
Simo Lin
|
e9e90460ed
|
[model-gateway] allow refill rate to be zero (#14030)
|
2025-11-26 17:15:27 -08:00 |
|
|
Chang SuandSimo Lin
|
66f242b98f
|
[model gateway][grpc] Add tojson filter to override minijinja's tojson (#14013)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-11-26 11:05:01 -08:00 |
|
|
Siyuan Chen
|
a164259efd
|
[Router bugfix] Fix router_manager selecting the wrong router when enable-igw. (#13572)
|
2025-11-24 18:51:41 -08:00 |
|
|
Simo Lin
|
5354d7b7fd
|
[model-gateway] clean up router manager function order (#13776)
|
2025-11-22 16:16:20 -08:00 |
|
|
Simo Lin
|
3ae664d786
|
[model-gateway] add both python and rust cli alias (#13678)
|
2025-11-20 17:00:28 -08:00 |
|
|
Chang Su
|
0d2d687812
|
[router][grpc] Support num_reasoning_tokens in haromy models (#13047)
|
2025-11-18 16:40:32 -08:00 |
|
|
Simo Lin
|
9188feccca
|
[model-gateway] use worker startup time out for worker registration (#13473)
|
2025-11-17 19:28:21 -08:00 |
|
|
Rivers
|
2a5773440e
|
refactor: replace worker pool with semaphore-based concurrency in jobqueue (#13383)
|
2025-11-16 17:57:59 -08:00 |
|
|
ybyang
|
3b18fd4cf5
|
[router] bindings for go (#13384)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-11-16 10:12:10 -08:00 |
|
|
Simo Lin
|
37c8761567
|
[model-gateway] remove grpc feature flag and mark as default (#13330)
|
2025-11-15 03:16:57 -08:00 |
|
|
Simo Lin
|
b732ffa404
|
[model-gateway] move python to binding folder (#13295)
|
2025-11-15 00:32:21 -08:00 |
|
|
Chang Su
|
c9e5799bd1
|
[router][grpc] Refine docs in minimax_m2 to match other parsers (#13218)
|
2025-11-14 06:47:24 +09:00 |
|
|
Edmund Suen
|
c2d69e8b56
|
fix: display served_model_name in /v1/models (#13155)
|
2025-11-13 17:07:55 +09:00 |
|
|
Simo Lin
|
4c1e909a80
|
[router] minmax-m2 xml tool parser (#13148)
|
2025-11-12 23:24:54 -08:00 |
|
|
Simo Lin
|
6d21392b0e
|
[router] remove worker url requirement (#13172)
|
2025-11-12 17:32:58 -08:00 |
|
|
Keyang Ru
|
401ed0c594
|
[router] Add comprehensive validation to Responses API (#13127)
|
2025-11-12 11:19:27 -08:00 |
|
|
|
4ef4390540
|
bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-12 11:13:27 -08:00 |
|
|
Chang Su
|
e5e65e3d2a
|
[router][grpc] Support vllm backend for grpc router (#13120)
|
2025-11-12 02:29:20 -08:00 |
|
|
Simo Lin
|
3cdec20c6b
|
[router] add minmax m2 reasoning parser (#13137)
|
2025-11-12 18:27:05 +09:00 |
|
|
|
d28caaf60a
|
[router] Support complex assistant and tool messages in /chat/completions (#12860)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-11-12 00:14:15 -08:00 |
|
|
Simo Lin
|
ae68158f2e
|
[router] move radix tree to policy crate and addreses some code styles (#13131)
|
2025-11-11 23:36:04 -08:00 |
|
|
Ziwen Zhao
|
7b877ab83d
|
[Router] use call_id instead of id for matching function calls in Responses API for Harmony (#13056)
|
2025-11-11 17:16:47 -08:00 |
|
|
Chang Su
|
2ca25a8aab
|
Revert "fix: display served_model_name in /v1/models" (#13093)
|
2025-11-11 15:58:46 -08:00 |
|
|
Edmund Suen
|
a06c44f905
|
fix: display served_model_name in /v1/models (#13063)
|
2025-11-12 00:13:58 +08:00 |
|
|
rongfu.leng
|
2fe4e69fca
|
[router] add postgres databases data connector (#12218)
|
2025-11-10 16:51:50 -08:00 |
|
|
syy-hw
|
611a4fd08b
|
[router] bucket policy (#11719)
|
2025-11-10 02:02:53 -08:00 |
|
|
Chang Su
|
e434187289
|
[router][grpc] Move all error logs to their call sites (#12859)
|
2025-11-07 15:55:34 -08:00 |
|
|
Chang Su
|
fe19a580fb
|
[router][grpc] Refactor: Add builders for chat and responses (#12852)
|
2025-11-07 15:43:32 -08:00 |
|
|
Keyang Ru
|
5c9273c032
|
[router] Support structured model output for openai and grpc router (#12431)
|
2025-11-07 10:16:45 -08:00 |
|
|
Chang Su
|
837b08eb2e
|
[router][grpc] Support mixin tool calls in Responses API (#12736)
|
2025-11-05 21:29:45 -08:00 |
|
|
Keyang Ru
|
74243dffa2
|
Revert "[router] web_search_preview tool basic implementation" (#12716)
|
2025-11-05 18:57:39 -08:00 |
|
|
Keyang RuandChang Su
|
7ef1964a66
|
[router] add basic ci tests for gpt-oss model support (#12651)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-05 15:45:11 -08:00 |
|
|
Keyang Ru
|
b0476a0642
|
[router][quick fix] Add minimal option for reasoning effort in spec (#12711)
|
2025-11-05 15:43:19 -08:00 |
|
|
Chang Su
|
ffba61a100
|
[router][grpc] Make harmony parser checks recipient first before channel (#12713)
|
2025-11-05 15:33:52 -08:00 |
|
|
wyx
|
3651cfbf62
|
[router] fix: validate HTTP status codes in health check (#12631)
|
2025-11-05 13:37:17 -08:00 |
|
|
Chang Su
|
4fe53e5888
|
[router][grpc] Support streaming parsing with Tool Choice in chat completions API (#12677)
|
2025-11-05 12:12:21 -08:00 |
|
|
Chang Su
|
9f5e701879
|
[router][grpc] Implement tool_choice support for Responses API (#12668)
|
2025-11-04 21:43:42 -08:00 |
|
|
Chang Su
|
1357ab025a
|
[router][grpc] Emit OutputItemDone event and store output item array (#12656)
|
2025-11-04 17:01:03 -08:00 |
|
|
Chang Su
|
887742a1e7
|
[router][grpc] Fix index issues in reasoning content and missing streaming events (#12650)
|
2025-11-04 15:38:43 -08:00 |
|
|
Chang Su
|
0e82fd3df4
|
[router][grpc] Fix model validation, tool call check, streaming logic and misc in responses (#12616)
|
2025-11-04 02:21:58 -08:00 |
|