Simo Lin
|
7235a7fbe9
|
[misc] add model arch and type to server info and use it for harmony (#14456)
|
2025-12-05 06:51:00 -08:00 |
|
Simo Lin
|
c1006fd8a1
|
[model-gateway] grpc to leverage event type (#14450)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 14:30:19 -08:00 |
|
Simo Lin
|
29c6c2ea9d
|
[model-gateway] add mistral 3 image processor (#14445)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 13:16:04 -08:00 |
|
Simo Lin
|
eb85fa6daf
|
[model-gateway] move all responses api event from oai to proto (#14446)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 13:11:03 -08:00 |
|
Simo Lin
|
d8faf2f361
|
[model-gateway] move oai header util to router header util (#14441)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 11:02:50 -08:00 |
|
Simo Lin
|
7f3308bc68
|
[model-gateway] extract conversation out of oai router (#14440)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 10:16:14 -08:00 |
|
Simo Lin
|
fdc2ef58db
|
[model-gateway] add llama4 vision image processor (#14438)
|
2025-12-04 09:52:36 -08:00 |
|
Simo Lin
|
b01fc161eb
|
[model-gateway] introduce request ctx for oai router (#14434)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 08:31:44 -08:00 |
|
Simo Lin
|
11d33c0e8f
|
[model-gateway] add phi4 vision image processor (#14430)
|
2025-12-04 07:40:33 -08:00 |
|
Daniel Cámpora
|
8428078436
|
Add Mistral Large 3 support. (#14213)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-04 20:00:05 +08:00 |
|
Simo Lin
|
fa78c44a3d
|
[model-gateway] introduce provider in openai router (#14394)
|
2025-12-03 22:47:20 -08:00 |
|
Simo Lin
|
654a78f9c8
|
[model-gateway] add phi3 vision image processor (#14381)
|
2025-12-03 22:32:40 -08:00 |
|
Simo Lin
|
d42c167bfd
|
[model-gateway] add qwen3_vl model image processor (#14377)
|
2025-12-03 17:16:37 -08:00 |
|
Simo Lin
|
388151053d
|
[model-gateway] use worker crate in openai router (#14330)
|
2025-12-03 13:36:32 -08:00 |
|
Simo Lin
|
8ab5d8b40d
|
[model-gateway] add qwen2.5_vl model image processor (#14375)
|
2025-12-03 12:51:30 -08:00 |
|
Simo Lin
|
03575ce38d
|
[model-gateway] add qwen2_vl model image processor and tests (#14374)
|
2025-12-03 12:34:06 -08:00 |
|
Simo Lin
|
abf6272bdd
|
[model-gateway] add llava model image processor and tests (#14371)
|
2025-12-03 11:18:00 -08:00 |
|
Simo Lin
|
58ac3f317b
|
[model-gateway] add image processor and transformer structure (#14344)
|
2025-12-03 00:04:06 -08:00 |
|
Simo Lin
|
d5ea8c7176
|
[model-gateway] multimodality initialization (#13350)
|
2025-12-02 19:41:40 -08:00 |
|
Simo Lin
|
5dad1ff1b6
|
[model-gateway] add workflow for external model providers (#14323)
|
2025-12-02 16:47:06 -08:00 |
|
Simo Lin
|
51a86ce69e
|
[model-gateway] change rust package name to sgl-model-gateway instead (#14283)
|
2025-12-02 00:06:54 -08:00 |
|
Simo Lin
|
383689e3ad
|
[model-gateway] fix version output (#14276)
|
2025-12-01 22:51:57 -08:00 |
|
Simo Lin
|
cd4151abc7
|
[model-gateway] add audio and moderation in model card (#14263)
|
2025-12-01 18:36:38 -08:00 |
|
Simo Lin
|
57f933fd7d
|
[model-gateway] Migrate Worker trait to model-aware methods (#14250)
|
2025-12-01 14:32:09 -08:00 |
|
Simo Lin
|
e7d6027e4a
|
[model-gateway] add ModelCard support to WorkerMetadata (#14243)
|
2025-12-01 13:04:09 -08:00 |
|
Simo Lin
|
9325f94534
|
[model-gateway] add ModelCard and ProviderType for model configuration (#14237)
|
2025-12-01 09:47:51 -08:00 |
|
Simo Lin
|
92ca629582
|
[model-gateway] add ModelType bitflags and Endpoint enum for worker (#14230)
|
2025-12-01 08:14:44 -08:00 |
|
Chang Su
|
ec92d7f14e
|
[model-gateway] fix v1/models response format to be oai compatible (#13693)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-01 07:20:38 -08:00 |
|
Simo Lin
|
79b389da6b
|
[model-gateway] refactor oai router 1/n (#14228)
|
2025-12-01 07:16:35 -08:00 |
|
Wenyi Xu
|
e55731b6e8
|
[model-gateway] Avoid logging MCP connection token (#13887)
|
2025-12-01 04:44:31 -08:00 |
|
ooapex
|
f138ae5789
|
[model-gateway] support VL models in router (#14140)
|
2025-11-30 17:50:22 -08:00 |
|
Tony Lu
|
6bad6a3655
|
[model-gateway] Add version command support to SMG (#12558)
|
2025-11-28 12:34:19 -08:00 |
|
Simo Lin
|
e9e90460ed
|
[model-gateway] allow refill rate to be zero (#14030)
|
2025-11-26 17:15:27 -08:00 |
|
Chang Su
|
66f242b98f
|
[model gateway][grpc] Add tojson filter to override minijinja's tojson (#14013)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-11-26 11:05:01 -08:00 |
|
Siyuan Chen
|
a164259efd
|
[Router bugfix] Fix router_manager selecting the wrong router when enable-igw. (#13572)
|
2025-11-24 18:51:41 -08:00 |
|
Simo Lin
|
5354d7b7fd
|
[model-gateway] clean up router manager function order (#13776)
|
2025-11-22 16:16:20 -08:00 |
|
Simo Lin
|
3ae664d786
|
[model-gateway] add both python and rust cli alias (#13678)
|
2025-11-20 17:00:28 -08:00 |
|
Chang Su
|
0d2d687812
|
[router][grpc] Support num_reasoning_tokens in haromy models (#13047)
|
2025-11-18 16:40:32 -08:00 |
|
Simo Lin
|
9188feccca
|
[model-gateway] use worker startup time out for worker registration (#13473)
|
2025-11-17 19:28:21 -08:00 |
|
Rivers
|
2a5773440e
|
refactor: replace worker pool with semaphore-based concurrency in jobqueue (#13383)
|
2025-11-16 17:57:59 -08:00 |
|
ybyang
|
3b18fd4cf5
|
[router] bindings for go (#13384)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-11-16 10:12:10 -08:00 |
|
Simo Lin
|
37c8761567
|
[model-gateway] remove grpc feature flag and mark as default (#13330)
|
2025-11-15 03:16:57 -08:00 |
|
Simo Lin
|
b732ffa404
|
[model-gateway] move python to binding folder (#13295)
|
2025-11-15 00:32:21 -08:00 |
|
Chang Su
|
c9e5799bd1
|
[router][grpc] Refine docs in minimax_m2 to match other parsers (#13218)
|
2025-11-14 06:47:24 +09:00 |
|
Edmund Suen
|
c2d69e8b56
|
fix: display served_model_name in /v1/models (#13155)
|
2025-11-13 17:07:55 +09:00 |
|
Simo Lin
|
4c1e909a80
|
[router] minmax-m2 xml tool parser (#13148)
|
2025-11-12 23:24:54 -08:00 |
|
Simo Lin
|
6d21392b0e
|
[router] remove worker url requirement (#13172)
|
2025-11-12 17:32:58 -08:00 |
|
Keyang Ru
|
401ed0c594
|
[router] Add comprehensive validation to Responses API (#13127)
|
2025-11-12 11:19:27 -08:00 |
|
Siyuan Chen
|
4ef4390540
|
bugfix: multi-model routing for /generate api (#12979)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-11-12 11:13:27 -08:00 |
|
Chang Su
|
e5e65e3d2a
|
[router][grpc] Support vllm backend for grpc router (#13120)
|
2025-11-12 02:29:20 -08:00 |
|