Simo Lin
fdc2ef58db
[model-gateway] add llama4 vision image processor ( #14438 )
2025-12-04 09:52:36 -08:00
Simo Lin
b01fc161eb
[model-gateway] introduce request ctx for oai router ( #14434 )
...
Co-authored-by: key4ng <rukeyang@gmail.com >
2025-12-04 08:31:44 -08:00
Simo Lin
11d33c0e8f
[model-gateway] add phi4 vision image processor ( #14430 )
2025-12-04 07:40:33 -08:00
Daniel Cámpora
8428078436
Add Mistral Large 3 support. ( #14213 )
...
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com >
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com >
2025-12-04 20:00:05 +08:00
Simo Lin
fa78c44a3d
[model-gateway] introduce provider in openai router ( #14394 )
2025-12-03 22:47:20 -08:00
Simo Lin
654a78f9c8
[model-gateway] add phi3 vision image processor ( #14381 )
2025-12-03 22:32:40 -08:00
Wenyi Xu
78647e08dd
[model-gateway][doc] Add STDIO Explicitly to Example in README ( #14393 )
2025-12-03 20:36:44 -08:00
fzyzcjy
df026bb110
Fix sgl-router silently parse selector wrongly causing OME fail to discover pods ( #14359 )
2025-12-04 09:56:37 +08:00
Simo Lin
d42c167bfd
[model-gateway] add qwen3_vl model image processor ( #14377 )
2025-12-03 17:16:37 -08:00
Simo Lin
388151053d
[model-gateway] use worker crate in openai router ( #14330 )
2025-12-03 13:36:32 -08:00
Simo Lin
8ab5d8b40d
[model-gateway] add qwen2.5_vl model image processor ( #14375 )
2025-12-03 12:51:30 -08:00
Simo Lin
03575ce38d
[model-gateway] add qwen2_vl model image processor and tests ( #14374 )
2025-12-03 12:34:06 -08:00
Simo Lin
abf6272bdd
[model-gateway] add llava model image processor and tests ( #14371 )
2025-12-03 11:18:00 -08:00
Simo Lin
58ac3f317b
[model-gateway] add image processor and transformer structure ( #14344 )
2025-12-03 00:04:06 -08:00
Simo Lin
d5ea8c7176
[model-gateway] multimodality initialization ( #13350 )
2025-12-02 19:41:40 -08:00
Simo Lin
5dad1ff1b6
[model-gateway] add workflow for external model providers ( #14323 )
2025-12-02 16:47:06 -08:00
Simo Lin
51a86ce69e
[model-gateway] change rust package name to sgl-model-gateway instead ( #14283 )
2025-12-02 00:06:54 -08:00
Simo Lin
383689e3ad
[model-gateway] fix version output ( #14276 )
2025-12-01 22:51:57 -08:00
Simo Lin
73df525382
[model-gateway] include smg version command in py binding ( #14274 )
2025-12-01 21:21:02 -08:00
Simo Lin
cd4151abc7
[model-gateway] add audio and moderation in model card ( #14263 )
2025-12-01 18:36:38 -08:00
Xinyue Zhang
1d66a14c2e
[model-gateway] Add e2e tests of streaming events and tool choice for response api ( #13880 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-12-01 15:27:12 -08:00
Simo Lin
57f933fd7d
[model-gateway] Migrate Worker trait to model-aware methods ( #14250 )
2025-12-01 14:32:09 -08:00
Simo Lin
e7d6027e4a
[model-gateway] add ModelCard support to WorkerMetadata ( #14243 )
2025-12-01 13:04:09 -08:00
Simo Lin
9325f94534
[model-gateway] add ModelCard and ProviderType for model configuration ( #14237 )
2025-12-01 09:47:51 -08:00
Simo Lin
92ca629582
[model-gateway] add ModelType bitflags and Endpoint enum for worker ( #14230 )
2025-12-01 08:14:44 -08:00
Chang Su
ec92d7f14e
[model-gateway] fix v1/models response format to be oai compatible ( #13693 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-12-01 07:20:38 -08:00
Simo Lin
79b389da6b
[model-gateway] refactor oai router 1/n ( #14228 )
2025-12-01 07:16:35 -08:00
Wenyi Xu
e55731b6e8
[model-gateway] Avoid logging MCP connection token ( #13887 )
2025-12-01 04:44:31 -08:00
Lianmin Zheng
bc3d2a85af
[Minor] update docs ( #14212 )
2025-12-01 02:33:58 -08:00
ooapex
f138ae5789
[model-gateway] support VL models in router ( #14140 )
2025-11-30 17:50:22 -08:00
Tony Lu
6bad6a3655
[model-gateway] Add version command support to SMG ( #12558 )
2025-11-28 12:34:19 -08:00
Simo Lin
e9e90460ed
[model-gateway] allow refill rate to be zero ( #14030 )
2025-11-26 17:15:27 -08:00
Xinyue Zhang
44d0a848da
[model-gateway] Fix flaky test_circuit_breaker_half_open_failure_reopens ( #14019 )
2025-11-26 14:52:10 -08:00
Wenyi Xu
67c8c86722
[model-gateway][doc] Update transport terminology to protocol in README.md ( #13872 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:44:59 -08:00
Simo Lin
69a03bc3f7
[ci] allow manual label to trigger ci in rust, change ci order ( #14016 )
2025-11-26 11:38:50 -08:00
Chang Su
66f242b98f
[model gateway][grpc] Add tojson filter to override minijinja's tojson ( #14013 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:05:01 -08:00
Simo Lin
a0d9f6cdd8
[model-gateway] fix xpu ci ( #14012 )
2025-11-26 10:33:59 -08:00
Wenyi Xu
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Siyuan Chen
a164259efd
[Router bugfix] Fix router_manager selecting the wrong router when enable-igw. ( #13572 )
2025-11-24 18:51:41 -08:00
Xinyue Zhang
a3b578fc60
[model-gateway] Refactor router e2e responses tests ( #13745 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-24 10:58:53 -08:00
Liangsheng Yin
981ca8313f
[misc] Rename minilb install env & remove files & fix lint ( #13831 )
2025-11-24 13:50:00 +08:00
Simo Lin
5354d7b7fd
[model-gateway] clean up router manager function order ( #13776 )
2025-11-22 16:16:20 -08:00
Lianmin Zheng
99e13d189b
Fix url: use https://roadmap.sglang.io for roadmap ( #13733 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-21 05:42:32 -08:00
Chang Su
c4db77f8a9
[model-gateway] fix gateway cli arg parser to not use = ( #13685 )
2025-11-20 17:57:17 -08:00
Simo Lin
3ae664d786
[model-gateway] add both python and rust cli alias ( #13678 )
2025-11-20 17:00:28 -08:00
Chang Su
0d2d687812
[router][grpc] Support num_reasoning_tokens in haromy models ( #13047 )
2025-11-18 16:40:32 -08:00
Simo Lin
9188feccca
[model-gateway] use worker startup time out for worker registration ( #13473 )
2025-11-17 19:28:21 -08:00
Simo Lin
b436113fc2
[model-gateway] Add Gateway Release Tooling ( #13420 )
2025-11-17 03:26:48 -08:00
Rivers
2a5773440e
refactor: replace worker pool with semaphore-based concurrency in jobqueue ( #13383 )
2025-11-16 17:57:59 -08:00
ybyang
3b18fd4cf5
[router] bindings for go ( #13384 )
...
Signed-off-by: ybyang <ybyang7@iflytek.com >
2025-11-16 10:12:10 -08:00
