Simo Lin
7235a7fbe9
[misc] add model arch and type to server info and use it for harmony ( #14456 )
2025-12-05 06:51:00 -08:00
Simo Lin and Chang Su
c1006fd8a1
[model-gateway] grpc to leverage event type ( #14450 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-12-04 14:30:19 -08:00
Simo Lin and Chang Su
29c6c2ea9d
[model-gateway] add mistral 3 image processor ( #14445 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-12-04 13:16:04 -08:00
Simo Lin and key4ng
eb85fa6daf
[model-gateway] move all responses api event from oai to proto ( #14446 )
...
Co-authored-by: key4ng <rukeyang@gmail.com >
2025-12-04 13:11:03 -08:00
Simo Lin and key4ng
d8faf2f361
[model-gateway] move oai header util to router header util ( #14441 )
...
Co-authored-by: key4ng <rukeyang@gmail.com >
2025-12-04 11:02:50 -08:00
Simo Lin and key4ng
7f3308bc68
[model-gateway] extract conversation out of oai router ( #14440 )
...
Co-authored-by: key4ng <rukeyang@gmail.com >
2025-12-04 10:16:14 -08:00
Simo Lin
fdc2ef58db
[model-gateway] add llama4 vision image processor ( #14438 )
2025-12-04 09:52:36 -08:00
Simo Lin and key4ng
b01fc161eb
[model-gateway] introduce request ctx for oai router ( #14434 )
...
Co-authored-by: key4ng <rukeyang@gmail.com >
2025-12-04 08:31:44 -08:00
Simo Lin
11d33c0e8f
[model-gateway] add phi4 vision image processor ( #14430 )
2025-12-04 07:40:33 -08:00
8428078436
Add Mistral Large 3 support. ( #14213 )
...
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com >
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com >
2025-12-04 20:00:05 +08:00
Simo Lin
fa78c44a3d
[model-gateway] introduce provider in openai router ( #14394 )
2025-12-03 22:47:20 -08:00
Simo Lin
654a78f9c8
[model-gateway] add phi3 vision image processor ( #14381 )
2025-12-03 22:32:40 -08:00
Wenyi Xu
78647e08dd
[model-gateway][doc] Add STDIO Explicitly to Example in README ( #14393 )
2025-12-03 20:36:44 -08:00
fzyzcjy
df026bb110
Fix sgl-router silently parse selector wrongly causing OME fail to discover pods ( #14359 )
2025-12-04 09:56:37 +08:00
Simo Lin
d42c167bfd
[model-gateway] add qwen3_vl model image processor ( #14377 )
2025-12-03 17:16:37 -08:00
Simo Lin
388151053d
[model-gateway] use worker crate in openai router ( #14330 )
2025-12-03 13:36:32 -08:00
Simo Lin
8ab5d8b40d
[model-gateway] add qwen2.5_vl model image processor ( #14375 )
2025-12-03 12:51:30 -08:00
Simo Lin
03575ce38d
[model-gateway] add qwen2_vl model image processor and tests ( #14374 )
2025-12-03 12:34:06 -08:00
Simo Lin
abf6272bdd
[model-gateway] add llava model image processor and tests ( #14371 )
2025-12-03 11:18:00 -08:00
Simo Lin
58ac3f317b
[model-gateway] add image processor and transformer structure ( #14344 )
2025-12-03 00:04:06 -08:00
Simo Lin
d5ea8c7176
[model-gateway] multimodality initialization ( #13350 )
2025-12-02 19:41:40 -08:00
Simo Lin
5dad1ff1b6
[model-gateway] add workflow for external model providers ( #14323 )
2025-12-02 16:47:06 -08:00
Simo Lin
51a86ce69e
[model-gateway] change rust package name to sgl-model-gateway instead ( #14283 )
2025-12-02 00:06:54 -08:00
Simo Lin
383689e3ad
[model-gateway] fix version output ( #14276 )
2025-12-01 22:51:57 -08:00
Simo Lin
73df525382
[model-gateway] include smg version command in py binding ( #14274 )
2025-12-01 21:21:02 -08:00
Simo Lin
cd4151abc7
[model-gateway] add audio and moderation in model card ( #14263 )
2025-12-01 18:36:38 -08:00
Xinyue Zhang and Simo Lin
1d66a14c2e
[model-gateway] Add e2e tests of streaming events and tool choice for response api ( #13880 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-12-01 15:27:12 -08:00
Simo Lin
57f933fd7d
[model-gateway] Migrate Worker trait to model-aware methods ( #14250 )
2025-12-01 14:32:09 -08:00
Simo Lin
e7d6027e4a
[model-gateway] add ModelCard support to WorkerMetadata ( #14243 )
2025-12-01 13:04:09 -08:00
Simo Lin
9325f94534
[model-gateway] add ModelCard and ProviderType for model configuration ( #14237 )
2025-12-01 09:47:51 -08:00
Simo Lin
92ca629582
[model-gateway] add ModelType bitflags and Endpoint enum for worker ( #14230 )
2025-12-01 08:14:44 -08:00
Chang Su and Simo Lin
ec92d7f14e
[model-gateway] fix v1/models response format to be oai compatible ( #13693 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-12-01 07:20:38 -08:00
Simo Lin
79b389da6b
[model-gateway] refactor oai router 1/n ( #14228 )
2025-12-01 07:16:35 -08:00
Wenyi Xu
e55731b6e8
[model-gateway] Avoid logging MCP connection token ( #13887 )
2025-12-01 04:44:31 -08:00
Lianmin Zheng
bc3d2a85af
[Minor] update docs ( #14212 )
2025-12-01 02:33:58 -08:00
ooapex
f138ae5789
[model-gateway] support VL models in router ( #14140 )
2025-11-30 17:50:22 -08:00
Tony Lu
6bad6a3655
[model-gateway] Add version command support to SMG ( #12558 )
2025-11-28 12:34:19 -08:00
Simo Lin
e9e90460ed
[model-gateway] allow refill rate to be zero ( #14030 )
2025-11-26 17:15:27 -08:00
Xinyue Zhang
44d0a848da
[model-gateway] Fix flaky test_circuit_breaker_half_open_failure_reopens ( #14019 )
2025-11-26 14:52:10 -08:00
Wenyi Xu and Simo Lin
67c8c86722
[model-gateway][doc] Update transport terminology to protocol in README.md ( #13872 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:44:59 -08:00
Simo Lin
69a03bc3f7
[ci] allow manual label to trigger ci in rust, change ci order ( #14016 )
2025-11-26 11:38:50 -08:00
Chang Su and Simo Lin
66f242b98f
[model gateway][grpc] Add tojson filter to override minijinja's tojson ( #14013 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:05:01 -08:00
Simo Lin
a0d9f6cdd8
[model-gateway] fix xpu ci ( #14012 )
2025-11-26 10:33:59 -08:00
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Siyuan Chen
a164259efd
[Router bugfix] Fix router_manager selecting the wrong router when enable-igw. ( #13572 )
2025-11-24 18:51:41 -08:00
a3b578fc60
[model-gateway] Refactor router e2e responses tests ( #13745 )
...
Co-authored-by: Chang Su <chang.s.su@oracle.com >
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-24 10:58:53 -08:00
Liangsheng Yin
981ca8313f
[misc] Rename minilb install env & remove files & fix lint ( #13831 )
2025-11-24 13:50:00 +08:00
Simo Lin
5354d7b7fd
[model-gateway] clean up router manager function order ( #13776 )
2025-11-22 16:16:20 -08:00
Lianmin Zheng and sglang-bot
99e13d189b
Fix url: use https://roadmap.sglang.io for roadmap ( #13733 )
...
Co-authored-by: sglang-bot <sglangbot@gmail.com >
2025-11-21 05:42:32 -08:00
Chang Su
c4db77f8a9
[model-gateway] fix gateway cli arg parser to not use = ( #13685 )
2025-11-20 17:57:17 -08:00
Simo Lin