Lianmin Zheng
bc3d2a85af
[Minor] update docs ( #14212 )
2025-12-01 02:33:58 -08:00
Tony Lu
6bad6a3655
[model-gateway] Add version command support to SMG ( #12558 )
2025-11-28 12:34:19 -08:00
Wenyi Xu
67c8c86722
[model-gateway][doc] Update transport terminology to protocol in README.md ( #13872 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:44:59 -08:00
Simo Lin
69a03bc3f7
[ci] allow manual label to trigger ci in rust, change ci order ( #14016 )
2025-11-26 11:38:50 -08:00
Simo Lin
a0d9f6cdd8
[model-gateway] fix xpu ci ( #14012 )
2025-11-26 10:33:59 -08:00
Wenyi Xu
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Simo Lin
b436113fc2
[model-gateway] Add Gateway Release Tooling ( #13420 )
2025-11-17 03:26:48 -08:00
Simo Lin
b732ffa404
[model-gateway] move python to binding folder ( #13295 )
2025-11-15 00:32:21 -08:00
fzyzcjy
1f134f850a
fix outdated router doc ( #13255 )
2025-11-14 14:00:42 +09:00
Keyang Ru
9840bf4f84
[router][ci] Fix maturin build ( #13012 )
2025-11-10 12:33:32 -08:00
Keyang Ru
74630ba310
[router][ci] Disable cache ( #12752 )
2025-11-05 22:49:03 -08:00
Keyang Ru
80802c4cc6
[router][ci] speed up python binding to 1.5 min ( #12673 )
2025-11-05 14:52:33 -08:00
Keyang Ru
72b5f3d0bb
[ci] install released version router ( #12410 )
2025-10-30 21:59:08 -07:00
Simo Lin
5259becd3c
[bug] fix router installation to include additional dependency ( #12348 )
2025-10-29 12:45:18 -07:00
Chang Su
400bddf24c
[router] fix router release workflow and add build test in PR ( #12315 )
2025-10-29 08:11:45 -07:00
Simo Lin
212f5e4822
[router] MCP Manager Refactoring - Flat Architecture with Connection Pooling ( #12097 )
2025-10-25 21:26:28 -07:00
Keyang Ru
2bc3fcd420
[doc] update router document ( #11767 )
2025-10-17 10:26:54 -07:00
Simo Lin
49345a68cf
[router] update router readme to latest features ( #11619 )
2025-10-14 11:47:38 -07:00
Keyang Ru
eb8cac6fe2
[router] add py binding and readme for openai router and history backend ( #11453 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-10-14 09:42:34 -07:00
Jonah Bernard
f4aa78801e
[router] Add Rust CLI flags for queue size, timeout, and rate limit for token bucket rate limiter ( #11483 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-10-13 11:08:48 -07:00
Keyang Ru
a0835c3a62
[router] Fix ci nvcc not found error ( #11411 )
2025-10-10 15:43:16 -07:00
Chang Su
ee704e6265
[router] add auth middleware for api key auth ( #10826 )
2025-09-23 16:07:34 -07:00
Keyang Ru
1ee11df8ac
[router][ci] add gpu process check and free port before start server ( #10338 )
2025-09-11 14:24:16 -07:00
Simo Lin
bde73ee43f
[router] add rust cache in benchmark ci ( #10080 )
2025-09-05 09:59:36 -07:00
Keyang Ru
4f0e28d7fc
[router] add rust cache for rust unit test ( #10079 )
2025-09-05 09:58:59 -07:00
Bruce-x-1997
3aec3d4f8b
[Doc] add LWS(LeaderWorkerSet) use case in sgl-router README ( #9568 )
...
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai >
2025-08-25 08:32:31 -07:00
Chang Su
ad359d1c71
router: Fix user guide link README.md ( #9122 )
2025-08-12 12:29:10 -07:00
Keyang Ru
4093d460ce
[CI] migrate router to BM.A10.4 runner ( #8992 )
...
Co-authored-by: key4ng <rukeyang@gamil.com >
2025-08-11 22:41:18 -07:00
Simo Lin
9d68bdb240
[router] Add Rust Binary Entrypoint for SGLang Router ( #9089 )
2025-08-11 21:37:36 -07:00
Simo Lin
067068f271
[router] regular router circuit breaker ( #8997 )
2025-08-10 21:19:30 -07:00
Simo Lin
f6f46f4629
[router] add basic usage doc ( #8640 )
2025-07-31 18:11:48 -07:00
Simo Lin
fe6a445d1e
[router] improve router logs and request id header ( #8415 )
2025-07-27 19:30:19 -07:00
Simo Lin
2ab97023e3
[router] add different policies for p node and d node ( #8395 )
2025-07-27 00:39:20 -07:00
Simo Lin
35724aa182
[docs] update router readme ( #7797 )
2025-07-06 22:54:11 -07:00
Zilin Zhu
82f021e22e
[router] add --log-level to sgl-router ( #6512 )
2025-07-02 19:33:04 -07:00
Simo Lin
30f2a44a96
[misc] Add PD service discovery support in router ( #7361 )
2025-06-22 17:54:14 -07:00
Chao Yang
1a39979993
Sgl-router Prometheus metrics endpoint and usage track metrics ( #6537 )
2025-05-24 22:28:15 -07:00
Simo Lin
1468769bde
[Misc] add service discovery for sgl router
2025-04-29 10:21:19 -07:00
Simo Lin
f0365820e8
[Misc] add structure logging, write to file and log tracing for SGL Router
2025-04-27 16:54:10 -07:00
Byron Hsu
ef18b0eda2
[router] Allow empty worker list for sglang.launch_router ( #2979 )
2025-01-19 01:05:23 -08:00
Yineng Zhang
41d7e5b7e6
docs: update link ( #2857 )
2025-01-13 18:40:48 +08:00
Ata Fatahi
e3b3acfa6f
Rename rust folder to sgl-router ( #2464 )
...
Signed-off-by: Ata Fatahi <immrata@gmail.com >
2024-12-12 09:40:41 -08:00
