Commit Graph

50 Commits

Author SHA1 Message Date
Simo Lin
69a03bc3f7 [ci] allow manual label to trigger ci in rust, change ci order (#14016) 2025-11-26 11:38:50 -08:00
Lianmin Zheng
2e1dbdb258 Update docs (#13519)
Co-authored-by: sglang-bot <sglangbot@gmail.com>
2025-11-18 06:24:58 -08:00
Liangsheng Yin
67071f55a8 [CI] fix triggered by a non-run-ci label (#13393) 2025-11-18 14:24:58 +08:00
Simo Lin
b732ffa404 [model-gateway] move python to binding folder (#13295) 2025-11-15 00:32:21 -08:00
Keyang Ru
9840bf4f84 [router][ci] Fix maturin build (#13012) 2025-11-10 12:33:32 -08:00
Keyang Ru
d3d7f960b5 [router] Switch MCP tests from DeepWiki to self-hosted Brave search server (#12849) 2025-11-07 16:16:07 -08:00
Keyang Ru
8be0e1bc9c fix ci (#12760) 2025-11-06 00:21:11 -08:00
Keyang Ru
74630ba310 [router][ci] Disable cache (#12752) 2025-11-05 22:49:03 -08:00
Keyang Ru
80802c4cc6 [router][ci] speed up python binding to 1.5 min (#12673) 2025-11-05 14:52:33 -08:00
Keyang Ru
72b5f3d0bb [ci] install released version router (#12410) 2025-10-30 21:59:08 -07:00
Keyang Ru
4d2f17bd0b [router] Function call support for openai router Responses API (#12386) 2025-10-30 12:45:10 -07:00
Simo Lin
5259becd3c [bug] fix router installation to include additional dependency (#12348) 2025-10-29 12:45:18 -07:00
Chang Su
400bddf24c [router] fix router release workflow and add build test in PR (#12315) 2025-10-29 08:11:45 -07:00
Keyang Ru
737b58d6dc [rust][ci] Add end-to-end tests for Oracle history backend (#12233) 2025-10-28 10:57:32 -07:00
Simo Lin
d85d6dba3b [router] configure workflow retries and timeout based on routerConfig (#12252) 2025-10-28 00:41:20 -07:00
Simo Lin
a4b637d87a [router] change ci names and update log level in ci (#12021) 2025-10-23 10:36:19 -07:00
Keyang Ru
e321c97113 [router] Add comprehensive E2E tests for Response API (#11988) 2025-10-23 05:13:51 -07:00
Keyang Ru
63cfe1b032 [router] Add gRPC E2E test suite (#11790) 2025-10-21 17:51:21 -07:00
Chang Su
dc01313da1 [router] Add rustfmt and set group imports by default (#11732) 2025-10-16 17:33:29 -07:00
Keyang Ru
a0835c3a62 [router] Fix ci nvcc not found error (#11411) 2025-10-10 15:43:16 -07:00
Lianmin Zheng
d645ae90a3 Rename runner labels (#11228) 2025-10-05 18:05:41 -07:00
Lianmin Zheng
50dc0c1e9c Run tests based on labels (#10456) 2025-09-15 00:29:20 -07:00
Simo Lin
07bcad7fb7 [bug] fix router ci syntax error (#10390) 2025-09-12 14:39:15 -07:00
Simo Lin
8c86595c93 [router] enable sccache in ci and local build (#10099) 2025-09-12 09:43:48 -07:00
Keyang Ru
7b141f816c [router][ci] Add gpu utilization analyze with nvml (#10345) 2025-09-11 19:26:02 -07:00
Keyang Ru
480d1b8b20 [router] add benchmark for regular router and pd router (#10280) 2025-09-11 12:04:11 -07:00
Keyang Ru
9eb50ecc9c [router] Improve the router e2e tests (#10102) 2025-09-06 16:19:28 -07:00
Keyang Ru
b3e7a2cee4 increase the rust e2e timeout (#10116) 2025-09-06 16:17:34 -07:00
Keyang Ru
21b9a4b435 [router] Introduce router integration tests (#10086) 2025-09-05 18:52:53 -07:00
Keyang Ru
4f0e28d7fc [router] add rust cache for rust unit test (#10079) 2025-09-05 09:58:59 -07:00
Keyang Ru
045ab92dc0 [router] add py binding unit tests to coverage 80% (#10043) 2025-09-05 08:40:21 -07:00
Keyang Ru
3828db4309 [router] Add IGW (Inference Gateway) Feature Flag (#9371)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
2025-08-20 17:38:57 -07:00
Jeff Nettleton
ce3ca9b02f [router] add cargo clippy in CI and fix-up linting errors (#9242) 2025-08-17 11:03:56 -07:00
Keyang Ru
4093d460ce [CI] migrate router to BM.A10.4 runner (#8992)
Co-authored-by: key4ng <rukeyang@gamil.com>
2025-08-11 22:41:18 -07:00
Lianmin Zheng
2c7f01bc89 Reorganize CI and test files (#9027) 2025-08-10 12:30:06 -07:00
Simo Lin
a9fd80336d [router] allow longer time out for router e2e (#8560) 2025-07-29 23:43:37 -07:00
Simo Lin
3abc30364d [ci] add router benchmark script and CI (#7498) 2025-06-25 01:28:25 -07:00
Yineng Zhang
ad1ae7f7cd use topk_softmax with sgl-kernel (#4439) 2025-03-14 15:59:06 -07:00
Byron Hsu
ef18b0eda2 [router] Allow empty worker list for sglang.launch_router (#2979) 2025-01-19 01:05:23 -08:00
Ata Fatahi
ce094a5d79 Clean up GPU memory after killing sglang processes (#2457)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-17 03:42:40 -08:00
Ata Fatahi
e3b3acfa6f Rename rust folder to sgl-router (#2464)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-12 09:40:41 -08:00
Ata Fatahi
2ac36b9a7b Make request payload size configurable (#2444)
Signed-off-by: Ata Fatahi <immrata@gmail.com>
2024-12-11 16:55:21 -08:00
Byron Hsu
c36736c841 [router] Add remove worker api (#2380) 2024-12-06 17:16:03 -08:00
Byron Hsu
64fceab8af [router] use 2-gpu-runner (#2368) 2024-12-06 14:13:57 +08:00
Byron Hsu
1f76fc6e3f [router] Rust e2e test (#2184) 2024-11-25 16:02:03 -08:00
Byron Hsu
3e33574374 run rust test on ubuntu instead of 1-gpu-runner (#2003) 2024-11-11 14:46:08 -08:00
Lianmin Zheng
a1f32867ca Update pr-test-rust.yml to add a "finish" step (#1975) 2024-11-09 13:53:35 -08:00
Xuehai Pan
a5e0defb5a minor: Add basic editorconfig and pre-commit hooks to enforce style for whitespaces (#1926) 2024-11-06 13:46:04 +00:00
Byron Hsu
96766101b4 [rust] refactor server and router (#1922) 2024-11-06 00:02:02 -08:00
Byron Hsu
530ff541cf [router] Impl radix tree and set up CI (#1893)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
2024-11-04 10:56:52 -08:00