Simo Lin
|
bf08d3f43c
|
[gRPC] Fix scheduler startup broken by context parallel refactor (#18933)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2026-02-17 08:52:11 -08:00 |
|
Lianmin Zheng
|
b33769786f
|
[Auto Sync] Update grpc_request_manager.py, tokenizer_manag... (20260214) (#18838)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2026-02-14 18:12:32 -08:00 |
|
Simo Lin
|
92c5749f41
|
refactor: replace local proto compilation with smg-grpc-proto package (#18682)
|
2026-02-12 05:29:24 -08:00 |
|
Simo Lin
|
f091858304
|
[gRPC] Add GetLoads RPC for comprehensive load metrics (#17087)
|
2026-01-14 12:05:10 -08:00 |
|
Chang Su
|
16880235d1
|
[grpc] Auto-generate protobuf files during wheel build (#16409)
|
2026-01-08 09:09:54 -08:00 |
|
Yuhao Yang
|
10174e1114
|
Revert "[grpc] update api to scheduler in grpc request manager" (#16387)
|
2026-01-04 22:05:39 -08:00 |
|
Chang Su
|
7bc13c906c
|
[grpc] update api to scheduler in grpc request manager (#16350)
|
2026-01-03 10:54:31 -08:00 |
|
Simo Lin
|
162d1cf9be
|
[model-gateway] Add classification model support infrastructure (#16061)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 08:34:05 -08:00 |
|
ratish
|
5f3a47d8a7
|
[model-gateway]: add gRPC router embeddings endpoint implementation (#15273)
|
2025-12-23 09:12:22 -08:00 |
|
Simo Lin
|
5d9c6bac07
|
[bug] fix grpc secheduler launcher breaking change (#15080)
|
2025-12-13 10:36:49 -08:00 |
|
Simo Lin
|
7235a7fbe9
|
[misc] add model arch and type to server info and use it for harmony (#14456)
|
2025-12-05 06:51:00 -08:00 |
|
fzyzcjy
|
340c613ab5
|
Support numactl bind for CPU and memory before process starts (#14156)
|
2025-11-30 17:00:33 +08:00 |
|
Zhi Yiliu
|
a95a38078b
|
[Fix] Fix uvloop get_event_loop() is not suitable for 0.22.x (#13612)
Signed-off-by: lzy <tomlzy213@gmail.com>
Co-authored-by: lzy <tomlzy213@gmail.com>
|
2025-11-25 01:20:00 +08:00 |
|
yinghui
|
58095cb00a
|
Add timing metrics for requests (#12646)
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-11-05 23:07:16 -08:00 |
|
Simo Lin
|
5259becd3c
|
[bug] fix router installation to include additional dependency (#12348)
|
2025-10-29 12:45:18 -07:00 |
|
Chang Su
|
6ade6a02d4
|
[grpc] Support gRPC standard health check (#11955)
|
2025-10-22 16:59:09 -07:00 |
|
Chang Su
|
ca240eefb4
|
[router][grpc] Support parallel queue puts in grpc_request_manager and remove mutex for grpc_client (#11798)
|
2025-10-17 20:49:43 -07:00 |
|
Chang Su
|
627974405d
|
[Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685)
|
2025-10-17 16:49:46 -07:00 |
|
Chang Su
|
887c2b4575
|
[router][grpc] Add serve_grpc to launch_server and log id for HealthCheck (#11564)
|
2025-10-13 16:07:19 -07:00 |
|
ai-jz
|
9cc1e065f1
|
[router][Fix] Include grpc reflection runtime dependency (#11419)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-13 09:32:42 -07:00 |
|
Simo Lin
|
2fcd56eaf6
|
[router] add get server info and get model info in grpc server (#11303)
|
2025-10-07 08:36:52 -07:00 |
|
Chang Su
|
a578d300ba
|
[router][grpc] Fix proto3 default value mismatches and cleanup unused fields (#11283)
|
2025-10-06 18:54:51 -07:00 |
|
Chang Su
|
963175d5c0
|
[router][grpc] Support streaming for v1/chat/completions (#11179)
|
2025-10-02 14:35:16 -07:00 |
|
Liangsheng Yin
|
7ff740a6ce
|
Remove dp balance metadata and minimul token balance. (#11170)
|
2025-10-03 01:48:15 +08:00 |
|
Liangsheng Yin
|
bfcd9b2433
|
[grpc] style fix for grpc compilation. (#11175)
|
2025-10-03 01:44:29 +08:00 |
|
Chang Su
|
3511b37099
|
[proto] Add script to compile python protos (#11171)
|
2025-10-02 08:45:51 -07:00 |
|
Chang Su
|
8ce830a8b0
|
[router][bugfix] Fix input_logprobs handling with None value and logprob_start_len = -1 (#11113)
|
2025-09-30 16:09:40 -07:00 |
|
Chang Su
|
5937a56d47
|
[router][grpc] Add logprobs support to router (#11082)
|
2025-09-29 15:55:06 -07:00 |
|
Chang Su
|
37f3325b06
|
[router][grpc] Support E2E non-stream chat completions (#10980)
|
2025-09-26 22:02:06 -07:00 |
|
Chang Su
|
0c3db88978
|
[router][grpc] Add helpfer functions for decoder in router.rs and fix specs (#10971)
|
2025-09-26 20:10:45 -04:00 |
|
Chang Su
|
37158f2018
|
router: Support parallel sampling num > 1 in grpc_server and non-stream handling (#10929)
|
2025-09-25 20:03:35 -07:00 |
|
Chang Su
|
7dcd689b47
|
[router][refactor] Clean up protobuf fields (#10923)
|
2025-09-25 17:48:47 -07:00 |
|
Chang Su
|
916784746b
|
router: Fix constraint proto and build_constraint in grpc router (#10881)
|
2025-09-25 11:12:06 -04:00 |
|
Chang Su
|
53ca15529a
|
Implement Standalone gRPC Server for SGLang Python Scheduler (#10283)
|
2025-09-11 20:57:17 -07:00 |
|