chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity
11,027 Commits 1 Branch 0 Tags
0cd5c38a9e3b5a0e3deef4ea82eea1da435945d4
Commit Graph

77 Commits

Author SHA1 Message Date
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
psaab
1145805e7d Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491) 
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
 2026-03-15 14:29:10 -07:00
shuwenn
538acb4c46 fix: Add .text property to HttpResponse to prevent AttributeError (#20518) 2026-03-14 22:59:32 -07:00
Kangyan-Zhou
f5a4a5429f Revert early HTTP port reservation (#17754, #19805) (#20468) 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 16:17:33 -07:00
Liangsheng Yin
61cad15d28 [Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306) 2026-03-11 00:07:37 -07:00
Mohammad Miadh Angkad
09fa012ba7 Fix /health regression from early prebound socket listen (#19805) 2026-03-03 23:00:46 -08:00
xrwang8
cedb86a950 Feature:Reserve HTTP server port before model loading to immediately detect port conflicts instead of failing after several minutes of model loading. (#17754) 
Signed-off-by: xrwang8 <xrwang8@gmail.com>
 2026-03-03 11:59:18 -08:00
Julian Huang
a55f658835 [Misc] Normalize --host parameter to use plain hostname without scheme (#19309) 
Co-authored-by: 墨楼 <huangzhilin.hzl@antgroup.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
 2026-02-25 00:37:24 -08:00
SoluMilken
07a24f1a38 update pre-commit config (#18860) 2026-02-16 00:18:31 +08:00
shuwenn
3299c4f9c1 [CI] feat: add early exit to wait_for_server when process dies (#18602) 2026-02-13 16:46:09 -08:00
赵晨阳
1552aab741 Support execute_shell_command for env var support (#18390) 2026-02-07 12:33:29 +08:00
xlzheng
37e8724ef3 perf: optimize TypeBasedDispatcher using dict for O(1) lookup (#12001) 2025-11-15 22:02:42 +08:00
Liangsheng Yin
1086473111 Enhance retract test (page cases, long output cases) (#12781) 2025-11-11 03:03:26 +08:00
Liangsheng Yin
4e916f9840 [lint] tiny fix unimported packages. (#12927) 2025-11-10 00:59:10 +08:00
Mick
f5b3ccd9a5 feat: basic support for server-level multimodal cache (#10775) 2025-11-10 00:27:50 +08:00
hzh0425
d9c812d881 [hotfix]: Resolve ModuleNotFoundError in PD deployment for is_in_ci() (#12772) 2025-11-06 18:48:03 -08:00
Baizhou Zhang
4ef981e2b6 Revert "[Fix] Fix lint to pass CI" (#12042) 2025-10-23 19:44:58 -07:00
Baizhou Zhang
69ed8b67a8 [Fix] Fix lint to pass CI (#12037) 2025-10-23 19:39:38 -07:00
Lianmin Zheng
ffc722a690 Revert "lang: support direct video inference" (#12038) 2025-10-23 19:21:31 -07:00
Mick
823b442945 lang: support direct video inference (#9936) 
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
 2025-10-23 18:12:39 -07:00
Lifu Huang
9241f4fd20 Move cached kernel to srt.utils (#10776) 2025-09-22 23:00:36 -07:00
Lianmin Zheng
38c00ed7a1 Fix multimodal registry and code sync scripts (#10759) 
Co-authored-by: cctry <shiyang@x.ai>
 2025-09-22 15:36:01 -07:00
Lifu Huang
2101d93b4f Fix CI TestChunkedSGMV (#10737) 2025-09-22 16:09:58 +08:00
Lifu Huang
635ccda673 [4/4] Introduce CachedKernel to reduce CSGMV kernel launch overheads by 60% (#10709) 2025-09-21 22:26:42 -07:00
Liangsheng Yin
305c9e8c2d [4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201) 2025-09-15 10:06:08 +08:00
Liangsheng Yin
78f139812a [1/N] DP-Refactor: move communicators into tokenizer_communicator_mixin (#10028) 2025-09-08 16:27:37 +08:00
Huapeng Zhou
75ee00112d [Doc] Fix SGLang tool parser doc (#9886) 2025-09-04 21:52:53 +08:00
Lianmin Zheng
c480a3f6ea Minor style fixes for sgl-kernel (#9289) 2025-08-18 09:38:35 -07:00
Lianmin Zheng
2449a0afe2 Refactor the docs (#9031) 2025-08-10 19:49:45 -07:00
Lianmin Zheng
a4c3b121d8 Split the scheduler into multiple mixin classes to reduce the file size (#8483) 2025-07-29 12:46:50 -07:00
Mick
3212c2ad3f vlm: optimize tensor transport (#6003) 
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
 2025-07-26 17:41:01 +08:00
Brayden Zhong
a37e1247c1 [Multimodal][Perf] Use pybase64 instead of base64 (#7724) 2025-07-08 14:00:58 -07:00
woodx
e30ef368ab Feat/support rerank (#6058) 2025-06-16 10:50:01 -07:00
Lifu Huang
3cf1473a09 Use monotonic clock for interval measurement (#6211) 
Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>
 2025-05-17 16:49:18 -07:00
applesaucethebun
2ce8793519 Add typo checker in pre-commit (#6179) 
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
 2025-05-11 12:55:00 +08:00
SEPLOS
032f8faaab Fix sglang frontend's incorrect dependency on torch (#4931) 2025-03-30 13:00:24 -07:00
mlmz
f6ab4ca6bc fix: fix ipython running error for Engine due to outlines nest_asyncio (#4582) 
Co-authored-by: shuaills <shishuaiuoe@gmail.com>
 2025-03-21 19:11:15 -07:00
Zhiqiang Xie
9376ac361d Memory pool fix for upstream change about eagle (#4170) 2025-03-07 00:58:20 -08:00
Yueyang Pan
25482edb5c Online serving benchmarks of real datasets for hierarchical KV caching (#3211) 
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
 2025-03-05 16:16:43 -08:00
Shi Shuai
55de40f782 [Docs]: Fix Multi-User Port Allocation Conflicts (#3601) 
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
 2025-02-19 11:15:44 -08:00
Jiada Li
39416e394a fix lockfile and port_registry file permission error (#3598) 
Co-authored-by: jiada li <jiada@lmsys.us-northcentral1-a.compute.internal>
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
 2025-02-15 19:14:45 -08:00
Shi Shuai
7443197a63 [CI] Improve Docs CI Efficiency (#3587) 
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
 2025-02-14 19:57:00 -08:00
Jhin
7b9b4f4426 Docs fix about EAGLE and streaming output (#3166) 
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
 2025-01-27 18:10:45 -08:00
Lianmin Zheng
73401fd016 Sync distributed package from vllm 0.6.4.post1 (#3010) 2025-01-20 04:57:14 -08:00
fzyzcjy
81d27c8e31 Refactor to add TypeBasedDispatcher to simplify dispatching (#2958) 2025-01-18 20:13:27 -08:00
SangBin Cho
9208618b3e [Core] in batch prefix caching by delay scheduling (#2442) 2024-12-11 12:51:50 -08:00
Yineng Zhang
75ae968959 minor: update killall script (#2391) 2024-12-08 04:21:00 +08:00
Lianmin Zheng
d4fc1a70e3 Crash the server correctly during error (#2231) 2024-11-28 00:22:39 -08:00
Chayenne
c77c1e05ba fix black in pre-commit (#1940) 2024-11-08 07:42:47 +08:00
Iñaki Arango
1363b51983 Escape backwards slash (#1902) 2024-11-03 12:27:11 -08:00