 Liangsheng Yin
|
85b8c5c4cd
|
Set max parallel for 1-gpu runner (#13215)
|
2025-11-14 01:36:43 +08:00 |
|
|
Liangsheng Yin
|
ad8d24c39e
|
Fix re-trigger actor of CI rate limit (#13136)
|
2025-11-12 16:10:27 +08:00 |
|
|
Liangsheng YinandHubert Lu
|
5f662e786f
|
Revert "[AMD] Add PD test for AMD CI (#11938)" (#13088)
Co-authored-by: Hubert Lu <55214931+hubertlu-tw@users.noreply.github.com>
|
2025-11-12 01:23:55 +08:00 |
|
|
Liangsheng Yin
|
f09eee036d
|
Tiny simplify evcition metrics collector (#12983)
|
2025-11-11 23:23:48 +08:00 |
|
|
Liangsheng Yin
|
56c83e0fb3
|
[CI] Limit the CI trigger frequency of low-privilege actors (#13010)
|
2025-11-10 11:27:10 -08:00 |
|
|
Liangsheng Yin
|
1086473111
|
Enhance retract test (page cases, long output cases) (#12781)
|
2025-11-11 03:03:26 +08:00 |
|
|
Liangsheng Yin
|
665416f6dd
|
Unify memory management across (overlap, non-overlap) x (page>=1) x (spec, non-spec, spec v2) x (retract, finished) (#12224)
|
2025-11-11 02:56:22 +08:00 |
|
|
Liangsheng Yin
|
f1f4c451ab
|
Add process_prefill_chunk back to fix PP event loop (#13009)
|
2025-11-11 00:51:36 +08:00 |
|
|
Liangsheng Yin
|
dc8a5a1ce7
|
[Refactor / Style] Unify all event loops (except for PP) (#12959)
|
2025-11-10 14:49:12 +08:00 |
|
|
Liangsheng Yin
|
61c7fe7aed
|
Minor code cleanup / improvement for PREBUILT_EXTEND mode (#12948)
|
2025-11-10 11:59:54 +08:00 |
|
|
Liangsheng Yin
|
4e916f9840
|
[lint] tiny fix unimported packages. (#12927)
|
2025-11-10 00:59:10 +08:00 |
|
|
Liangsheng Yinandcctry
|
4f65a64666
|
Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
|
2025-11-10 00:42:50 +08:00 |
|
|
Liangsheng Yin
|
210a9cab6d
|
[CI] Fix matrix.part in pr-test. (#12920)
|
2025-11-09 18:53:18 +08:00 |
|
|
Liangsheng Yin
|
877cb52840
|
[CI] increase ut buckets & adjust estimation time. (#12919)
|
2025-11-09 18:17:50 +08:00 |
|
|
Liangsheng Yin
|
49543be9da
|
Tiny simplify can_run_dp_cuda_graph gather logic (#12891)
|
2025-11-09 11:15:36 +08:00 |
|
|
Liangsheng Yin
|
243ea585fc
|
[DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843)
|
2025-11-08 23:23:14 +08:00 |
|
|
Liangsheng Yin
|
6fee2c535c
|
[CI] Tiny adjust CI esitmation time (#12886)
|
2025-11-08 23:02:19 +08:00 |
|
|
Liangsheng Yin
|
44b1b394a4
|
[PD-Disagg] Check finish after pop tranferred (#12638)
|
2025-11-05 11:18:09 +08:00 |
|
|
Liangsheng Yin
|
befa41a152
|
Fix output_ids inconsistency (#12628)
|
2025-11-05 01:43:08 +08:00 |
|
|
Liangsheng Yin
|
30b26ee9d0
|
Add io struct naming check back (#12634)
|
2025-11-05 01:15:01 +08:00 |
|
|
Liangsheng Yin
|
aa797d013d
|
[Test] Merge all constrained decoding tests. (#12633)
|
2025-11-05 00:43:06 +08:00 |
|
|
Liangsheng Yin
|
0678beaaee
|
[sepc-v2] Fix imcompatibility with constrained decoding (#12615)
|
2025-11-04 17:27:31 +08:00 |
|
|
Liangsheng Yin
|
edb2569356
|
[hot-fix] Fix broken CI (#12564)
|
2025-11-04 00:03:25 +08:00 |
|
|
Liangsheng Yin
|
3529c061bb
|
[spec v2] Fix output repetition by speculative sampling error (#12561)
|
2025-11-03 23:00:17 +08:00 |
|
|
Liangsheng Yin
|
9632e48f5d
|
[hot fix] Remove from python.sglang.xxx (#12483)
|
2025-11-01 11:00:05 +08:00 |
|
|
Liangsheng Yin
|
2c9aebea70
|
Simplify watchdog (#12463)
|
2025-10-31 21:17:38 +08:00 |
|
|
Liangsheng YinandLianmin Zheng
|
300b4c212e
|
[CI] fix possible port conflicts. (#12452)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
|
2025-10-31 17:20:20 +08:00 |
|
|
Liangsheng Yin
|
5cc0d25a0d
|
Add trait for BasePrefixCache (#12436)
|
2025-10-31 14:03:27 +08:00 |
|
|
Liangsheng Yin
|
9416ee60dd
|
Reserved abortion API when retracting (#12425)
|
2025-10-31 10:56:05 +08:00 |
|
|
Liangsheng Yin
|
d4a09ec9dc
|
[CI] fix tests' time estimation (#12401)
|
2025-10-30 19:20:35 -07:00 |
|
|
Liangsheng Yin
|
73dfd2dfb1
|
[Test] Enhance radix cache test for spec cases (#12394)
|
2025-10-30 18:46:28 +08:00 |
|
|
Liangsheng Yin
|
42f8ea4030
|
[Test] Fix session control test (#12336)
|
2025-10-29 18:28:04 +08:00 |
|
|
Liangsheng Yin
|
14cbe42fd3
|
Refactor abortion in event loop (#12312)
|
2025-10-29 18:25:20 +08:00 |
|
|
Liangsheng Yin
|
ea385ae85a
|
Fix ITL metrics when using openai endpoint with spec (#12156)
|
2025-10-26 18:06:25 +08:00 |
|
|
Liangsheng Yin
|
5994e6c373
|
Do not use MagicMock to mock server_args in tests (#12154)
|
2025-10-26 16:00:46 +08:00 |
|
|
Liangsheng Yin
|
8491c794ad
|
[misc] depdencies & enviroment flag (#12113)
|
2025-10-26 14:52:35 +08:00 |
|
|
Liangsheng Yin
|
bda3758fac
|
[log] Make forward iter count optional (#12116)
|
2025-10-26 14:51:07 +08:00 |
|
|
Liangsheng Yin
|
6c18addb6f
|
Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015)
|
2025-10-23 21:27:58 +08:00 |
|
|
Liangsheng Yin
|
32852fe9e9
|
Move memory runtime checker to mixin class (#12014)
|
2025-10-23 20:53:26 +08:00 |
|
|
Liangsheng YinandXiaoyu Zhang
|
9d61205dac
|
[lint] improve ruff check (#11922)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-10-22 11:32:50 +08:00 |
|
|
Liangsheng Yin
|
97710ccd1a
|
Fix flush cache API for spec v2 (#11918)
|
2025-10-21 23:01:16 +08:00 |
|
|
Liangsheng Yin
|
da5bde4d16
|
Tiny fix main lint (#11862)
|
2025-10-20 19:57:24 +08:00 |
|
|
Liangsheng Yin
|
7a020e0f3b
|
[Test] Add basic matched stop for beta eagle (#11833)
|
2025-10-20 01:17:00 +08:00 |
|
|
Liangsheng Yin
|
48738af7f9
|
[CI] always print back trace in retry() (#11834)
|
2025-10-20 01:12:49 +08:00 |
|
|
Liangsheng Yin
|
d658f0497e
|
[overlap-spec] fix stop condition and trimming (#11819)
|
2025-10-19 22:00:20 +08:00 |
|
|
Liangsheng Yin
|
57e25de756
|
Revert "Fix: Dynamic RoPE Cache Expansion to Prevent Position-ID Out-of-Bounds in EAGLE + Long-Sequence Workloads" (#11827)
|
2025-10-19 19:44:06 +08:00 |
|
|
Liangsheng Yin
|
b288f4f440
|
Improve send_sone script (#11817)
|
2025-10-19 11:28:16 +08:00 |
|
|
Liangsheng Yin
|
a93f10a722
|
[overlap-spec] support page size > 1 (#11772)
|
2025-10-19 02:09:13 +08:00 |
|
|
Liangsheng Yin
|
cde5a6e30f
|
Abstraction for spec worker and code cleanup (#11643)
|
2025-10-17 23:31:36 +08:00 |
|
|
Liangsheng Yin
|
d88ac9bc9a
|
[overlap-spec] Make plan stream an option (#11724)
|
2025-10-17 15:48:57 +08:00 |
|
|
Liangsheng Yin
|
ce11dd82dc
|
[CI] Try fix broken event loop init (#11746)
|
2025-10-17 13:30:17 +08:00 |
|
|
Liangsheng Yin
|
8221f9ae8b
|
Tiny cleanup some eagle unused codes (#11660)
|
2025-10-15 17:24:08 +08:00 |
|
|
Liangsheng Yin
|
5ea96ac7cc
|
Reduce one step decode for draft model. (#11561)
|
2025-10-14 23:52:04 +08:00 |
|
|
Liangsheng Yin
|
5a33c3aae7
|
Optimize Triton Draft Backend (#11556)
|
2025-10-14 20:08:32 +08:00 |
|
|
Liangsheng Yin
|
acc2327bbd
|
Move deep gemm related arguments to sglang.srt.environ (#11547)
|
2025-10-14 00:34:35 +08:00 |
|
|
Liangsheng Yin
|
bfadb5ea5f
|
Adjust overlap event loop (#11507)
|
2025-10-14 00:33:19 +08:00 |
|
|
Liangsheng Yin
|
54a46a264d
|
Remove tp_worker.worker (#11548)
|
2025-10-13 22:38:48 +08:00 |
|
|
Liangsheng Yin
|
516738b096
|
Depreate global_server_args_dict (#11528)
|
2025-10-13 19:34:43 +08:00 |
|
|
Liangsheng Yin
|
1083e7e3df
|
Deprecate global_server_args_dict (#11331)
|
2025-10-13 01:20:47 +08:00 |
|
|
Liangsheng Yin
|
2157d12ae8
|
[CI] fix lint (#11509)
|
2025-10-13 01:07:21 +08:00 |
|
|
Liangsheng Yin
|
f49419061d
|
Move args from global_config to environ (#11332)
|
2025-10-12 21:29:31 +08:00 |
|
|
Liangsheng Yin
|
01e59e8247
|
Fix CI break by express-laned PRs. (#11499)
|
2025-10-12 21:06:06 +08:00 |
|
|
|
20a6c0a63d
|
Beta spec-overlap for EAGLE (#11398)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-10-12 11:02:22 +08:00 |
|
|
Liangsheng Yin
|
739daa63e4
|
Adjust logits metada init for target verify (#11467)
|
2025-10-11 21:17:04 +08:00 |
|
|
Liangsheng YinandShangming Cai
|
c882b5ae75
|
[CI] improve disaggregation CI. (#11264)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-08 21:40:56 +08:00 |
|
|
Liangsheng Yin
|
4b4dc132fa
|
Rename ngram_utils -> ngram_info (#11316)
|
2025-10-08 11:49:46 +08:00 |
|
|
Liangsheng Yin
|
3ddd7dc9f8
|
Introduce future indices (#11301)
|
2025-10-07 22:24:02 +08:00 |
|
|
Liangsheng Yin
|
501dfa6b42
|
Remove sampling info events and overlap thread file (#11300)
|
2025-10-07 21:34:25 +08:00 |
|
|
|
1519a89cfd
|
Remove overlap thread (#11210)
Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-10-07 20:12:12 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
8a8a608af9
|
[ci] fix pp test (#11294)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-07 14:20:04 +08:00 |
|
|
Liangsheng Yin
|
4cb5a5235e
|
Tiny skip_sample adjust (#11225)
|
2025-10-05 23:41:04 +08:00 |
|
|
Liangsheng Yin
|
4726c9197f
|
[minor] fix the lint (#11198)
|
2025-10-04 01:04:58 +08:00 |
|
|
Liangsheng Yin
|
04b86b3c5c
|
[hot-fix] Fix CI break which caused by adding thinking_mode in eval (#11192)
|
2025-10-03 18:29:27 +08:00 |
|
|
Liangsheng Yin
|
de89ef49da
|
[CI]] Tee server logs to both file and stdout/stderr using PIPE (#11185)
|
2025-10-03 12:31:13 +08:00 |
|
|
Liangsheng Yin
|
3c699772c9
|
Introduce naming convention in io_struct and base sglang io classes. (#10133)
|
2025-10-03 10:55:13 +08:00 |
|
|
Liangsheng Yin
|
7ff740a6ce
|
Remove dp balance metadata and minimul token balance. (#11170)
|
2025-10-03 01:48:15 +08:00 |
|
|
Liangsheng Yin
|
bfcd9b2433
|
[grpc] style fix for grpc compilation. (#11175)
|
2025-10-03 01:44:29 +08:00 |
|
|
Liangsheng Yin
|
458611de77
|
Unify forward output datastructure (#11124)
|
2025-10-03 00:28:57 +08:00 |
|
|
Liangsheng Yin
|
7d00479950
|
Clean up ascend allocator (#11152)
|
2025-10-02 20:34:26 +08:00 |
|
|
Liangsheng Yin
|
6a29003410
|
Remove unused pack .item() in paged allocator. (#11156)
|
2025-10-02 18:01:21 +08:00 |
|
|
Liangsheng Yin
|
25e7dbe8af
|
Fix ngram spec with page size > 1 (#11135)
|
2025-10-02 12:34:23 +08:00 |
|
|
Liangsheng Yin
|
73d4a5f879
|
Organize spec-related data structures (#10735)
|
2025-10-01 09:45:30 +08:00 |
|
|
Liangsheng Yin
|
9710f718fb
|
[Eval] Add --repeat in run_eval (#11101)
|
2025-09-30 23:35:54 +08:00 |
|
|
Liangsheng Yin
|
4a762041d7
|
move environ into sglang.srt to avoid break SRT auto sync. (#10791)
|
2025-09-23 02:04:20 -07:00 |
|
|
Liangsheng Yin
|
f5a2faf2b8
|
Introduce FutureMap (#10715)
|
2025-09-22 23:27:30 -07:00 |
|
|
Liangsheng Yin
|
632b7d8cc9
|
Use simulate acc len from sglang.environ (#10771)
|
2025-09-23 12:59:50 +08:00 |
|
|
Liangsheng Yin
|
5ccf0b03bd
|
[bench] Fix random seed in bench_one_batch_server (#10548)
|
2025-09-17 19:30:32 +08:00 |
|
|
Liangsheng Yin
|
fa5d0bf6a5
|
Remove wrong imports from sglang.python (#10493)
|
2025-09-15 22:12:21 -07:00 |
|
|
Liangsheng Yin
|
c3c26f76b3
|
[Env] minimal version for organizing envs (#10479)
|
2025-09-16 03:51:25 +08:00 |
|
|
Liangsheng Yin
|
2cf811a9da
|
Fix --dataset-path in bench_one_batch_server (#10475)
|
2025-09-16 02:55:02 +08:00 |
|
|
Liangsheng Yin
|
305c9e8c2d
|
[4/N]DP refactor: support watching mode get_load and shortest queue strategy (#10201)
|
2025-09-15 10:06:08 +08:00 |
|
|
Liangsheng Yin
|
55a6e644b0
|
[Hack] Add pd-disaggregation decode polling interval (#10411)
|
2025-09-14 10:18:23 +08:00 |
|
|
Liangsheng Yin
|
6897e06b69
|
Remove repeatedly lists adding in init_incremental_detokenization (#10412)
|
2025-09-14 10:05:52 +08:00 |
|
|
Liangsheng Yin
|
83d55ac51f
|
[1/N]DP refactor: Improve dp rank scheduling in PD disaggregation mode. (#10169)
|
2025-09-09 12:27:55 +08:00 |
|
|
Liangsheng Yin
|
2c2b19b18b
|
[CI] fix ambiguous argument in testing hybrid attentions. (#10161)
|
2025-09-08 18:16:52 +08:00 |
|
|
Liangsheng YinandHuang Long
|
72f9fc5f11
|
Monkey patch uvicorn multi worker is_alive timeout (#10159)
Co-authored-by: Huang Long <121648372+llll114@users.noreply.github.com>
|
2025-09-08 17:43:23 +08:00 |
|
|
Liangsheng Yin
|
78f139812a
|
[1/N] DP-Refactor: move communicators into tokenizer_communicator_mixin (#10028)
|
2025-09-08 16:27:37 +08:00 |
|
|
Liangsheng Yin
|
e719bb0e84
|
[1/2] Refactor multi-tokenizer manager (#10074)
|
2025-09-07 19:13:34 +08:00 |
|
|
Liangsheng Yin
|
6e95f5e5bd
|
Simplify Router arguments passing and build it in docker image (#9964)
|
2025-09-05 12:13:55 +08:00 |
|
|
Liangsheng Yin
|
27e8ffed37
|
[1/N] DP-refactor: move dp balance code into scheduler's mixin class (#10004)
|
2025-09-04 16:53:58 +08:00 |
|