 Liangsheng Yin
|
4653939cda
|
Revert "[jit kernel] Support per_token_group_quant_8bit jit kernel" (#19131)
|
2026-02-22 07:54:24 +08:00 |
|
|
Liangsheng Yin
|
1f2da824dd
|
[Benchmark] Remove re-exports from bench_serving.py (#19130)
|
2026-02-21 14:30:30 -08:00 |
|
|
Liangsheng Yin
|
3fb457b103
|
Tiny rename cuda_graph tests to piecewise_cuda_graph (#19128)
|
2026-02-21 13:46:01 -08:00 |
|
|
Liangsheng Yin
|
db34c1cbfb
|
Tiny remove duplicate coredump env injection (#19023)
|
2026-02-19 13:26:30 -08:00 |
|
|
Liangsheng Yin
|
5ff5aa6923
|
[spec v2]Fix torch gc of future indices (#18958)
|
2026-02-19 11:38:25 -08:00 |
|
|
Liangsheng Yin
|
2d85f01d43
|
Revert "Fix generated-shared-prefix bench_serving" (#18956)
|
2026-02-17 20:43:55 -08:00 |
|
|
Liangsheng Yin
|
83a475e8d7
|
feat: add cuda core dump CI warpper (#18909)
|
2026-02-17 14:49:26 -08:00 |
|
|
Liangsheng Yin
|
dcea74d63f
|
Add timeout abort kits for normal / eagle. (#18815)
|
2026-02-13 17:57:30 -08:00 |
|
|
Liangsheng Yin
|
4474fb98b4
|
[PD-Disagg] Fix double free when prebuilt batch is aborted. (#18822)
|
2026-02-13 17:46:35 -08:00 |
|
|
Liangsheng Yin
|
e6f7a372ef
|
Rename request timeout env vars for waiting/running stages (#18766)
|
2026-02-12 22:58:40 -08:00 |
|
|
Liangsheng Yin
|
d29e331491
|
[Spec] Move forward timeout before verify to fix Eagle v1 filter mismatch (#18760)
|
2026-02-12 20:58:34 -08:00 |
|
|
Liangsheng Yin
|
3404dda592
|
Try fix the max-parallel for maunally triggered test again. (#18686)
|
2026-02-11 20:08:25 -08:00 |
|
|
Liangsheng Yin
|
b2d7fd5c87
|
fix the max-parallel for /rerun-stage (#18658)
|
2026-02-11 19:06:51 -08:00 |
|
|
Liangsheng Yin
|
10c6bee74f
|
List more CI runs for pr-test (#18650)
|
2026-02-11 18:36:45 -08:00 |
|
|
Liangsheng Yin
|
cd90346a2b
|
Add cache hit rate UT (#18566)
|
2026-02-10 21:27:41 -08:00 |
|
|
Liangsheng Yin
|
50f74285e9
|
Tiny fix regex warning (#18592)
|
2026-02-10 21:07:53 -08:00 |
|
|
Liangsheng Yin
|
93fca0bbc3
|
Fix wrong prefill log. (#18570)
|
2026-02-10 15:54:03 -08:00 |
|
|
Liangsheng Yin
|
2825f5d8e0
|
Tiny fix wrong metric collect key name forward_prefill -> forward_extend (#18506)
|
2026-02-09 16:23:41 -08:00 |
|
|
Liangsheng Yin
|
875ad6cf35
|
Tiny rename for spec related fileds. (#18468)
|
2026-02-09 00:10:39 -08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
8278ef0e68
|
Pass GPU ids to kill specified devices in script. (#17840)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2026-01-27 13:52:55 -08:00 |
|
|
Liangsheng Yin
|
85d077f44d
|
Introduce global alloc_len_per_decode & clean check decode memory (#15115)
|
2026-01-26 10:26:20 -08:00 |
|
|
Liangsheng Yin
|
e2c8a50b38
|
fix grammar timeout sync across tp ranks. (#16898)
|
2026-01-14 10:26:31 +08:00 |
|
|
Liangsheng YinandDarkSharpness
|
2b3791ed37
|
Fix wrong kernel selection for int32/int64 indices (#16912)
Co-authored-by: DarkSharpness <2040703891@qq.com>
|
2026-01-12 17:26:57 +08:00 |
|
|
Liangsheng Yin
|
5b7bed7ca4
|
Decouple grammar logic out of scheduler. (#16820)
|
2026-01-12 10:52:42 +08:00 |
|
|
Liangsheng Yin
|
934ae89abe
|
Tiny fix typo minxin -> mixin (#16908)
|
2026-01-12 00:36:45 +08:00 |
|
|
Liangsheng Yin
|
cf1426a7b7
|
[CI] reapply max-parallel in stage-b-test-small-1-gpu (#16906)
|
2026-01-11 23:17:38 +08:00 |
|
|
Liangsheng Yin
|
09e2571e2e
|
Clarify the meaning of cpu_group / entry_rank when dp + tp is enabled. (#16876)
|
2026-01-11 13:04:43 +08:00 |
|
|
Liangsheng Yin
|
78c41758ad
|
[hot fix ci] Hot fix for the unregistered. (#16877)
|
2026-01-11 01:24:32 +08:00 |
|
|
Liangsheng Yin
|
3c358736d1
|
Enhance test for dp-attention + constrained decoding. (#16849)
|
2026-01-10 16:49:10 +08:00 |
|
|
Liangsheng Yin
|
e6d40bff81
|
Revert "feat: reduce constrained-decoding overhead in TP" (#16845)
|
2026-01-10 11:39:38 +08:00 |
|
|
Liangsheng Yin
|
7066711529
|
[ci hot fix] fix global server args init for mamba ut (#16821)
|
2026-01-10 02:03:32 +08:00 |
|
|
Liangsheng Yin
|
87ee6b5eaa
|
Tiny remove auto-triggering for list-active-pr-runs. (#16778)
|
2026-01-09 13:16:23 +08:00 |
|
|
Liangsheng Yin
|
f7c1d24b18
|
List ci workflows status. (#16774)
|
2026-01-09 13:02:12 +08:00 |
|
|
Liangsheng Yin
|
75da784d48
|
Tiny simplify draft worker init. (#16446)
|
2026-01-09 11:20:29 +08:00 |
|
|
Liangsheng Yin
|
77d3566555
|
Tiny fix wording about CI preemption. (#16773)
|
2026-01-09 11:08:17 +08:00 |
|
|
Liangsheng Yin
|
064ae3419e
|
Adjust the cancel PR workflows for better preemption. (#16749)
|
2026-01-09 03:25:41 +08:00 |
|
|
Liangsheng Yin
|
8867d24879
|
Tiny adjust cancel PR workflow. (#16697)
|
2026-01-08 11:13:46 +08:00 |
|
|
Liangsheng Yin
|
a7fd810842
|
Allow editable install without .git with add fallback version in pyproject.toml (#16435)
|
2026-01-05 11:17:20 +08:00 |
|
|
Liangsheng Yin
|
229938805f
|
Make personal configs optional in SGLang's official docker image. (#16365)
|
2026-01-04 12:27:13 +08:00 |
|
|
Liangsheng Yin
|
db6b51a838
|
Add CI_PERMISSION sort hook. (#16200)
|
2025-12-31 12:15:15 +08:00 |
|
|
Liangsheng Yin
|
ba67e006a7
|
Refactor speculative algorithm registry. (#16168)
|
2025-12-31 01:24:22 +08:00 |
|
|
Liangsheng Yin
|
4de59d83a1
|
Reduce stages of pr-test from 4 to 3. (#16173)
|
2025-12-30 22:21:48 +08:00 |
|
|
Liangsheng Yin
|
b6871ba7c9
|
[CI] set max-parallel to 4 by default. (#16154)
|
2025-12-30 17:27:48 +08:00 |
|
|
Liangsheng Yin
|
c2601f0d21
|
Fix wrong assigning extend_input_len_per_req with eagle. (#16129)
|
2025-12-30 15:51:53 +08:00 |
|
|
Liangsheng Yin
|
3946dad6fa
|
Add attack204 into CI_PERMISSION (#16131)
|
2025-12-30 13:55:00 +08:00 |
|
|
Liangsheng Yin
|
ac03ec0851
|
Add PR review process into template. (#16133)
|
2025-12-30 13:45:56 +08:00 |
|
|
Liangsheng Yin
|
a435f55d18
|
Tiny print launch command with shlex (#16010)
|
2025-12-29 11:26:46 +08:00 |
|
|
Liangsheng Yin
|
be3828a13b
|
Tiny cleanup duplicate code for multi-layer eagle worker. (#16004)
|
2025-12-28 18:08:20 +08:00 |
|
|
Liangsheng Yin
|
c7e7bfa32c
|
Add EAGLE3 test with MMLU dataset. (#15945)
|
2025-12-28 16:07:58 +08:00 |
|
|
Liangsheng Yin
|
bf90ea9c5b
|
Unify spec v2's naming manner. (#15990)
|
2025-12-28 14:14:52 +08:00 |
|
|
Liangsheng Yin
|
9ad546d7e8
|
Tiny cleanup the models' name in test_utils (#15920)
|
2025-12-27 14:13:23 +08:00 |
|
|
Liangsheng Yin
|
e75657c839
|
[Bug] fix piggyback load report return None bug (#15870)
|
2025-12-26 14:48:45 +08:00 |
|
|
Liangsheng Yin
|
cb1812954a
|
Introduce ModelRunnerKVCacheMixin to simplify the code. (#15821)
|
2025-12-26 11:17:33 +08:00 |
|
|
Liangsheng Yin
|
f4e835af2f
|
Cleanup ModelRunner (#15802)
|
2025-12-25 18:13:30 +08:00 |
|
|
Liangsheng Yin
|
b311c43d13
|
Clarify None handling in sglang's environ (#15770)
|
2025-12-25 11:40:17 +08:00 |
|
|
Liangsheng Yin
|
159b128357
|
Tiny add flush for CI crash locating (#15769)
|
2025-12-24 22:47:10 +08:00 |
|
|
Liangsheng Yin
|
d5fbbfd988
|
Retry removing wrong logic about max total token in spec decoding (#15748)
|
2025-12-24 21:13:26 +08:00 |
|
|
Liangsheng Yin
|
cb719c74ad
|
[2/N] clean duplicate code of logprob processing in spec. (#15593)
|
2025-12-24 15:21:13 +08:00 |
|
|
Liangsheng Yin
|
6292c24437
|
Tiny fix test eagle infer b. (#15716)
|
2025-12-24 11:57:15 +08:00 |
|
|
Liangsheng Yin
|
5f5a567768
|
Tiny add flush in the suite partition status print. (#15719)
|
2025-12-24 11:55:59 +08:00 |
|
|
Liangsheng Yin
|
0d0367e9d0
|
Tiny fix CI (#15696)
|
2025-12-24 01:51:08 +08:00 |
|
|
Liangsheng Yin
|
bd572360f3
|
Tiny apply gsm8k mixin to ngram test (#15606)
|
2025-12-24 01:30:26 +08:00 |
|
|
Liangsheng Yin
|
705287b2e5
|
Tiny add more information in retract logging. (#15694)
|
2025-12-24 00:43:36 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
3c882db3ad
|
Adjust wrong mtp meaning introduce by mimo (#15632)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-23 02:06:46 +08:00 |
|
|
Liangsheng Yin
|
beae3f961c
|
Adapt fixture-kit to gsm8k mixin (#15599)
|
2025-12-22 14:19:35 +08:00 |
|
|
Liangsheng Yin
|
393e2f9b62
|
Revert "[FusedMoE] Fix fused w13 tp sharded weight loading" (#15579)
|
2025-12-22 04:15:24 +08:00 |
|
|
Liangsheng Yin
|
8766a1dd24
|
[1 / N] Clean up logprob utils (#15509)
|
2025-12-22 03:12:25 +08:00 |
|
|
Liangsheng Yin
|
b9ebf0ed63
|
Clean hidden_states_before_norm (#15485)
|
2025-12-20 09:38:46 +08:00 |
|
|
Liangsheng Yin
|
5dccd9bdcc
|
Enhance protection rules of code owners (#15406)
|
2025-12-20 00:25:57 +08:00 |
|
|
Liangsheng Yin
|
933cef16cc
|
Tiny fix mimo model conflicts with main (#15483)
|
2025-12-19 23:20:59 +08:00 |
|
|
Liangsheng Yin
|
374ad4cce0
|
Fix gpt-oss yarn with truncate argument (#14270)
|
2025-12-18 16:31:15 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
8b0a68f1bf
|
Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 16:28:07 +08:00 |
|
|
Liangsheng Yin
|
0c00220795
|
tiny unify environ usage (#15335)
|
2025-12-17 23:31:43 +08:00 |
|
|
Liangsheng Yin
|
ecb401ed42
|
Enhance runtime memory check in CI (#15192)
|
2025-12-16 21:40:38 +08:00 |
|
|
Liangsheng Yin
|
372507649d
|
Tiny improve summary text in bench_one_batch_server.py (#15158)
|
2025-12-15 14:59:11 +08:00 |
|
|
Liangsheng Yin
|
5c75907e62
|
Introduce native kv cache move (#15108)
|
2025-12-14 17:23:28 +08:00 |
|
|
Liangsheng Yin
|
ed52d01b0b
|
Fix spec info's filter when reqs are finished right after prefill (#14742)
|
2025-12-14 00:32:54 +08:00 |
|
|
Liangsheng Yin
|
90e7d4f78f
|
Tiny adjust CI run suite (#15074)
|
2025-12-14 00:05:19 +08:00 |
|
|
Liangsheng Yin
|
d977dd2e07
|
Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740)
|
2025-12-13 23:04:41 +08:00 |
|
|
Liangsheng Yin
|
01e3b3f3a3
|
Fix decode OOM caused by retraction (#14939)
|
2025-12-13 12:59:17 +08:00 |
|
|
Liangsheng Yin
|
7160283800
|
Tiny remove the duplicate function in spec v2 (#14957)
|
2025-12-13 11:08:27 +08:00 |
|
|
Liangsheng Yin
|
c660d8dfd0
|
Re-org eagle unit tests (#14909)
|
2025-12-12 12:25:39 +09:00 |
|
|
Liangsheng Yin
|
543d62d11a
|
Introduce server_fixtures in sglang.test (#14899)
|
2025-12-11 22:30:33 +09:00 |
|
|
Liangsheng Yin
|
bd7824b24d
|
Minor code style fix for dllm (#14836)
|
2025-12-11 10:35:42 +09:00 |
|
|
Liangsheng Yin
|
503880dbbe
|
[CI] fix UT success check in test_eagle_infer_beta_dp_attention.py (#14831)
|
2025-12-11 01:00:50 +09:00 |
|
|
Liangsheng Yinandzhanghaotong
|
cbc7dcdaa7
|
Re-add the API serving timing metrics. (#14744)
Signed-off-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
Co-authored-by: zhanghaotong <zhanghaotong.zht@antgroup.com>
|
2025-12-10 10:17:48 +09:00 |
|
|
Liangsheng Yin
|
125e17efd5
|
Add small model test for spec v2 + dp + trtllm_mla (#14576)
|
2025-12-07 23:55:00 +08:00 |
|
|
Liangsheng Yin
|
88c459c6c8
|
Tiny remove wrong import from python.sglang (#14577)
|
2025-12-07 22:07:49 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
441420e149
|
Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-04 22:35:00 +08:00 |
|
|
Liangsheng Yin
|
24903b88ba
|
Tiny adjust CI testcases (#14362)
|
2025-12-03 21:19:51 +08:00 |
|
|
Liangsheng Yin
|
427a19b643
|
Remove cargo config also in .zshenv (#14267)
|
2025-12-02 11:31:53 +08:00 |
|
|
Liangsheng Yin
|
a2423052f6
|
Add cuda event based on waiting value (#14214)
|
2025-12-01 18:51:44 +08:00 |
|
|
Liangsheng Yin
|
0a9d64530d
|
Support grammar + spec + reasoning (#14163)
|
2025-11-30 21:19:57 +08:00 |
|
|
Liangsheng Yin
|
bab033b970
|
Adjust max-parallel for CUDA CI (#14057)
|
2025-11-27 20:48:37 +08:00 |
|
|
Liangsheng Yin
|
0dd759e087
|
Put pr-gate after check-changes (#14009)
|
2025-11-27 01:40:16 +08:00 |
|
|
Liangsheng Yin
|
6c190cbda0
|
Rename: --hooks to --forward-hooks (#13994)
|
2025-11-26 22:26:28 +08:00 |
|
|
Liangsheng Yin
|
eff6a07c8f
|
Fix get_load API (#13991)
|
2025-11-26 22:07:51 +08:00 |
|
|
Liangsheng Yin
|
3421d049aa
|
[CI] rename: per_commit -> registered (#13928)
|
2025-11-25 23:05:06 +08:00 |
|
|
Liangsheng Yinandalisonshao
|
d3d404d3d7
|
[CI] CI registry update (#13927)
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com>
|
2025-11-25 22:43:19 +08:00 |
|
|
Liangsheng Yin
|
b60e769d0e
|
Tiny unpin uvloop for other backends (#13858)
|
2025-11-25 01:34:57 +08:00 |
|