Zhiqiang Xie
|
13f4f010d8
|
HiSparse for Sparse Attention (#20343)
|
2026-03-22 23:09:31 -07:00 |
|
 
|
36b557d2c9
|
Fix streaming session with paged KV cache (SWA/MLA) (#20070)
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-03-08 03:00:32 -07:00 |
|
Liangsheng Yin
|
d02c515ee8
|
Decouple scheduler log printing from metrics collection (#20107)
|
2026-03-07 22:09:10 -08:00 |
|
 sglang-botandClaude Opus 4.6
|
ebb66cc1de
|
[misc] Priority scheduling metrics cleanup (#19927)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
|
2026-03-05 12:42:42 -08:00 |
|
 zhuxinjie-nzandhnyls2002
|
28c931e1a5
|
feat: Priority-based scheduling optimization (including default priority, preemption toggle, priority-based metrics, etc.) (#17026)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-04 14:52:08 -08:00 |
|
Liangsheng Yin
|
e08ef06758
|
[Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531)
|
2026-02-27 18:14:55 -08:00 |
|
 Aurick Qiaoandhnyls2002
|
c6cb0c9649
|
[Session] Add streaming mode with SessionAwareCache fast path (#19171)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-02-27 16:31:08 -08:00 |
|
Ke Bao
|
7f8a58fffb
|
Refactor prefix cache type checking (#17028)
|
2026-01-15 11:28:13 +08:00 |
|
Liangsheng Yin
|
5b7bed7ca4
|
Decouple grammar logic out of scheduler. (#16820)
|
2026-01-12 10:52:42 +08:00 |
|
fzyzcjy
|
c89949bbaf
|
Tiny let soft watchdog cover initialization phase (#16853)
|
2026-01-10 13:20:08 +08:00 |
|
fzyzcjy
|
c6a6ba4368
|
Tiny refactor request logger (#15740)
|
2025-12-24 19:51:26 +08:00 |
|
fzyzcjy
|
454a2544f2
|
Support soft watchdog for tokenizer/detokenizer/dp-controller processes (#15607)
|
2025-12-22 16:59:16 +08:00 |
|
 ![github-actions[bot] <github-actions[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)
|
92e6b3c30e
|
[Auto Sync] Update scheduler_runtime_checker_mixin.py (20251219) (#15437)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-12-19 01:46:03 -08:00 |
|
Lianmin Zheng
|
9d64a7b24f
|
Minor style fixes to the scheduler.py (#15218)
|
2025-12-16 17:09:44 -08:00 |
|
Liangsheng Yin
|
ecb401ed42
|
Enhance runtime memory check in CI (#15192)
|
2025-12-16 21:40:38 +08:00 |
|
Hanming Lu
|
e61dabf5e4
|
[Qwen3-next] support mamba radix cache for overlap scheduler (#14792)
|
2025-12-14 18:54:16 -08:00 |
|
fzyzcjy
|
313f59ad80
|
Add soft watchdogs to debug soft hangs (#15023)
|
2025-12-13 10:41:35 +08:00 |
|
fzyzcjy
|
487cf81a68
|
Tiny extract SchedulerWatchdog (#15021)
|
2025-12-13 10:40:32 +08:00 |
|
kun-llfl
|
cef5ba65b1
|
[Bugfix] Fix environ error in scheduler_runtime_checker_mixin.py (#14461)
Signed-off-by: Kun(llfl) <i@imux.top>
|
2025-12-09 20:33:41 +08:00 |
|
Yuhao Yang
|
b9bef31a15
|
fix: use .get() when accessing strict mem-check env variable (#14657)
|
2025-12-08 13:25:42 -08:00 |
|
roikoren755
|
2ce121a1c3
|
Enable RadixCache for Mamba2 models (#13584)
|
2025-12-05 18:23:58 +08:00 |
|
  ![github-actions[bot] <github-actions[bot]@users.noreply.github.com>](/assets/img/avatar_default.png)
|
64092c8b55
|
[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
|
2025-12-01 23:24:24 -08:00 |
|
Liangsheng Yin
|
5c2915494c
|
[Scheduler] Tiny organize code style (#13806)
|
2025-11-23 23:41:34 +08:00 |
|
Liangsheng Yin
|
3e804bb0ba
|
Update mem checker during busy (#13704)
|
2025-11-22 21:15:02 +08:00 |
|
Zilin Zhu
|
9edb0e0da3
|
Add SGLANG_ENABLE_REQ_POOL_LEAK_STRICT_CHECK to bypass mem leak check (#13339)
|
2025-11-16 22:02:22 +08:00 |
|
Liangsheng Yin
|
dc8a5a1ce7
|
[Refactor / Style] Unify all event loops (except for PP) (#12959)
|
2025-11-10 14:49:12 +08:00 |
|
 Liangsheng Yinandcctry
|
4f65a64666
|
Refactor / Unify event loop across PD-Disagg, Overlap, DP-Attn cases (#12839)
Co-authored-by: cctry <17473714+cctry@users.noreply.github.com>
|
2025-11-10 00:42:50 +08:00 |
|
Liangsheng Yin
|
2c9aebea70
|
Simplify watchdog (#12463)
|
2025-10-31 21:17:38 +08:00 |
|
 cctryandLiangsheng Yin
|
b0b4f71679
|
[Fix] memory leak by overlap + retract (#11981)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-10-23 22:59:23 +08:00 |
|
Liangsheng Yin
|
32852fe9e9
|
Move memory runtime checker to mixin class (#12014)
|
2025-10-23 20:53:26 +08:00 |
|