Leon Gao
|
b1246c50f8
|
Fix chunked prefill and KV cache leaks for streaming sessions (#20476)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-13 02:36:55 -07:00 |
|
Qiaolin Yu
|
a3d88a247b
|
Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453)
|
2026-03-10 12:50:57 -07:00 |
|
Liangsheng Yin
|
36b557d2c9
|
Fix streaming session with paged KV cache (SWA/MLA) (#20070)
Co-authored-by: Yilong Zhao <74357408+happierpig@users.noreply.github.com>
Co-authored-by: Aurick Qiao <6137920+aurickq@users.noreply.github.com>
|
2026-03-08 03:00:32 -07:00 |
|
Liangsheng Yin
|
69ec15ad74
|
[CI] Re-enable streaming session tests with correctness and stress coverage (#20084)
|
2026-03-07 18:18:11 -08:00 |
|
Alison Shao
|
c584158135
|
[CI] Temporarily disable flaky test_priority_metrics on CUDA (#20075)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
|
2026-03-06 20:34:45 -08:00 |
|
Liangsheng Yin
|
e08ef06758
|
[Session] Gate streaming sessions with --enable-streaming-session and spec v2 guard (#19531)
|
2026-02-27 18:14:55 -08:00 |
|
Aurick Qiao
|
c6cb0c9649
|
[Session] Add streaming mode with SessionAwareCache fast path (#19171)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-02-27 16:31:08 -08:00 |
|