Leon Gao b1246c50f8 Fix chunked prefill and KV cache leaks for streaming sessions (#20476) ...

Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>

2026-03-13 02:36:55 -07:00

..

test_session_control.py

Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453)

2026-03-10 12:50:57 -07:00

test_session_latency.py

Fix streaming session with paged KV cache (SWA/MLA) (#20070)

2026-03-08 03:00:32 -07:00

test_streaming_session_leak.py

Fix chunked prefill and KV cache leaks for streaming sessions (#20476)

2026-03-13 02:36:55 -07:00