 Leon Gao
|
63c38aba5e
|
Fix token leak with logprob_start_len=0 in streaming sessions (#20557)
|
2026-03-19 15:37:27 -07:00 |
|
|
|
b1246c50f8
|
Fix chunked prefill and KV cache leaks for streaming sessions (#20476)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-13 02:36:55 -07:00 |
|
|
Leon Gao
|
07ef5f7be1
|
Remove sync points in mamba cache + prefill cudagraph plumbing for DP (#19639)
|
2026-03-02 15:03:42 +08:00 |
|
|
|
b5a8e4179e
|
[SGL] sync patch: Remove sync points, prefill cudagraph for DP, disable cache reset in mem check (#19190)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
|
2026-02-27 18:11:05 -08:00 |
|
|
Leon Gao
|
ab0fb248fd
|
feat: add SGLANG_DISTRIBUTED_INIT_METHOD_OVERRIDE env var (#18743)
|
2026-02-14 09:37:33 +08:00 |
|