Liangsheng YinandLianmin Zheng 836873b99f Fix memory leak when aborting decode request in PD-Disagg (#9817) ...

Co-authored-by: Lianmin Zheng <15100009+merrymercy@users.noreply.github.com>

2025-08-30 14:36:03 +08:00

..

ascend

[Feature] Support NPUGraph for DeepSeek on Ascend NPU (#9355)

2025-08-28 16:06:24 -07:00

base

[PD] Support PD disaggregation with Prefill PP (#8846)

2025-08-16 18:31:31 -07:00

common

[P/D] Support ipv6 in P/D scenario (#7858)

2025-07-25 08:53:30 -07:00

fake

Minor PD style fix (#7215)

2025-06-15 16:12:12 -07:00

mooncake

[PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261)

2025-08-20 19:29:10 -07:00

nixl

[P/D] Support ipv6 in P/D scenario (#7858)

2025-07-25 08:53:30 -07:00

decode_schedule_batch_mixin.py

[Feat] QWen-1M context support[2/2]: Update block sparse attention backend (#5949)

2025-08-06 23:49:36 -07:00

decode.py

[PD] Improve disaggregation metrics output: update the metrics to keep reflecting real stats (#7317)

2025-08-24 23:16:43 -07:00

kv_events.py

feat: add dp-rank to KV events (#6852)

2025-06-04 15:29:34 -07:00

launch_lb.py

Fix memory leak when aborting decode request in PD-Disagg (#9817)

2025-08-30 14:36:03 +08:00

mini_lb.py

[PD] Support get_model_info interface for mini_lb (#9792)

2025-08-29 00:54:03 -07:00

prefill.py

[HiCache] resolve conflict between chunked-prefill and hicache hit count (#9776)

2025-08-30 01:30:54 +08:00

utils.py

[PD] Fix nvlink transport accuracy through transferring metadata with tcp (#9261)

2025-08-20 19:29:10 -07:00