Byron Hsu 2d831c6ef9 [PD] Support structured output (#6560)

2025-05-23 21:49:00 -07:00

..

base

[PD] Add support for different TP sizes per DP rank (#5922)

2025-05-12 13:55:42 -07:00

fake

[PD] Add doc and simplify sender.send (#6019)

2025-05-21 21:22:21 -07:00

mooncake

[PD] support spec decode (#6507)

2025-05-23 12:03:05 -07:00

nixl

Refactor group_concurrent_contiguous in NIXL (#6214)

2025-05-21 11:55:04 +08:00

decode_schedule_batch_mixin.py

[PD] Support structured output (#6560)

2025-05-23 21:49:00 -07:00

decode.py

[PD] Support structured output (#6560)

2025-05-23 21:49:00 -07:00

kv_events.py

[Metrics] Add KV events publishing (#6098)

2025-05-19 14:19:54 -07:00

mini_lb.py

[PD] Support logprob & Add failure test (#6558)

2025-05-23 14:29:20 -07:00

prefill.py

[PD] Support structured output (#6560)

2025-05-23 21:49:00 -07:00

utils.py

[PD] Support logprob & Add failure test (#6558)

2025-05-23 14:29:20 -07:00