|
ab9a46d462
|
Support configuring the request limit per receiving poll (#14076)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com>
|
2025-11-28 16:14:21 +08:00 |
|
|
vipwangerxiaoandPeng Wang
|
15729dbc8e
|
Use dynamically maintained num_waiting_tokens in get_load() (#13203)
Signed-off-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
|
2025-11-26 20:34:45 +08:00 |
|
|
vipwangerxiaoandPeng Wang
|
8f01a12d43
|
Improve overlap scheduling for better TTFT (#11856)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
|
2025-11-12 11:24:04 +08:00 |
|
|
vipwangerxiaoandPeng Wang
|
8982418957
|
Fix 'KeyError' for per_token expert distribution recorder (#9501)
Signed-off-by: Peng Wang <rocking@linux.alibaba.com>
Co-authored-by: Peng Wang <rocking@linux.alibaba.com>
|
2025-10-25 03:28:50 +00:00 |
|