 siyu
|
c6184b7dc0
|
Fix EPD OOM by offloading precomputed_embeddings during chunked prefill (#16503)
|
2026-03-08 20:10:40 -07:00 |
|
|
siyu
|
c0fdfd4b92
|
Delete mm.feature after decode phase (#17324)
|
2026-02-24 18:13:03 -08:00 |
|
|
|
245430eaac
|
Encoder Global Cache Manager (#16137)
Co-authored-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2026-02-24 18:05:43 -08:00 |
|
|
siyu
|
0b15f19927
|
[EPD] Add notification mechanism to fix server hang and add timeout env var (#18229)
|
2026-02-10 11:52:54 +08:00 |
|
|
siyu
|
f1824a957b
|
[EPD][refactor]: introduce BaseMMReceiver for gRPC transport integration (#17921)
|
2026-02-02 11:37:32 +08:00 |
|
|
siyuandYuhao Yang
|
4d00bd17a3
|
use shared memory for multimodal feature transport between Tokenizer and Scheduler (#16402)
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-27 11:01:08 -08:00 |
|
|
siyu
|
17349168bb
|
set cooldown_interval_minutes to 0 for liusy58 (#17637)
|
2026-01-22 23:36:05 -08:00 |
|
|
siyu
|
62e6a749b0
|
Skip mm feature pool init to avoid EPD OOM (#16388)
|
2026-01-23 10:53:45 +08:00 |
|
|
siyuandZhengWG
|
7520b92927
|
Support EPD error handling (#16670)
Co-authored-by: ZhengWG <zwg0606@gmail.com>
|
2026-01-21 18:47:00 +08:00 |
|
|
siyu
|
e18e0057a4
|
Add an env var to allow transferring small metadata via TCP for PD (#16951)
|
2026-01-16 18:32:22 -08:00 |
|
|
siyu
|
068abe7e40
|
add doc for #14386 (#14655)
|
2026-01-09 22:38:51 +08:00 |
|
|
siyu
|
6b3f93c4dd
|
vlm: support SGLANG_MM_SKIP_COMPUTE_HASH for bypassing multimodal feature hashing (#16555)
|
2026-01-08 11:10:00 +08:00 |
|
|
|
fba785c459
|
use aync load for encoder_server (#15456)
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: liuanqi <liuanqi6@xiaomi.com>
|
2026-01-06 14:31:52 +08:00 |
|
|
|
078d96213a
|
[FEAT] optimize tensor zmq transfer for multimodal inputs (#13592)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2026-01-03 12:23:23 +08:00 |
|
|
siyu
|
abdf65d4f3
|
Fix OOM by offloading multimodal features to CPU after embedding (#16018)
|
2025-12-31 23:02:34 +08:00 |
|