Yuhao Yang
|
39ca57cd28
|
[diffusion] chore: tiny fix model config (#16159)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-30 22:11:38 +08:00 |
|
Mick
|
3449806727
|
[diffusion] feat: generalize layer-wise-offload to all supported models (#16150)
|
2025-12-30 22:06:57 +08:00 |
|
Ke Bao
|
b3817fa93b
|
Split model_worker init function (#16160)
|
2025-12-30 21:39:11 +08:00 |
|
Ke Bao
|
059428bd8a
|
Tiny remove additional args in init_memory_pool (#16158)
|
2025-12-30 21:38:06 +08:00 |
|
jiapingW
|
5d200dd8d9
|
[diffusion] bench: distinguish between video generation and image generation in the bench_serving (#16149)
|
2025-12-30 21:29:18 +08:00 |
|
husf
|
7f9a3d0609
|
[docs][NPU]Update model and feature docs support (#16124)
|
2025-12-30 20:05:40 +08:00 |
|
Jumiar
|
664f611e83
|
Add profiling capture support to the encoder server (#15730)
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
|
2025-12-30 19:56:25 +08:00 |
|
yh0903
|
49adb37e37
|
[diffusion] chore: fix ZMQ binding and model loading for FastWan compatibility (#13978)
Co-authored-by: Han Yu <hyu5@dt-login01.delta.ncsa.illinois.edu>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-30 18:09:38 +08:00 |
|
Gaoji Liu
|
7518dc3532
|
feat(SpecEagleV2): add standalone_worker_v2 (#12625)
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
|
2025-12-30 17:55:04 +08:00 |
|
Liangsheng Yin
|
b6871ba7c9
|
[CI] set max-parallel to 4 by default. (#16154)
|
2025-12-30 17:27:48 +08:00 |
|
Baizhou Zhang
|
98225be6e5
|
[CI] Fixing release with cut branch workflow (#16153)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
|
2025-12-30 17:18:02 +08:00 |
|
Yuan Luo
|
94bcc19bce
|
[VLM] Support Video for InternVL3_5 (#15942)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-30 17:07:49 +08:00 |
|
Shangming Cai
|
db3821a9ef
|
[PP] Add a minimum chunk value for PP dynamic chunking (#16140)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-30 16:35:39 +08:00 |
|
Alison Shao
|
8c5d91b884
|
Fix race condition in /tag-and-rerun-ci command (#16142)
|
2025-12-30 15:55:49 +08:00 |
|
Qiaolin Yu
|
6a3e709253
|
Tiny rename test_deepseek_v3_fp4_mtp_stage_b.py (#16141)
|
2025-12-30 15:55:07 +08:00 |
|
Liangsheng Yin
|
c2601f0d21
|
Fix wrong assigning extend_input_len_per_req with eagle. (#16129)
|
2025-12-30 15:51:53 +08:00 |
|
Vitaly Tuzov
|
1048803c1f
|
Reworked fast_pos_embed_interpolate() using torch (#10959)
|
2025-12-30 14:45:34 +08:00 |
|
HuangJi
|
8a84b1e7e0
|
[diffusion] model: support TurboWan2.1-T2V-1.3B/14B SLA (#15888)
|
2025-12-30 14:30:22 +08:00 |
|
Bingxu Chen
|
5e20e7a60d
|
[AMD CI] Organize AMD nightly perf test files (#16114)
|
2025-12-29 22:09:46 -08:00 |
|
Liangsheng Yin
|
3946dad6fa
|
Add attack204 into CI_PERMISSION (#16131)
|
2025-12-30 13:55:00 +08:00 |
|
Liangsheng Yin
|
ac03ec0851
|
Add PR review process into template. (#16133)
|
2025-12-30 13:45:56 +08:00 |
|
Stefan He
|
9416464682
|
Fix Qwen Next GDN w/ Radix Cache (#16053)
|
2025-12-29 21:06:06 -08:00 |
|
Cheng Wan
|
5fb734f1a5
|
Enhance comments in set_extend_input_len method (#16130)
|
2025-12-29 20:47:33 -08:00 |
|
Cheng Wan
|
60f1ca6925
|
Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105)
|
2025-12-30 12:38:33 +08:00 |
|
Vladimir Serov
|
9e263c2162
|
[LoRA] Torch native backend: rework implementation and updated tests (#15187)
|
2025-12-30 11:48:51 +08:00 |
|
Kangyan-Zhou
|
0d003e34b0
|
Reduce CI failure monitor to run once every 12 hours (#16123)
|
2025-12-29 19:44:25 -08:00 |
|
Prozac614
|
f253f43c9d
|
[diffusion] CI: fix LoRA downloading issues and respect offline flag (#15813)
|
2025-12-30 11:39:27 +08:00 |
|
Mick
|
1e45320198
|
[diffusion] improve: tiny improve layerwise offload manager by consolidating weights per layer (#16081)
|
2025-12-30 11:31:00 +08:00 |
|
Mick
|
26e17f9076
|
[diffusion] improve: tiny speedup qwen-image-edit-2511 by avoiding unnecessary calculation (#15896)
|
2025-12-30 10:10:32 +08:00 |
|
Ke Bao
|
3de23274ee
|
Clean up swa handling in fa3 backend (#15877)
|
2025-12-30 08:51:40 +08:00 |
|
Alison Shao
|
f4ec6f8e17
|
ci: migrate remaining spec/eagle tests to test/registered/spec/ (#15800)
|
2025-12-29 14:00:00 -08:00 |
|
Kangyan-Zhou
|
9c4eb46099
|
Add a new branch cut GH workflow, and adopt setuptools-scm for version control (#15985)
|
2025-12-29 13:51:21 -08:00 |
|
Cheng Wan
|
c2e0913e17
|
Fix extend_input_len calculation in decode.py (#16103)
|
2025-12-29 13:13:24 -08:00 |
|
Simo Lin
|
8c6f865afb
|
[model-gateway]: optimize prefix_match with zero-copy tenant and deferred char count (#16099)
|
2025-12-29 11:32:57 -08:00 |
|
Alison Shao
|
269aa27bff
|
Enable testing slash command handler changes on non-fork PRs (#15921)
|
2025-12-29 11:30:39 -08:00 |
|
Simo Lin
|
f39382c6ca
|
[model-gateway] Fix duplicate classify prefix in response ID (#16101)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 11:07:21 -08:00 |
|
Simo Lin
|
2ff289e2dc
|
[model-gateway] Generate UUID-based request IDs for embedding/classify (#16100)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 10:49:58 -08:00 |
|
Simo Lin
|
b2a3f0551a
|
[model-gateway] Wire classify pipeline to gRPC router (#16098)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 10:44:45 -08:00 |
|
Simo Lin
|
684e148e38
|
[model-gateway] Optimize INSERT with leaf-only timestamp updates (#16097)
|
2025-12-29 10:43:20 -08:00 |
|
Simo Lin
|
f44c4b3715
|
[model-gateway] Add classify pipeline stages and protocol types (#16094)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 10:23:36 -08:00 |
|
shuwenn
|
7380ec9d55
|
[CI] fix test_mla_deepseek_v3.py (#16096)
|
2025-12-29 10:18:02 -08:00 |
|
Simo Lin
|
ac78f96ec5
|
[model-gateway] Optimize radix tree timestamp updates for multi-tenant scaling (#16093)
|
2025-12-29 10:08:19 -08:00 |
|
jiapingW
|
278012caa0
|
[Feature] support bench jsonl files with sharegpt format (#15057)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-29 10:06:11 -08:00 |
|
Simo Lin
|
7f5879985c
|
[model-gateway] Improve tree benchmark with realistic multi-tenant scenarios (#14838)
|
2025-12-29 08:37:24 -08:00 |
|
Simo Lin
|
162d1cf9be
|
[model-gateway] Add classification model support infrastructure (#16061)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 08:34:05 -08:00 |
|
Mick
|
8e08207c18
|
[diffusion] fix: fix serving with dit-layerwise-offload enabled (#16066)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-30 00:21:42 +08:00 |
|
Simo Lin
|
c31f62722c
|
[model-gateway] fix tokenizer to match transformers special token handling (#16087)
|
2025-12-29 08:13:03 -08:00 |
|
Mick
|
b5d9fc873b
|
[diffusion] chore: minor refactor by streamlining the VAE class hierarchy (#16069)
|
2025-12-29 23:37:59 +08:00 |
|
Xiaoyu Zhang
|
88f3de2514
|
[JIT kernel] Jit kernel add codeowners (#16085)
|
2025-12-29 22:32:55 +08:00 |
|
Xiaoyu Zhang
|
24616c5234
|
[Diffusion] Qwen image edit support qknorm optimization (#16062)
|
2025-12-29 21:37:24 +08:00 |
|