Cherry_ming
|
1808df48fe
|
[NPU]add nightly-test-npu (#14143)
|
2025-12-05 00:43:35 +08:00 |
|
Simo Lin
|
b01fc161eb
|
[model-gateway] introduce request ctx for oai router (#14434)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 08:31:44 -08:00 |
|
WenhaoZhang
|
788628b56f
|
[diffusion] feat: Add Configurable Generator Device and Seed Support via API (#14366)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-05 00:25:09 +08:00 |
|
Simo Lin
|
11d33c0e8f
|
[model-gateway] add phi4 vision image processor (#14430)
|
2025-12-04 07:40:33 -08:00 |
|
Liangsheng Yin
|
441420e149
|
Add mooncake transfer_engine_bench into maunal test (#14429)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-04 22:35:00 +08:00 |
|
Raul Torres
|
29a2d4b59f
|
Add 'NPU' to the runtime exception message in get_device (#14225)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-12-04 17:34:31 +03:00 |
|
R0CKSTAR
|
079ac237da
|
[diffusion] fix: fix gen video doc (#14409)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-04 22:05:38 +08:00 |
|
Daniel Cámpora
|
8428078436
|
Add Mistral Large 3 support. (#14213)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-04 20:00:05 +08:00 |
|
Xuchun Shang
|
af35023e65
|
[bug fix] fix ima with get_mla_kv_buffer_kernel overflow (#14224)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-04 01:20:11 -08:00 |
|
Qiaolin Yu
|
cb8df87fc1
|
[1/2] Add rope kernel in sgl-kernel (#14334)
|
2025-12-04 16:45:44 +08:00 |
|
fzyzcjy
|
e3ab23c1a6
|
Try to fix B200 DeepEP error (#14399)
|
2025-12-04 00:41:24 -08:00 |
|
jianan-gu
|
70d2587324
|
[CPU] Optimize small oc GEMM for Qwen3-next on CPU (#12446)
Co-authored-by: Zheng, Beilei <beilei.zheng@intel.com>
|
2025-12-04 00:38:47 -08:00 |
|
Even Zhou
|
894c0dc57c
|
[NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359)
|
2025-12-04 16:15:31 +08:00 |
|
yctseng0211
|
d6c490192d
|
[AMD] fix the regression issue for DeepseekV3 on MI300 (#14383)
|
2025-12-03 23:30:11 -08:00 |
|
Simo Lin
|
fa78c44a3d
|
[model-gateway] introduce provider in openai router (#14394)
|
2025-12-03 22:47:20 -08:00 |
|
Simo Lin
|
654a78f9c8
|
[model-gateway] add phi3 vision image processor (#14381)
|
2025-12-03 22:32:40 -08:00 |
|
Ma Mingfei
|
f90b400431
|
[CPU] add support for mamba causal conv1d for qwen3-next (#12309)
|
2025-12-04 13:41:42 +08:00 |
|
Wenyi Xu
|
78647e08dd
|
[model-gateway][doc] Add STDIO Explicitly to Example in README (#14393)
|
2025-12-03 20:36:44 -08:00 |
|
Ma Mingfei
|
46f21a5956
|
use faster covnersion from float8_e4m3fn to bfloat16 (#12316)
|
2025-12-04 12:34:05 +08:00 |
|
Yuan Luo
|
b2b09f5f24
|
[VLM] Introduce Cache for positional embedding ids for Qwen-VL family (#14292)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-04 12:32:00 +08:00 |
|
Kevin Li
|
04df80a9a1
|
Support PP x PD decode with nixl backend (#14392)
|
2025-12-04 12:22:17 +08:00 |
|
Zaili Wang
|
4f73e53dcc
|
[CPU] document updates (#14272)
|
2025-12-03 19:56:06 -08:00 |
|
Qi Yuhang
|
16ff892c18
|
[sgl-kernel][Feat][B200][1/N] Support MXFP8 Grouped GEMM in Blackwell (#13731)
Co-authored-by: Yineng Zhang <me@zhyncs.com>
|
2025-12-04 10:09:09 +08:00 |
|
fzyzcjy
|
df026bb110
|
Fix sgl-router silently parse selector wrongly causing OME fail to discover pods (#14359)
|
2025-12-04 09:56:37 +08:00 |
|
Simo Lin
|
d42c167bfd
|
[model-gateway] add qwen3_vl model image processor (#14377)
|
2025-12-03 17:16:37 -08:00 |
|
Simo Lin
|
388151053d
|
[model-gateway] use worker crate in openai router (#14330)
|
2025-12-03 13:36:32 -08:00 |
|
b8zhong
|
9d82340298
|
Revert "Revert "enable csgmv automatically on cuda"" (#14277)
|
2025-12-03 13:12:30 -08:00 |
|
Simo Lin
|
8ab5d8b40d
|
[model-gateway] add qwen2.5_vl model image processor (#14375)
|
2025-12-03 12:51:30 -08:00 |
|
Simo Lin
|
03575ce38d
|
[model-gateway] add qwen2_vl model image processor and tests (#14374)
|
2025-12-03 12:34:06 -08:00 |
|
alisonshao
|
80518bea65
|
Fix validation to detect missing model files before loading (#14253)
|
2025-12-03 11:36:07 -08:00 |
|
Baizhou Zhang
|
7e78825d5a
|
[Tiny]Small fixes in deepseek v32 doc (#14372)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-03 11:35:40 -08:00 |
|
sunxxuns
|
5bbd83a2c8
|
ci: Migrate AMD workflows to new MI325 runners; temporarily disabled failed CI's to be added back (#14226)
|
2025-12-03 11:33:27 -08:00 |
|
Simo Lin
|
abf6272bdd
|
[model-gateway] add llava model image processor and tests (#14371)
|
2025-12-03 11:18:00 -08:00 |
|
Lianmin Zheng
|
46d7b35ec7
|
Move custom_ops under layers; move _custom_ops.py → custom_all_reduce_ops.py (#14326)
|
2025-12-03 10:33:37 -08:00 |
|
Sulfur6-L8972
|
20aad5b5ab
|
Single Batch Overlap for MoE Models (#9660)
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
Co-authored-by: Zqy11 <841971412@qq.com>
Co-authored-by: AniZpZ <aniz1905@gmail.com>
Co-authored-by: TianyuZhang1214 <tianyuzhang1214@gmail.com>
Co-authored-by: Cheng Wan <54331508+ch-wan@users.noreply.github.com>
|
2025-12-03 10:07:42 -08:00 |
|
blzheng
|
974c562a25
|
[CPU] add fused_qkvzba_split_reshape_cat kernel for Qwen3-next (#12330)
|
2025-12-03 23:46:08 +08:00 |
|
Dongjie Zou
|
aca0d01d3f
|
[diffusion] doc: add vae path to cli doc#14004 (#14355)
Co-authored-by: BBuf <1182563586@qq.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-03 15:13:25 +00:00 |
|
VDV1985
|
dc1635023f
|
[NPU][Doc] updated installation guide for Ascend NPU (#13585)
Co-authored-by: Howeee <15935120809@163.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-12-03 16:58:49 +03:00 |
|
Liangsheng Yin
|
24903b88ba
|
Tiny adjust CI testcases (#14362)
|
2025-12-03 21:19:51 +08:00 |
|
Michelle Wu
|
443d7bcd83
|
[Ascend] fix AscendAttnMaskBuilder bug to support float16 models (#14271)
|
2025-12-03 19:37:16 +08:00 |
|
chenxu140
|
16d8de2284
|
[bugfix] NpuFuseEPMoE miss initialization parameters (#14295)
|
2025-12-03 19:36:41 +08:00 |
|
ZhengdQin
|
d122e32467
|
[NPU] bug fix: w_vc need contiguous for NPU batch_matmul_transpose ops (#13980)
|
2025-12-03 19:35:18 +08:00 |
|
Cheng Wan
|
96cc10834a
|
[CI] update estimated elapsed time of some unittests (#14347)
|
2025-12-03 01:21:40 -08:00 |
|
Yuhao Yao
|
77512ae0d7
|
[bugfix] Fix prefill tbo disabled when --deepep-mode=auto (#14333)
Co-authored-by: Cheng Wan <wan4ch@gmail.com>
|
2025-12-03 01:20:33 -08:00 |
|
Xuan Liao
|
c233e9d7a9
|
[CPU] Support chunk_gated_delta_rule kernel for Qwen3-Next (#12441)
|
2025-12-03 17:03:48 +08:00 |
|
Simo Lin
|
58ac3f317b
|
[model-gateway] add image processor and transformer structure (#14344)
|
2025-12-03 00:04:06 -08:00 |
|
Shangming Cai
|
93452a8252
|
[PD] Support decode pp for PD disaggregation (#14265)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-03 14:35:29 +08:00 |
|
b8zhong
|
65c8568c4a
|
sync attention, deepseek doc (#14335)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-02 21:19:40 -08:00 |
|
Baizhou Zhang
|
4bcc5879af
|
[Doc] Fix DeepSeek V32 Doc (#14336)
|
2025-12-02 21:06:55 -08:00 |
|
Simo Lin
|
d5ea8c7176
|
[model-gateway] multimodality initialization (#13350)
|
2025-12-02 19:41:40 -08:00 |
|