 Yuan Luoandluoyuan.luo
|
165f5c04cb
|
Optimize MiMo-V2-Flash by flashinfer fused allreduce (#15464)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-20 17:45:18 +08:00 |
|
|
Артем Савкин
|
3e01f3a533
|
[NPU] [BUGFIX] [CRITICAL!] Fix NPU inference (torch_npu._npu_reshape_and_cache() crash) (#15484)
|
2025-12-20 14:53:46 +08:00 |
|
|
yctseng0211
|
6468cb5823
|
[AMD] remove the redundant projection (#15178)
|
2025-12-19 22:10:46 -08:00 |
|
|
Qiaolin Yu
|
e220da1723
|
tiny fix sampling seed for completion api (#15498)
|
2025-12-19 20:32:13 -08:00 |
|
|
Yuxuan Zhang
|
b82c7a0ae7
|
[GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333)
|
2025-12-19 20:30:44 -08:00 |
|
|
Liangsheng Yin
|
b9ebf0ed63
|
Clean hidden_states_before_norm (#15485)
|
2025-12-20 09:38:46 +08:00 |
|
|
YL D
|
6afc5d497b
|
[DSv32] Move deep_gemm.get_paged_mqa_logits_metadata to init time as metadata (#15040)
|
2025-12-19 13:23:33 -08:00 |
|
|
Khush Gupta
|
ef908aeb40
|
fixed trtllm nvfp4 backend for moe (#15022)
|
2025-12-19 10:49:21 -08:00 |
|
|
Yuwei An
|
9d0347b33a
|
EP Support for Piecewise Cuda Graph (#14164)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-12-20 01:59:27 +08:00 |
|
|
Liangsheng Yin
|
933cef16cc
|
Tiny fix mimo model conflicts with main (#15483)
|
2025-12-19 23:20:59 +08:00 |
|
|
Hexq0210
|
241ae17b25
|
[NPU] bugfix for chunkedprefill (#15166)
|
2025-12-19 22:41:17 +08:00 |
|
|
Mayyyy
|
2c5a446006
|
[NPU]Fix for ipc handle with npu (#14138)
|
2025-12-19 22:39:04 +08:00 |
|
|
shuwenn
|
5a0ad7310e
|
fix: update model name after weights update (#15416)
|
2025-12-19 21:53:14 +08:00 |
|
|
Jackie
|
5045aa34d3
|
Add MiDasheng Model Support (#15219)
|
2025-12-19 21:41:59 +08:00 |
|
|
|
92e6b3c30e
|
[Auto Sync] Update scheduler_runtime_checker_mixin.py (20251219) (#15437)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-12-19 01:46:03 -08:00 |
|
|
weiliang
|
6559e43f30
|
Support FP8 MLA prefill and 128k context. (#14395)
|
2025-12-19 01:24:00 -08:00 |
|
|
shuwennandLiangsheng Yin
|
fb17845723
|
fix: unreachable error check in retraction (#15433)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-19 16:33:34 +08:00 |
|
|
sunxxunsandThomas Wang
|
f2d64e6782
|
[amd] Add deterministic all-reduce kernel for AMD (ROCm) (#15340)
Co-authored-by: Thomas Wang <1am9trash@gmail.com>
|
2025-12-18 23:36:03 -08:00 |
|
|
Qiaolin Yu
|
173940927f
|
Add customized sampler registration (#15423)
|
2025-12-18 23:10:23 -08:00 |
|
|
Lianmin Zheng
|
f228b662a7
|
Update readme (#15425)
|
2025-12-18 23:06:00 -08:00 |
|
|
b8zhongandEven Zhou
|
a36142aa71
|
Fix Mindspore model import warning (#15287)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-12-18 23:15:33 -05:00 |
|
|
+6
|
160a06cab2
|
[Feature] Xiaomi MiMo-V2-Flash day0 support (#15207)
Co-authored-by: 谢学扬 <xiexueyang@xiaomi.com>
Co-authored-by: tz <tangzhen3@xiaomi.com>
Co-authored-by: 李家乐 <lijiale10@xiaomi.com>
Co-authored-by: 张晨 <zhangchen50@xiaomi.com>
Co-authored-by: Shaohui Liu <liushaohui3@xiaomi.com>
Co-authored-by: 王晨 <wangchen77@xiaomi.com>
Co-authored-by: jiangzihan <jiangzihan@xiaomi.com>
Co-authored-by: xiexueyang <xyxie_wangyi@163.com>
Co-authored-by: Linghao Zhang <zhanglinghao@xiaomi.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: JoyFuture <35593546+JoyFuture@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: root <root@bj9-ml-g8h20e-k8s-slave106-20251106.alicn.idc.xiaomi.com>
|
2025-12-19 11:40:07 +08:00 |
|
|
Zehuan Li
|
f6c9db4bc4
|
[DLLM] Fix dLLM regression (#15371)
|
2025-12-19 10:55:46 +08:00 |
|
|
b8zhong
|
e88e75a9df
|
[Deepseek V3.2] Fix Deepseek MTP in V1 mode (#15429)
|
2025-12-18 17:56:07 -08:00 |
|
|
Zehuan Li
|
b2803ff207
|
[DLLM] Add CI for diffusion LLMs (#14723)
|
2025-12-19 08:54:03 +08:00 |
|
|
Charles Chen
|
9e0ef04e5b
|
Support using different attention backend for draft decoding. (#14843)
|
2025-12-19 08:49:11 +08:00 |
|
|
Jimmy
|
216067c0cb
|
feat(dsv32): better error handling for DeepSeek-v3.2 encoder (#14353)
|
2025-12-18 16:34:27 -08:00 |
|
|
Feng Su
|
29e8f7f9e5
|
multimodal: precompute hash for MultimodalDataItem (#14354)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
Signed-off-by: Junjie Mao <junjie.mao@linux.alibaba.com>
|
2025-12-18 15:27:59 -08:00 |
|
|
Johnsonms
|
e0026f7c92
|
[Performance] optimize NSA backend metadata computation for multi-step speculative decoding (#14781)
|
2025-12-18 13:48:27 -08:00 |
|
|
Baizhou Zhang
|
2b0ddf89f5
|
[Tiny]Add warning for deepgemm on Blackwell (#15352)
|
2025-12-18 13:45:26 -08:00 |
|
|
fzyzcjy
|
88a405cc10
|
Support EPLB balancedness prometheus metric without GPU->CPU synchronize (#15401)
|
2025-12-18 22:24:23 +08:00 |
|
|
fzyzcjy
|
602fe3b296
|
Super tiny add moe_ep_rank to prometheus labels (#15407)
|
2025-12-18 22:23:20 +08:00 |
|
|
fzyzcjy
|
ad9616f13a
|
Tiny extract ModelRunnerOutput (#15400)
|
2025-12-18 22:18:45 +08:00 |
|
|
fzyzcjy
|
c5f4e20f2f
|
Support GPU execution time breakdown by forward mode metrics (#15396)
|
2025-12-18 22:18:17 +08:00 |
|
|
fzyzcjyandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2c196f95a7
|
Tiny fix unknown route in prometheus metrics (#15404)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 22:17:46 +08:00 |
|
|
Bruce-x-1997
|
793c96c3d2
|
[perf]optimize w4afp8 kernel on deepseek-v3-0324 (#12921)
Signed-off-by: bruce.xu <bruce.x@gmicloud.ai>
|
2025-12-18 18:13:22 +08:00 |
|
|
Lianmin Zheng
|
d1f0063262
|
Clean up __init__ function of the scheduler and event loop for PD (#15298)
|
2025-12-18 01:35:14 -08:00 |
|
|
Xuchun ShangandShangming Cai
|
fea2d5211d
|
[bug fix][pp] fix inconsistent latency between tp (#15379)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-18 16:59:56 +08:00 |
|
|
Liangsheng Yin
|
374ad4cce0
|
Fix gpt-oss yarn with truncate argument (#14270)
|
2025-12-18 16:31:15 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
8b0a68f1bf
|
Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 16:28:07 +08:00 |
|
|
Shangming Cai
|
ee1ca51de8
|
[PP] Fix dynamic chunking strategy for PP (#15372)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-18 14:24:55 +08:00 |
|
|
Yuhao Yang
|
3d42b7e7b0
|
unified management of environment variables for vlm cuda ipc transport (#14501)
|
2025-12-18 12:28:06 +08:00 |
|
|
elvischenv
|
9970ee34e8
|
Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)
|
2025-12-18 11:11:42 +08:00 |
|
|
|
41683536d3
|
feat: DeepSeek-V3.2 Streaming tool call output (#15278)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: momaek <momaek17@gmail.com>
Co-authored-by: Muqi Li <muqi1029@gmail.com>
|
2025-12-17 17:43:58 -08:00 |
|
|
Dongjie Zou
|
891ee8221f
|
Feature/trtllm mha workspace size configurable #15089 (#15131)
|
2025-12-17 17:07:23 -08:00 |
|
|
Yuan Luoandluoyuan.luo
|
8fa3dc36c5
|
[VLM] Support cos sin cache for Qwen3-VL & GLM-4.1V (#15205)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-18 08:39:50 +08:00 |
|
|
b8zhongandBrayden Zhong
|
d20699a33c
|
[Deepseek V3.2] Support Overlap Spec + NSA (#15307)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-17 13:35:39 -08:00 |
|
|
Scott Lee
|
169a75dfb8
|
Add request-level timestamp for when prefill finishes (#14860)
|
2025-12-17 13:34:46 -08:00 |
|
|
Cheng Wan
|
5290cef97c
|
Fix condition check for require_gathered_buffer (#15328)
|
2025-12-17 12:42:47 -08:00 |
|
|
许霖
|
726fe3e72e
|
fix: prevent points regex from matching checkpoints/endpoints (#15120)
|
2025-12-17 12:38:18 -08:00 |
|