 Vladimir Serov
|
f124539a01
|
[NPU]LoRA: Adding Torch Native backend (#14132)
|
2025-12-08 02:16:07 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
26d95008b6
|
[apply][2/2] Fused qk_norm_rope for Qwen3-MoE (#13998)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-07 20:25:18 +08:00 |
|
|
|
9abcab3ffa
|
[DLLM] feat: Add threshold based parallel decoding support (#14412)
Co-authored-by: Jinwei Yao <jinweiy@illinois.edu>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
|
2025-12-07 18:25:33 +08:00 |
|
|
Chen1022
|
3c7886ec4c
|
Fix attention backend logic for Qwen3-Next on SM100 (#14560)
|
2025-12-06 22:03:34 -08:00 |
|
|
Rain JiangandTrevor Morris
|
ea177372bd
|
support mtp with deepseek r1 nvfp4 model (#13115)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
|
2025-12-06 00:45:54 -08:00 |
|
|
Baizhou Zhang
|
42fcf5438f
|
Revert "tiny remove deprecated endpoint call" (#14533)
|
2025-12-05 23:48:54 -08:00 |
|
|
fzyzcjy
|
3d1b591aa1
|
Tiny use trtllm_mha as default when possible (#14291)
|
2025-12-05 14:26:03 -08:00 |
|
|
b8zhong
|
ec7b2c16d9
|
tiny remove deprecated endpoint call (#13607)
|
2025-12-05 09:54:49 -08:00 |
|
|
elvischenvandLinda-Stadter
|
205f041e96
|
Add Mistral Large 3 Eagle Support (#14466)
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-05 23:11:41 +08:00 |
|
|
roikoren755
|
2ce121a1c3
|
Enable RadixCache for Mamba2 models (#13584)
|
2025-12-05 18:23:58 +08:00 |
|
|
Sam
|
922756aaa1
|
[FIX] trtllm-moe-fp4-renorm for Qwen series models (#14350)
|
2025-12-04 12:52:21 -08:00 |
|
|
|
8428078436
|
Add Mistral Large 3 support. (#14213)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-04 20:00:05 +08:00 |
|
|
Even Zhou
|
894c0dc57c
|
[NPU][1/N] NPU basic functions refactor and new modelslim quant type (#13359)
|
2025-12-04 16:15:31 +08:00 |
|
|
|
02af51e4fc
|
Support fp4 fp8 non gated moe (#13794)
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
|
2025-12-01 15:26:28 -08:00 |
|
|
YAMY
|
decb48965d
|
[DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646)
|
2025-11-30 15:59:23 -08:00 |
|
|
Yuhao Yang
|
f03ea34a3d
|
add runtime check for PyTorch 2.9.1 + CuDNN < 9.15 to prevent Conv3d performance issues (#14119)
|
2025-11-29 10:05:54 -05:00 |
|
|
|
848ee57067
|
feat: support flashinfer kernel autotune (#12306)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-29 00:05:37 -08:00 |
|
|
Cheng WanandKangyan Zhou
|
0fe74af563
|
Remove incorrect deep_gemm assertions from server_args.py (#14113)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
|
2025-11-28 20:25:39 -08:00 |
|
|
fjybiocsandserverance.fu
|
143b57b805
|
enable piecewise cuda graph for prefill server (#13377)
Co-authored-by: serverance.fu <serverance.fu@temu.com>
|
2025-11-29 12:09:26 +08:00 |
|
|
Baizhou Zhang
|
7ab548ef64
|
[2/2] Refactor DeepGeem requant for FP8 FusedMoE on Blackwell (#13960)
|
2025-11-27 09:00:26 -05:00 |
|
|
SamandKaixi Hou
|
91e8dc371a
|
[Feat][NVFP4] Enable NVFP4 MoE for Qwen series models (eg. Qwen3-Next) #13761 (#13761)
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
|
2025-11-26 17:53:45 -07:00 |
|
|
Lianmin Zheng
|
231df4b0d4
|
Cleanup server args (#14027)
|
2025-11-26 16:32:41 -08:00 |
|
|
Liangsheng Yin
|
6c190cbda0
|
Rename: --hooks to --forward-hooks (#13994)
|
2025-11-26 22:26:28 +08:00 |
|
|
Zehuan LiandTiwei Bie
|
21b0582d4b
|
[feature] Initial block diffusion language model support (#12588)
Co-authored-by: Tiwei Bie <tiwei.btw@antgroup.com>
|
2025-11-26 17:57:54 +08:00 |
|
|
Yubo Wang
|
18fb51583f
|
Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725)
|
2025-11-26 11:44:41 +08:00 |
|
|
Jan Bernlöhr
|
fcccaf9001
|
Add Llama4 attention backend auto-selection (#13421)
Signed-off-by: jbernloehr <jbernloehr@nvidia.com>
|
2025-11-25 11:54:21 -08:00 |
|
|
LiwansiandEven Zhou
|
432ecf841e
|
[Ascend] qwen optimization (#12078)
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>
|
2025-11-25 19:44:24 +08:00 |
|
|
gongwei-130
|
8ff3ef1fef
|
fix: draft model revision misuse model revision (#11893)
|
2025-11-24 21:13:37 -08:00 |
|
|
|
b0a26ba624
|
Add support for bf16 x bf16 cutlass fused MoE (#10275)
Co-authored-by: Sam Li <lsam@nvidia.com>
Co-authored-by: jackeyhua <jackeyhuasjtu@gmail.com>
|
2025-11-24 18:49:39 -08:00 |
|
|
hlu1
|
618ca23802
|
[Deepseek] Refactor deepseek server_args _handle_model_specific_adjustments (#13687)
|
2025-11-23 12:41:14 -08:00 |
|
|
Binyao Jiang
|
b29769f3b6
|
Move unnecessary input_addr capture under debug mode flag for speed-up (#13690)
|
2025-11-22 11:42:26 -08:00 |
|
|
Chen Haozhe
|
6c2e5fcd91
|
[feat][Ascend][Mindspore]: support model-impl of mindspore (#9234)
|
2025-11-19 09:17:47 +08:00 |
|
|
b8zhong
|
92ad2ff9ce
|
Flashinfer TRTLLM-GEN-MoE + Qwen3 (#13489)
|
2025-11-18 14:18:29 -08:00 |
|
|
|
ac81db66c2
|
[VLM][feat] Support encoder DP for Qwen2.5-VL (#13126)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
|
2025-11-18 16:13:18 +08:00 |
|
|
|
f1be8aa0f2
|
chore: add an unified server arg for multimodal inputs preprocess config(#12149)
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-11-18 12:18:50 +08:00 |
|
|
Carlo Mussolini
|
df56139226
|
Adding user defined hooks support (#13217)
|
2025-11-17 23:07:37 +08:00 |
|
|
|
15db5497d3
|
[feature] Custom base path on FastAPI server (#5879)
Co-authored-by: lianhu.yin <lianhu.yin@nio.com>
Co-authored-by: kebyn <kebyn@kebyn.cc>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-11-17 22:40:09 +08:00 |
|
|
huangtingwei
|
1dcde53928
|
[HiCache] support memory_pool_host page head layout (#11644)
|
2025-11-17 13:45:17 +08:00 |
|
|
lixiaolx
|
d368c7451a
|
(1/n)support context parallel with deepseekv3.2-DSA (#12065)
|
2025-11-16 20:12:25 -08:00 |
|
|
Lifu Huang
|
254f62d879
|
Support spec decoding when LoRA is applied to target model (#12903)
|
2025-11-16 13:20:23 -08:00 |
|
|
kyleliang-nv
|
597d416070
|
[feature] Add layerwise NVTX support (#11870)
|
2025-11-15 19:20:56 -08:00 |
|
|
Zhihao Lyuandronnie_zheng
|
10592e9c08
|
[Ascend][Feat] Add Ascend sampling backend (#12692)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2025-11-15 21:59:58 +08:00 |
|
|
Yongfei Xu
|
d91b16eb16
|
Opt tp: tp attn support tp reduce scattered input (#10568)
|
2025-11-15 02:08:12 -08:00 |
|
|
Zilin Zhu
|
56fc483073
|
[RL] support only do cpu backup on draft model (#13318)
|
2025-11-15 16:31:57 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
f0021c0dc8
|
Add feature flag for mm inputs processing optimization (#13278)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-15 14:43:44 +08:00 |
|
|
Yuwei An
|
eae59b337e
|
Piecewise Cuda Graph Support for gpt-oss model (#13045)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-11-15 09:28:00 +08:00 |
|
|
Kshiteej K
|
84e151ac7f
|
LLama4 Attention: Update assertion msg (#12777)
|
2025-11-15 02:52:50 +08:00 |
|
|
huangtingwei
|
4ac65e3c7d
|
[PD / HiCache]fix deocde kvcache offload manager memory leak (#12774)
|
2025-11-14 03:31:53 +08:00 |
|
|
Scott Lee
|
c94564912e
|
Add RequestMetricsExporter utility to export request-level metrics (#10973)
|
2025-11-12 16:33:37 -08:00 |
|
|
|
c4b74c1db2
|
[Ascend] LoRA: adding Ascend LoRA backend with using kernels from sgl_kernel_npu (#12288)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
|
2025-11-12 16:20:34 -08:00 |
|