Commit Graph

11116 Commits

Author SHA1 Message Date
Vedant V Jhaveri
db995fba47 perf(kimi_linear): replace einops rearrange with native torch ops in Kimi-Linear KDA path (#20396) 2026-03-20 10:38:12 +08:00
ehuaa
fa0d8f6629 perf: avoid unnecessary gpu-cpu sync in eagle_info (#20266)
Co-authored-by: root <qianhao@zhejianglab.org>
2026-03-19 19:37:29 -07:00
Mohammad Miadh Angkad
3d749c49ca [JIT Kernel] Fix NVFP4 multi-arch compilation failure (#20874) 2026-03-20 10:30:04 +08:00
Liangsheng Yin
6ad78b008b Consolidate streaming session tests (4 files → 3, fewer server starts) (#20961) 2026-03-19 19:13:28 -07:00
cs-cat
22e378af86 Fix result writer in tuning_block_wise_kernel.py, and add FP8 kernel config for L40 (#20368)
Signed-off-by: cs-cat <118669451+cs-cat@users.noreply.github.com>
2026-03-20 09:28:54 +08:00
Yuan Luo
d9794ef9f7 [Qwen3-Next] Fuse Qwen3-Next GDN's qkvz_proj and ba_proj (#19321)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-03-20 09:25:29 +08:00
Baizhou Zhang
42f4b7276c Revert "feat(mm)(grpc): compute M-RoPE positions for preprocessed VL inputs" (#20956) 2026-03-19 18:03:04 -07:00
Liangsheng Yin
8d22efdeea [Tiny Fix] Fix IS_BLACKWELL env var empty string warning in rerun-ut workflow (#20957) 2026-03-19 17:24:35 -07:00
Liangsheng Yin
2b53e660de Simplify streaming session logprob handling (#20955) 2026-03-19 17:09:40 -07:00
Leon Gao
63c38aba5e Fix token leak with logprob_start_len=0 in streaming sessions (#20557) 2026-03-19 15:37:27 -07:00
Kangyan-Zhou
62361e8fd5 Temporarily adjust the scheulde for pr-test.yml to 12 hours (#20951) 2026-03-19 14:48:10 -07:00
Brayden Zhong
b42b9f6e1a Support CuteDSL mm_fp4 backend (#18801) 2026-03-19 14:20:01 -07:00
Yuwei An
d8ece7fb22 [Tiny Fix] Filter lru related warning with pcg (#20940)
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
2026-03-19 13:20:49 -07:00
Lianmin Zheng
0949b138af Simplify server startup output (#20885)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-19 13:11:37 -07:00
Xinyuan Tong
a02cff7f2b [Fix] Patch is_flash_attn_2_available for flash-attn-4 in VLM input format test (#20946) 2026-03-19 13:00:51 -07:00
AlfredYong
c562e0d13b [feat] Enhance Kimi-K2/K2.5 function call and reasoning detection (#19552)
Co-authored-by: alfredyyang <alfredyyang@tencent.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2026-03-19 12:57:57 -07:00
billishyahao
2ee7f41e25 [AMD] add mori ep normal tbo unittest (#20941) 2026-03-19 11:52:25 -07:00
YC Yen-Ching Tseng
9e629d31fd [AMD] CI - Fix AMD CI (multimodal test, move flaky test to non-deterministic group) (#20815) 2026-03-19 11:50:19 -07:00
Lianmin Zheng
3b89c6d3ea simplify and improve pr-test.yml (#20911) 2026-03-19 11:01:06 -07:00
Mohammad Miadh Angkad
29ced9c162 [UX] Suppress noisy httpx/httpcore INFO logs (#20944) 2026-03-19 10:58:41 -07:00
Xinyu Zhang
319bb4974c [Fix] RayEngine multi-node: co-locate rank0 scheduler with Engine and fix CUDA device setting (#20722) 2026-03-19 10:27:16 -07:00
Cao E
274581fb77 Add support for more batch sizes in cpu_graph_runner (#13881) 2026-03-19 09:50:56 -07:00
Shangming Cai
4c52b7fcc6 [CI] Improve PP consistency check success rate (#20838)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-03-19 19:12:50 +08:00
YC Yen-Ching Tseng
671bd266c1 [AMD] CI - update amd nightly cronjob (#20928)
Co-authored-by: Bingxu Chen <bingxche@amd.com>
2026-03-19 18:10:17 +08:00
kk
c8f0122acf Fix gpu-fault issue when run deepseek-r1 and enable dp (#20841)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-03-19 02:36:12 -07:00
Qi Yuhang
cb8105fe28 [sgl-kernel][6/7]Support Expert Specialization Grouped GEMM (#15471) 2026-03-19 15:39:52 +08:00
khalilzhk
574572b21b [BugFix] bug fix for DeepSeek eagle3 in Attn-DP mode (#20492) 2026-03-19 14:48:46 +08:00
Shangming Cai
fd05532da1 Add logging for BootstrapServer for CI diagnosis (#20844)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-03-19 14:42:12 +08:00
blzheng
a98b456c70 [CPU] Add frontend support for Gemma (#12590) 2026-03-18 23:02:26 -07:00
jianan-gu
8d4fcf2f7b [CPU] Fix MoE layer support for DeepSeek-OCR models (#12555) 2026-03-18 22:57:55 -07:00
Matti Varjokallio
85fe8c6793 [AMD] Use aiter_dsv3_router_gemm kernel if number of experts <= 256. (#18451) 2026-03-18 22:40:48 -07:00
kk
126cd5cfae gpt-oss decode performance optimization (#20392)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-03-18 22:30:03 -07:00
blzheng
cd22aa27a9 [CPU] Add FP8 Bmm support (#9744)
Co-authored-by: Fan Yin <1106310035@qq.com>
2026-03-18 22:19:48 -07:00
blzheng
c2b01bd2fc [CPU] fix bug in AVX512 implementation of flash_attn_softmax (#20220)
Co-authored-by: Wu, Chunyuan <chunyuan.wu@intel.com>
2026-03-18 22:18:47 -07:00
Ma Mingfei
687d9eb66f [CPU] Optimize image preprocessor performance for Qwen2VLImageProcessorFast (#15168) 2026-03-18 22:18:15 -07:00
Ma Mingfei
62d7454976 optimize conv3d used in patch embedding (#16040) 2026-03-18 22:17:53 -07:00
blzheng
cbea9f6909 [CPU] improve numa memory binding (#19666)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-03-18 22:15:50 -07:00
Zaili Wang
2f4babe32b [CPU] support LayerNorm with 3D shape (#15075)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-03-18 22:15:24 -07:00
blzheng
dc6aa26ce9 [CPU] Add mrope kernel for Qwen3-vl (#12531)
Co-authored-by: Ma Mingfei <mingfei.ma@intel.com>
2026-03-18 22:12:48 -07:00
Juan Muneton
4052b53227 fix scheduler for non-cuda devices and disable piecewise cuda graph f… (#19992)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-03-18 21:54:19 -07:00
Ling Zhang
f85455ab24 [Bugfix] fix qwen3vl hang when --mm-enable-dp-encoder is enable (#20759) 2026-03-18 21:51:39 -07:00
Ethan (Yusheng) Su
7f6f1a3ab1 [LoRA][II] Add fused MOE LoRA Triton kernel and tests (#19711) 2026-03-18 19:58:14 -07:00
R0CKSTAR
7553b7dcb0 chore: extract diffusion_common in python/pyproject_other.toml (#20803)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2026-03-19 10:39:16 +08:00
Qiaolin Yu
eea9e19c13 fix lint introduced in #20708 (#20886) 2026-03-18 15:38:52 -07:00
Chang Su
0d23a461a0 feat(mm)(grpc): compute M-RoPE positions for preprocessed VL inputs (#19973)
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Chang Su <chang.s.su@oracle.com>
2026-03-18 15:34:50 -07:00
Liangsheng Yin
8b9482e665 fix(dp-attn): consistent overlap disable decision across DP ranks (#20853) 2026-03-18 15:16:39 -07:00
maocheng23
4e8829e4cd Replace topk_ids with curr_topk_ids in fused_moe.py (#20302) 2026-03-18 21:57:05 +00:00
Chad Voegele
a3196d08b8 [MiniMax M2] Fix KV cache scale loading (#20870)
Co-authored-by: Claude Sonnet 4.6 (1M context) <noreply@anthropic.com>
2026-03-18 14:54:43 -07:00
Xinyuan Tong
6b8a6545b2 Add Mistral Small 4 (Pixtral) support (#20708)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Alex Nails <alexnails@radixark.ai>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: dbari <dbari@users.noreply.github.com>
2026-03-18 14:15:32 -07:00
Trevor Morris
df1d046de2 Add packed_modules_mapping for MiniMax-M2 (#19995) 2026-03-18 14:10:01 -07:00