Commit Graph
9318 Commits
Author SHA1 Message Date
b8zhongandBrayden Zhong 22df62d586 add weightless qk norm to RMSNorm interface for Llama 4 (#12813)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2026-01-29 19:09:55 -08:00
baonudesifeizhai 84ab611af8 model: support DeepSeek-OCR-2 (#17897) 2026-01-30 09:49:51 +08:00
Kangyan-ZhouandClaude Opus 4.5 2cd2c3118d Add concurrency tracking to runner utilization report (#17963)
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-29 17:31:55 -08:00
YC Tseng b7b1ba329e [AMD] fix pip sglang version (#17950) 2026-01-29 17:19:57 -08:00
StonyPortandqiuxuan.lzw 2b3408ff14 feat: add forward timeout (#17831)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
2026-01-30 08:52:29 +08:00
Cheng Wan 6a6b36367e Fix logprob_start_len handling for prefill-only requests (#17395) 2026-01-29 15:14:43 -08:00
Kangyan-Zhou c3bf53c7c1 Fix ci weight validation logic to check the safetensor completeness (#17917) 2026-01-29 13:00:42 -08:00
Alison Shao 1f75c2af4d Fix /tag-and-rerun-ci to do full rerun when PR has sgl-kernel changes (#17729) 2026-01-29 12:54:30 -08:00
Cheng Wan a416af4be7 Fix capture_sizes range for pcg (#17956) 2026-01-29 12:46:35 -08:00
EduardDurech 1b6798a6a4 Fix torch.__version__ for PEP440 (#15682) 2026-01-29 11:55:13 -08:00
R0CKSTAR 4f2b73baf6 [MUSA] Add labeler config (#17923)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-01-29 09:58:54 -08:00
Hudson Xing d417c6809e Add tool call tests for DeepSeek V3.2 in nightly CI (#17951) 2026-01-29 09:50:54 -08:00
Ratish P 88fb927cc9 [diffusion]: add dummy device attribute to fix AttributeError (#17949) 2026-01-29 09:35:12 -08:00
Shivam jindal 0769de9b0f Support LightOnOCR-2-1B (#17806) 2026-01-29 23:03:41 +08:00
Ziang Li 3c9cc44ff5 Add mxfp8 support for online quantization, Triton dense linear, and CUTLASS MoE (#17449) 2026-01-29 21:33:57 +08:00
22dimensions cfa09d311c [NPU] add support for npu x86_64 image release (#14127)
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
2026-01-29 21:23:56 +08:00
Yuhao Yang 3c2f4c7bbe [diffusion] model: sync with upstream z-Image (#17822) 2026-01-29 21:10:11 +08:00
RoyWangandroywang 30adf78f82 [diffusion]: align sglang diffusion AMD pyproject_other.toml diffusion dependency with pyproject.toml (#16225)
Co-authored-by: roywang <roywang@amd.com>
2026-01-29 01:50:57 -08:00
kkandwunhuang ef1c512754 Add aiter bias moe support in gpt-oss mxfp4 model (#17735)
Co-authored-by: wunhuang <wunhuang@amd.com>
2026-01-29 01:50:11 -08:00
triple-mu 319f6886fe [diffusion] model: move tp_rmsnorm check to WanTransformerBlock (#17792) 2026-01-29 16:39:00 +08:00
Zhang Yiyang (SII) cdedbf1486 [diffusion] fix: resolve library mismatch in scheduler and update dit offload method name (#17916) 2026-01-29 15:54:36 +08:00
22dimensions 7b79326751 [NPU] support GPTQ quantization on npu (#15203)
Signed-off-by: 22dimensions <waitingwind@foxmail.com>
2026-01-29 15:48:18 +08:00
Niko Maandcwortman-amd cbf90d70ff [PD] Support KV transfer with MORI-IO (#14626)
Co-authored-by: cwortman-amd <cwortman@amd.com>
2026-01-28 23:22:41 -08:00
R0CKSTAR d3cdee0a04 [MUSA][4/N] Add common device utilities, distributed backend, and custom op wiring (#17246)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
2026-01-28 23:13:24 -08:00
Xinyuan Tong 9409c43593 Fix flaky tool calls in the Kimi K2.5 model (#17914)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-01-28 20:58:16 -08:00
Xinyuan Tong 3c34d2c3eb [FIX] kimi_k2 reasoning parser (#17901)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-01-28 19:47:09 -08:00
amote-i 1b22f2ee1c update ascend docs (#17741) 2026-01-29 11:43:48 +08:00
Joe Redmond 0ff0d181ca feat: add custom request header logging (#17786) 2026-01-28 19:33:08 -08:00
f1384f5293 Integration mori backend for EP a2a data communication (#17012)
Co-authored-by: Duyi-Wang <duyi.wang@amd.com>
Co-authored-by: billishyahao <bill.he@amd.com>
Co-authored-by: HaiShaw <hixiao@gmail.com>
2026-01-28 19:07:34 -08:00
Jerry Ji 673dc09d9b [Fix][trtllm-mha] Canonicalize the strides when num_head = 1 (#17732) 2026-01-29 10:11:18 +08:00
Simo Lin ac16d4450e [smg][mesh] extract mesh to mesh crate to reduce compile time (#17907) 2026-01-28 17:58:42 -08:00
Qi Yuhang 0368ddf9ea [JIT Kernel]Support fused_add_rmsnorm in JIT Kernel (#17677) 2026-01-29 09:29:59 +08:00
09a9147f59 [diffusion] model: support MOVA (#17704)
Co-authored-by: gaoyang07 <Gary1546308416AL@gmail.com>
Co-authored-by: cms42 <c@cms42.top>
Co-authored-by: cms42 <44895820+cms42@users.noreply.github.com>
Co-authored-by: Ruixiao Li <cgruixiao@outlook.com>
Co-authored-by: Li Ruixiao(SII) <80368770+Li-dongyang@users.noreply.github.com>
2026-01-29 09:12:08 +08:00
Prozac614 3fcda00e8c [CI] Fix CI timeouts by upgrading runai_model_streamer (related to #16937) (#17636) 2026-01-28 17:09:45 -08:00
Lianmin Zheng d4180815a4 Make the functions in logits_processor.py and sampler.py more modular (#17885) 2026-01-28 16:24:23 -08:00
jackey hua 0998de088b [Perf] Tune Llama-4-Scout-17B-16E-Instruct fused moe kernel (#17891) 2026-01-28 14:06:46 -08:00
gingerXueandjingzhi.xue e9d727cb92 [MUSA][7/N] Enhance CUDA / PyNccl wrapper to support MTLink connectivity detection (#17499)
Signed-off-by: jingzhi.xue <jingzhi.xue@mthreads.com>
Co-authored-by: jingzhi.xue <jingzhi.xue@mthreads.com>
2026-01-28 11:36:30 -08:00
Артем Савкинandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> b77b0ffd60 [NPU] NZ for non-quantized MOE, Qwen3 MOE double memory consumption fix (#15904)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-29 00:55:08 +08:00
Jinn 1953efb60e [AMD] ROCm: route W4A16 MoE to Triton and fix packed-weight loading (#17863) 2026-01-28 08:20:23 -08:00
triple-mu 1d1e72e516 [diffusion] fix: fix comfyui import typo (#17834) 2026-01-28 23:49:55 +08:00
MichaelandYC Tseng f8636fbb25 [AMD] Add Kimi-K2, DeepSeek-V3.2 tests to nightly CI (#17523)
Co-authored-by: YC Tseng <yctseng@amd.com>
2026-01-28 00:55:46 -08:00
Even Zhou 6077de1237 [CI] [NPU] npu ci use existing modelscope model (#17868) 2026-01-28 16:51:41 +08:00
Xiaoyu Zhang c08b54a575 [JIT kernel] Update jit_kernel cache and develop doc (#17842) 2026-01-28 15:09:47 +08:00
Mick 2573a262af [diffusion] doc: fix wrong docker run command (#17856) 2026-01-28 14:52:33 +08:00
Praneth Paruchuri 6f009961bb [model-gateway] Optimize HashRing construction to reduce heap allocations (#17575) 2026-01-27 22:46:40 -08:00
Praneth Paruchuri 897c35b457 [model-gateway] Optimize consistent hashing hot path to eliminate allocations (#17467) 2026-01-27 22:46:11 -08:00
Kangyan-Zhou c0b4dd68a2 Add a performance dashboard server and frontend for nightly CUDA tests (#17725) 2026-01-27 22:22:33 -08:00
Xiaoyu Zhang fb74e43707 [Diffusion] Delete sgl-kernel outdated time_embedding kernel (#17278) 2026-01-28 14:18:53 +08:00
Xiaoyu Zhang 67fb492c9a [CI] Fix test_moe_fused_gate error (#17844) 2026-01-28 12:03:17 +08:00
Ziang Li a8dda2aa57 [DSv32] Overlap indexer qk projection and activation quant (#17688) 2026-01-28 11:46:49 +08:00