Commit Graph

9885 Commits

Author SHA1 Message Date
Ratish P
c560e14216 [diffusion] fix: enforce 16-pixel alignment for flux2 to prevent shape mismatch crash (#17302) 2026-01-20 12:03:33 +08:00
Shangming Cai
71cb9d0302 [PD] Fix PP dynamic chunking with DP attention (#17339)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-01-20 11:27:13 +08:00
shuwenn
8fb45523f3 feat: support bitsandbytes quantization algorithm (#15325) 2026-01-19 18:36:56 -08:00
Raghav Ravishankar
84aef37808 fix function calling for Trinity (#17364) 2026-01-19 18:33:17 -08:00
Alison Shao
17c04b109d Enable parallel stage execution for scheduled CI runs (#16880) 2026-01-19 18:31:46 -08:00
Alison Shao
55c4288b3e Fix runner utilization workflow to use 24h default (#17378) 2026-01-19 18:31:33 -08:00
zijiexia
9f8b79f16f [Docs] Fix formatting in Evaluating New Models with SGLang (#17376) 2026-01-19 18:22:30 -08:00
b8zhong
7dc3cbe7ca [Docker] Fix CUDA 13 installing wrong nvidia-nccl-cu13 due to nixl-cu13 not breaking system package (#17370) 2026-01-20 09:52:30 +08:00
zijiexia
79ddc34c1c [Docs] Add new model evaluation docs (#17043)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
2026-01-19 16:35:03 -08:00
Aurick Qiao
09a9d214f7 Pipe customized_info through CudaGraphRunner output (#17088) 2026-01-19 15:48:49 -08:00
Alison Shao
7e40d52635 Move test_autoround.py to stage-b-test-large-1-gpu suite (#17336) 2026-01-19 14:36:19 -08:00
Alison Shao
057b07fc50 Disable unit-test-backend-4-gpu-gb200 job (#17367) 2026-01-19 14:35:58 -08:00
Douglas Yang
91d8c52d6d fix: updating pypi workflow with new base version formatting in pyproject.toml (#17366) 2026-01-19 13:23:11 -08:00
YC Tseng
e9a44ea607 [AMD] fix perf ci errors (#17363) 2026-01-19 13:04:15 -08:00
Hudson Xing
c1282da236 fix(ci): apply MMMU retry logic to all affected test files (#17329) 2026-01-19 10:00:29 -08:00
shuwenn
71279e31f7 [CI] fix test_vlm_models.py (#17049) 2026-01-19 10:00:00 -08:00
YC Tseng
1a053a810c [AMD] CI - add partitions for stage-b-test-small-1-gpu-amd (#17345) 2026-01-19 08:16:07 -08:00
Bingxu Chen
2ea02f0642 [AMD CI] Migrate and Add More Testcases (#17116)
Co-authored-by: yctseng0211 <yctseng@amd.com>
2026-01-19 08:07:39 -08:00
zhangheng
20b0523eca [RadixTree][1/N Refactor]: Support unified match_prefix params (#17142)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
2026-01-19 22:39:40 +08:00
Ke Bao
ce8a6ac690 Evict swa kv cache during decoding (#17220) 2026-01-19 22:36:52 +08:00
ybyang
ebca5879a1 Fix v32 continue_final_message not work (#16567) 2026-01-19 21:45:39 +08:00
Xiaoyu Zhang
cc410a1088 [Diffusion] Apply qknorm to flux2 and apply lightx2v rms_norm_one_pass kernel(without residual) (#17305)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-19 21:25:33 +08:00
b8zhong
f374623fa9 [Refactor] Set fp4-gemm-backend=auto on SM100 and rename fp4-gemm-backend with flashinfer_ prefix (#17309) 2026-01-19 20:09:07 +08:00
Shu Wang
5c02217746 Inclusion of nvfp4 blockscale in EPLB Rebalance (#17158) 2026-01-19 17:45:27 +08:00
Alison Shao
8916b9d080 Migrate performance, accuracy, and quantization tests to CI registry (#17177)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2026-01-18 23:25:24 -08:00
Xiaoyu Zhang
a3d9a21882 Revert "[Perf] fuse q, k norm for Flux2Attention (#17241)" (#17332) 2026-01-19 15:24:11 +08:00
Alison Shao
fb88fb672e fix(ci): rate limit and permission errors in trace publishing (#17238) 2026-01-18 23:20:22 -08:00
Alison Shao
2d72e168fd [CI] Add partition to stage-b-test-large-1-gpu (11->12) (#17245) 2026-01-18 23:19:39 -08:00
Minglei Zhu
64946679b5 [Perf] fuse q, k norm for Flux2Attention (#17241)
Co-authored-by: Minglei Zhu <zminglei@linkedin.com>
2026-01-19 14:33:34 +08:00
Kartik Ramesh
5836324c55 KV Cache Events with Attention DP bug fix (#16030) (#16412) 2026-01-19 14:13:48 +08:00
yudian0504
9fe56cd0fb Fix kernel selection in biased_grouped_topk_gpu (#17325) 2026-01-19 14:06:11 +08:00
Gaoji Liu
858a4d659b support new qwen3_coder_detector (#16744)
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
2026-01-18 21:16:27 -08:00
Lianmin Zheng
e619f53113 [Auto Sync] Update tokenizer_manager.py (20260119) (#17317)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2026-01-18 20:32:19 -08:00
Lianmin Zheng
fc4b932f4e Update code sync scripts (#17319) 2026-01-18 19:57:28 -08:00
Yongfei Xu
d2105d4abd [DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation (#16961) 2026-01-19 11:54:11 +08:00
Lee Nau
84c8390514 Use dsv3 optimized routing fused_topk_deepseek instead of moe_fused_gate (#15347) 2026-01-19 11:50:16 +08:00
Baizhou Zhang
ea879c7739 [Minor] Correct sglang version when installing from source (#17315) 2026-01-18 19:36:16 -08:00
Shangming Cai
0227db8926 [PD] Optimize MHA models pp util calculation logic (#17306) 2026-01-19 11:23:15 +08:00
Glen Liu
ad1b4e4728 [Feature] overlap LoRA weight loading with compute (#15512) 2026-01-19 10:43:17 +08:00
Mick
51f147ada3 Update CODEOWNERS for multimodal_gen (#17308)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-01-19 08:39:20 +08:00
Koushik Dutta
d3eafc7357 [GLM 4.7] Add RTX 6000 Pro aka sm120 (#17235)
Co-authored-by: root <root@ubuntu-nvidia.localdomain>
2026-01-18 13:33:19 -08:00
Jinyan Chen
e00b43442d [jit-kernel] Add CuTe DSL GDN Decode Kernel (#15631)
Co-authored-by: Jinyan Chen <jinyanc@nvidia.com>
2026-01-18 12:54:36 -08:00
Todobe
733de6be31 [NPU]Support GPT-OSS for NPU (#14197) 2026-01-19 04:13:41 +08:00
Jerry Ji
93433726eb [Refactor] Split out deepseek v2 weight loader function into mixin (#16649) 2026-01-19 00:41:59 +08:00
Xiaoyu Zhang
330605cc88 [Diffusion] Apply jit qk_norm to flux1 (#17296) 2026-01-19 00:28:36 +08:00
Ch3ngY1
bb6055b43c [Bugfix] Fix PD accuracy when MTP is not configured on the prefill node (#17212)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-01-18 23:37:58 +08:00
b8zhong
4df74eb576 [Refactor] Add -fp4-gemm-backend to replace SGLANG_FLASHINFER_FP4_GEMM_BACKEND (#16534)
Co-authored-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
2026-01-18 23:25:46 +08:00
Ke Bao
f3a7c7dcd9 Move radix cache related tests (#17295) 2026-01-18 17:47:32 +08:00
Xinyuan Tong
2069050d3f fix: Handle multiple named chat templates in HuggingFace tokenizers (#17236)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
2026-01-18 17:20:04 +08:00
Ke Bao
1fe0c82f67 Add kl test for swa radix cache (#17281) 2026-01-18 16:19:57 +08:00