Commit Graph

7282 Commits

Author SHA1 Message Date
Yuhao Yang
841eb29d3d [diffusion] model: support z-image (#14067) 2025-11-28 21:48:31 +08:00
fzyzcjy
45cf575852 Fix overlap scheduler not take effect when outputing logprobs (#14096) 2025-11-28 18:15:56 +08:00
Mick
0e8ce1e832 [diffusion] refactor: clean useless files (#14094) 2025-11-28 18:14:00 +08:00
Lzhang-hub
ea1e9f6b3c feat: support qwen3_vl vision model dp (#13724) 2025-11-28 17:29:07 +08:00
Lzhang-hub
f6e37d3edb [Bugfix] qwen2.5-vl spec decode accept_len low (#13904)
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
2025-11-28 17:26:32 +08:00
vipwangerxiao
ab9a46d462 Support configuring the request limit per receiving poll (#14076)
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com>
Co-authored-by: Feng Su <225349073+sufeng-buaa@users.noreply.github.com>
2025-11-28 16:14:21 +08:00
shuwenn
621061f017 [Bugfix] input prompt was not logged (#13936) 2025-11-28 16:00:51 +08:00
Aleksandr Krotov
7daddcdb58 Fix structural_tag tool call with null schema (#14006) 2025-11-27 23:04:16 -08:00
Raayan Dhar
91d249cd9b fix: small changes to enable test_mrope.py (#14082)
Signed-off-by: Raayan Dhar raayan.dhar@gmail.com <raayan.dhar@gmail.com>
2025-11-27 22:58:17 -08:00
Mick
951028968c [diffusion] refactor: refactor ComponentLoader and support loading native models from diffusers and transformers (#13205) 2025-11-28 14:17:32 +08:00
Mick
3543a04a48 [diffusion] refactor: refactor condition image resize logic (#14079) 2025-11-28 14:06:34 +08:00
Yuan Luo
e12c78aab6 [sgl-kernel][1/2] Fused qk_norm_rope for Qwen3-MoE (#14036)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-11-28 12:25:15 +08:00
alisonshao
bce40fa217 Fix utils import issue for nightly tests (#13944) 2025-11-27 15:24:27 -08:00
Baizhou Zhang
051ad83347 [chore] Arrange NV packages in Dockerfile (#13749) 2025-11-27 18:08:27 -05:00
Kangyan-Zhou
4c9f7c97d3 Temporarily disabled test (#14069) 2025-11-27 14:58:46 -08:00
Mohammad Miadh Angkad
63b056213f Remove disused B300 Dockerfile (#13946) 2025-11-27 09:48:00 -05:00
fzyzcjy
21af8e73ad Super tiny add comments to SGLANG_DEEPEP_NUM_MAX_DISPATCH_TOKENS_PER_RANK (#14048) 2025-11-27 22:16:43 +08:00
Baizhou Zhang
7ab548ef64 [2/2] Refactor DeepGeem requant for FP8 FusedMoE on Blackwell (#13960) 2025-11-27 09:00:26 -05:00
Liangsheng Yin
bab033b970 Adjust max-parallel for CUDA CI (#14057) 2025-11-27 20:48:37 +08:00
Yixin Dong
6350042696 feat: Naive support Spec V2 + Constrained Decoding (#13425)
Signed-off-by: Ubospica <ubospica@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2025-11-27 20:31:46 +08:00
fzyzcjy
25758647b1 Support sanity checking weight consistency especially for RL (#13854) 2025-11-27 20:25:12 +08:00
fzyzcjy
2bc8ee8b74 Tiny support 3D tensors in inverse_transform_scale_ue8m0 (#14002) 2025-11-27 20:20:45 +08:00
Jimmy
ab843ced31 [Feat]Add scheduler recv skipper weights to environment configuration (#13855) 2025-11-27 18:16:11 +08:00
Mick
6edffc6391 [diffusion] perf: improve black-forest-labs/FLUX.2-dev (#14040) 2025-11-27 14:49:52 +08:00
gaopengff
077ca70ee4 [Intel XPU]Add xpu support for get_device_memory_capacity (#13895) 2025-11-26 20:55:52 -08:00
Qiaolin Yu
7cb04dc0e5 Use trtllm mha decode kernel for target_verify in speculative decoding (#13976)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
2025-11-26 20:40:34 -08:00
sunxxuns
5443db8759 fix: Fix AMD CI failures with HIP layernorm and PyPI connectivity (#13814)
Co-authored-by: root <root@mi300x8-005.atl1.do.cpe.ice.amd.com>
2025-11-27 11:30:37 +08:00
Stefan He
9f340ab1fb [Piecewise] support disable decode cuda graph when enable piecewise cuda graph (#13965) 2025-11-26 18:35:59 -08:00
Stefan He
70c6f95107 Add CODEOWNERS entry for batch_invariant_ops (#14026) 2025-11-26 18:35:37 -08:00
alisonshao
d941a3befa Fix nightly test failure: NSA indexer dtype (#14017) 2025-11-26 21:27:51 -05:00
Cheng Wan
b12c9e5c0a Fix installation for nvidia-nvshmem-cu12 (#14033) 2025-11-26 18:27:12 -08:00
Simo Lin
e9e90460ed [model-gateway] allow refill rate to be zero (#14030) 2025-11-26 17:15:27 -08:00
alisonshao
6330d6641b Fix flashinfer cutlass MoE output shape for non-FP4-packed inputs (#14028) 2025-11-26 18:09:02 -07:00
Sam
91e8dc371a [Feat][NVFP4] Enable NVFP4 MoE for Qwen series models (eg. Qwen3-Next) #13761 (#13761)
Co-authored-by: Kaixi Hou <kaixih@nvidia.com>
2025-11-26 17:53:45 -07:00
Lianmin Zheng
231df4b0d4 Cleanup server args (#14027) 2025-11-26 16:32:41 -08:00
alisonshao
b087ef8b4b Nightly test job filter (#14025) 2025-11-26 16:04:24 -08:00
ShawnY112358
5155016b56 [feat] update bucketed weights from distributed (#13824)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-26 15:30:45 -08:00
Netanel Haber
082b54c689 Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277) 2025-11-26 16:28:52 -07:00
alisonshao
a8ef4d1804 Add nightly test support to unified run_suite.py (#13941) 2025-11-26 15:16:12 -08:00
mrhaoxx
15ff6982b9 Support KTransformers for Qwen3-VL moe (#13983) 2025-11-26 14:59:15 -08:00
alisonshao
9adef42c60 Fix nightly test failure: CPP radix cache init (#14018) 2025-11-26 14:58:26 -08:00
Tianhao Zhou
685b9d82bd fix: cuda graph issue while running longcat_flash (#14007) 2025-11-26 14:57:22 -08:00
alisonshao
a223402ffb Add adapter_model.safetensors to corruption validation for LoRA (#14022) 2025-11-26 14:52:46 -08:00
Xinyue Zhang
44d0a848da [model-gateway] Fix flaky test_circuit_breaker_half_open_failure_reopens (#14019) 2025-11-26 14:52:10 -08:00
alisonshao
5b7da0f58e Temporarily disable test_update_weights_from_disk.py in CI (#14021) 2025-11-26 13:56:28 -08:00
Douglas Yang
697a77bf73 Add stress test workflow (#13937)
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
2025-11-26 13:24:39 -08:00
Lianmin Zheng
0a186924ba [Code sync] Fix registration of some ops in grok & Fix oss sync scripts (#13990)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-26 13:11:52 -08:00
Stefan He
b6312e62ea Update CODEOWNERS for layer and executor files (#14020) 2025-11-26 12:59:04 -08:00
Kangyan-Zhou
779cbc6e4b Fix Nvidia nightly test trigger params when it is triggered by parent workflow (#13966) 2025-11-26 12:01:48 -08:00
Wenyi Xu
67c8c86722 [model-gateway][doc] Update transport terminology to protocol in README.md (#13872)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2025-11-26 11:44:59 -08:00