Commit Graph
6083 Commits
Author SHA1 Message Date
Netanel HaberandYi Zhang e75299a111 Fix issues/16714: Revert comment out of tl.debug_barrier() in causal_conv1d_triton (#16899)
Co-authored-by: Yi Zhang <1109276519@qq.com>
2026-01-14 17:26:48 +08:00
roikoren755 72bacc88c8 [NemotronH] Use ReplicatedLinear for fc1_latent_proj (#16569)
Signed-off-by: Roi Koren <roik@nvidia.com>
2026-01-14 17:08:27 +08:00
shaharmor98 ba625c2d90 Feat/support nemotron h mtp (#17013)
Signed-off-by: Shahar Mor <smor@nvidia.com>
2026-01-14 16:30:35 +08:00
HuangJi 030496eb06 [diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962) 2026-01-14 14:44:10 +08:00
shuwennandSimo Lin cd33694585 feat: add --admin-api-key for finer-grained endpoint auth (#15908)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
2026-01-13 20:21:55 -08:00
Mick a5348eac4c [diffusion] chore: avoid raising error when output resolution is not optimal (#17030) 2026-01-14 11:36:27 +08:00
Mick 9524040220 [diffusion] chore: refactor warmup logic (#17027) 2026-01-14 11:35:06 +08:00
Liangsheng Yin e2c8a50b38 fix grammar timeout sync across tp ranks. (#16898) 2026-01-14 10:26:31 +08:00
Lianmin Zheng a4825ed588 Fix kernel type annotations for fp8 quant and logging (#16994) 2026-01-13 18:14:32 -08:00
Hubert Luandwufann afe285f7bd [AMD] enable CUDA graph for NSA backend and fix NSA FP8 fused RMSNorm group quant (#16841)
Co-authored-by: wufann <715544327@qq.com>
2026-01-13 17:36:01 -08:00
Byron Hsuandroot 339915ce2b [logprob] Fix logprob + streaming for long concurrent decode by caching already processed logprob (#17005)
Co-authored-by: root <root@memx-cge-29-sr1.xpop.twttr.net>
2026-01-13 12:39:14 -08:00
Lianmin Zheng 075c5a5789 Code clean up for fp8 quantization (#16982) 2026-01-13 12:38:39 -08:00
Yuhao Yangandjianyingzhu a0b4ba9032 [diffusion] model: GLM-Image (#16894)
Co-authored-by: jianyingzhu <53300651@qq.com>
2026-01-14 02:02:03 +08:00
Mick 7a869045b6 [diffusion] chore: clean excessive document (#16986) 2026-01-13 21:33:50 +08:00
888d7e54d1 [diffusion] fix: fix compatibility issue with torch.compile and flash attention v4 (#16790)
Co-authored-by: root <root@nimrodb200.tail5cbfe.ts.net>
Co-authored-by: ahb13 <ahb13@qq.com>
2026-01-13 21:11:19 +08:00
qichu-yun 3cb1fbaee4 [diffusion] fix: fix Qwen-Image-Edit Lightning LoRA alpha/rank scaling (read per-layer *.alpha) (#16935) 2026-01-13 21:09:11 +08:00
DarkSharpnessgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>Xiaoyu Zhang
ba9f6d8f26 [Refactor] Clean up JIT kernel utilites (#16884)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-01-13 17:54:16 +08:00
Xiaoyu Zhang 740d3c0b39 [Diffusion] Remove useless dependency in diffusion (#16967) 2026-01-13 17:25:53 +08:00
Hubert Lu 8716589826 [AMD][Diffusion] support timestep embedding kernel for AMD GPUs (#16766) 2026-01-12 22:17:07 -08:00
HuangJi a83484275d [diffusion] perf: optimize linear calculation in SLA (#16648) 2026-01-13 09:38:35 +08:00
Mick 47d485f35f [diffusion] fix: fix not respecting dit_layerwise_offload server arg (#16252) 2026-01-13 09:29:07 +08:00
Mick 2b42309955 [diffusion] UX: provide solutions for OOM (#16940) 2026-01-13 09:25:27 +08:00
James ae0baefb94 [NPU] upgrade npu mf_apater plugin (#15853) 2026-01-13 09:02:10 +08:00
Yinghai Lu d3c08fb07c [layers] support zero-dim rmsnorm (#16978) 2026-01-12 15:53:19 -08:00
7b682de870 [Model] Support IQuest-Coder-40B-Loop (#16348)
Co-authored-by: yxing <yxing@iquestlab.com>
Co-authored-by: yzhu <yzhu@ubiquant.com>
Co-authored-by: zelong518 <zelonghuang02@gmail.com>
2026-01-12 23:44:45 +08:00
76f69b7753 [diffusion] app: add ComfyUI plugin support for SGLang-Diffusion (#15271)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
2026-01-12 21:58:16 +08:00
chenxu214 53dca74f47 Bugfix: EagleDraftWorker has not attribute "eagle_use_aux_hidden_state" (#16480) 2026-01-12 20:14:35 +08:00
HuangJiyhyang201gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2dadf63562 [diffusion] Support I2I/TI2I/I2V/TI2V warmup && T2I/T2V warmup bug fix (#16922)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-12 19:40:37 +08:00
Liangsheng YinandDarkSharpness 2b3791ed37 Fix wrong kernel selection for int32/int64 indices (#16912)
Co-authored-by: DarkSharpness <2040703891@qq.com>
2026-01-12 17:26:57 +08:00
Xun Sun 9f5cd80a8d Re-introduce the unit test of test_mooncake_ep_small (#16019) 2026-01-12 17:01:24 +08:00
Hu Chongandroot f44c63eef7 [diffusion] chore: validate sampling params (#16677)
Co-authored-by: root <root@huchong2-0.huchong2.podvm.svc.cluster.local>
2026-01-12 16:00:10 +08:00
HuangJi feb39f7768 [diffusion] model: Support TurboWan2.2-I2V SLA && add CI test for TurboWan (#16536) 2026-01-12 13:55:38 +08:00
Liangsheng Yin 5b7bed7ca4 Decouple grammar logic out of scheduler. (#16820) 2026-01-12 10:52:42 +08:00
chenxu140 38a88479c6 llama model and llama eagle3 model support dp-attn (#15268) 2026-01-12 08:54:56 +08:00
Liangsheng Yin 934ae89abe Tiny fix typo minxin -> mixin (#16908) 2026-01-12 00:36:45 +08:00
Yibo Cai 2f4a6addf3 [cpu/arm64] support run sglang on arm64 cpu (#14867) 2026-01-11 04:27:19 -08:00
Adarsh Shirawalmathandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 7b089ae4e0 [Diffusion] Docs for Diffusers backend (#16864)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-01-11 00:08:26 -08:00
Liangsheng Yin 09e2571e2e Clarify the meaning of cpu_group / entry_rank when dp + tp is enabled. (#16876) 2026-01-11 13:04:43 +08:00
Ratish P c0248d6f37 [dpc]: unify DP controller load balancing and simplify dispatch logic (#16258) 2026-01-11 12:38:03 +08:00
Leoyzen cf14feba4d Fix parallel tool call parsing bug when tool parameters contain arrays (#16345) 2026-01-10 19:31:38 -08:00
Mohammad Miadh Angkad ff97814232 Tiny fix hicache kernel backend comparison (#16867)
Signed-off-by: Mohammad Miadh Angkad <MAngkad.BSDSBA2027@aim.edu>
2026-01-10 18:10:42 -08:00
DarkSharpness d112f6a25b [Feature] Support JIT set kv cache (#16273) 2026-01-10 17:34:09 -08:00
Minglei Zhu a2c2c09d7d [BugFix] fix gpt-oss-120b launch failure with --enable-piecewise-cuda-graph (#16757) 2026-01-11 09:19:59 +08:00
Yuwei An 2a9344d320 [tiny remove] remove torch_compile in parallel_state (#16865)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2026-01-10 16:04:25 -08:00
Qiaolin Yu 206db66f5c tiny refactor pcg split op registration (#16863) 2026-01-10 23:45:28 +08:00
5c72be1e51 [diffusion] feat: support multiple LoRA adapters loading and application (#16667)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-10 23:32:45 +08:00
wxy 76d4881794 [diffusion] improve: apply tp optim to cross-attn for wan2.2 (#16788) 2026-01-10 21:25:59 +08:00
Yuan Luoandluoyuan.luo d1ec93e3ac Optimize layernorm_gated for Qwen3-Next (#16397)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-01-10 20:55:31 +08:00
bdb76b34db [diffusion] fix: fix LoRA weight merging when using layerwise offload (#16737)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: DavisTao <dwt614707404@163.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-10 20:17:35 +08:00
fzyzcjy dae6a4092a Tiny add scheduler status logging (#16872) 2026-01-10 20:12:24 +08:00