Commit Graph
137 Commits
Author SHA1 Message Date
Mick 41bd76e18b [diffusion] log: fix wrong use of suppress_other_loggers (#15534) 2025-12-20 23:43:55 +08:00
Mick c6ca1b3afc [diffusion] chore: allow all attention backends if not specified (#15530) 2025-12-20 23:14:55 +08:00
Xiaoyu Zhang 8999ce754f [diffusion] perf: support zero-cost weight offload and overlap with compute for wan-series (#15511) 2025-12-20 22:52:40 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> c0f9b51992 [diffusion] refactor: deprecate workloadtype (#15267)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-20 11:24:31 +08:00
Yashika Gandhi - Google 05eb0bcc61 [diffusion] http-server: support vertex generate pathway (#15348) 2025-12-20 01:47:17 +08:00
Xiaoyu Zhangandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> f3705b0115 [diffusion] doc: add doc for attention backends (#15408)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-19 22:10:29 +08:00
Mick ff1e2ce24d [diffusion] fix: fix wrong validation on 2k resolution (#15478) 2025-12-19 21:28:45 +08:00
ryangandMengxi Li 1e58248808 [diffusion] multi-platform: add Sage Attention 3 Support for sm 120 (RTX5090) (#15382)
Co-authored-by: Mengxi Li <marcyleemx@gmail.com>
2025-12-19 21:27:02 +08:00
46be74b4b4 [diffusion] kernel: timestep embedding kernel implementation (#12995)
Co-authored-by: 戚余航 <qiyuhang@bytedance.com>
Co-authored-by: Qi Yuhang <45795032+HydraQYH@users.noreply.github.com>
2025-12-19 20:59:50 +08:00
suyeduand也渡 1c65802648 [diffusion] feat: support multiple input images for generate mode (#15394)
Co-authored-by: 也渡 <fangxinlei.fxl@alibaba-inc.com>
2025-12-19 20:08:10 +08:00
Yuhao Yang ba41080892 [diffusion] model: support qwen-image-edit-2511 (#15458) 2025-12-19 20:06:00 +08:00
HuangJi 89512029f1 [diffusion]Support url image input (#15262) 2025-12-19 19:37:23 +08:00
4bf06635fc [diffusion] multi-platform: support diffusion on amd and fix encoder loading on MI325 (#13760)
Co-authored-by: Sabre Shao <sabre.shao@amd.com>
Co-authored-by: Yusheng (Ethan) Su <yushengsu.thu@gmail.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>
Co-authored-by: xsun <sunxiao04@gmail.com>
2025-12-19 15:38:46 +08:00
coco 0e869f0868 [diffusion] refactor: refactor _build_req_from_sampling to use shallow_asdict (#13782) 2025-12-19 15:19:56 +08:00
Mick a0985dd5e5 [diffusion] profiling: add bench_serving.py and VBench (#15410) 2025-12-19 10:57:39 +08:00
Xiaoyu Zhang 9a7641d7bf [diffusion] profiling: include per-denoising-step timings in perf-dump-path (#15397) 2025-12-18 18:43:33 +08:00
Xiaoyu ZhangMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>github-actions[bot] <github-actions[bot]@users.noreply.github.com>
6c4bf8a0be [diffusion] profiling: enhance trace export with gzip and integrity check (#15326)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
2025-12-17 20:44:55 +08:00
Xiaoyu Zhang 533851fbcb [diffusion] ci: add flux2 tp2 test into ci to avoid breaking tensor parallel (#15237) 2025-12-17 20:44:21 +08:00
cdce516331 [diffusion] api: add sampling parameters and model info endpoint to OpenAI API (#15071)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: niehen6174 <nihen6174@gmail.com>
2025-12-17 15:33:18 +08:00
Baizhou Zhang 28a19e494b Fix lint (#15281) 2025-12-16 13:36:01 -08:00
Mick f95729b06f [diffusion] doc: update profiling.md (#15270) 2025-12-16 23:48:32 +08:00
R0CKSTAR 9f4ed93dd8 [diffusion] multi-platform: use current_platform.device_type to replace hard-coded cuda device (#15232)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2025-12-16 22:17:33 +08:00
Xiaoyu Zhang 6292d97135 [diffusion] fix: fix pack qkv opt break tensor parallel (#15225) 2025-12-16 14:33:49 +08:00
Xiaoyu ZhangMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
4901693110 [diffusion] perf: support FFN pack gate and up proj for Z-Image(#15201)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-16 01:18:47 +08:00
Xiaoyu Zhang c0d94440b7 [diffusion] perf: support pack qkv for Z-Image (#15191) 2025-12-16 00:22:24 +08:00
Mickandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> 1dedb63860 [diffusion] chore: minor code cleanups (#15190)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-15 23:57:02 +08:00
Xiaoyu ZhangandMick 7bc8b1532e [diffusion] fix: fix AttributeError in _build_parallelism_config when accessing tp_group.device_group (#15196)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-15 23:41:06 +08:00
MickandBrain97 b098b1ae24 [diffusion] fix: fix video model sp when resolution is not specified (#15047)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
2025-12-15 20:25:43 +08:00
Lancer abd3e048f2 [diffusion] fix: fix pytorch non-writable array warning (#15017) 2025-12-15 20:18:54 +08:00
Xiaoyu ZhangandMick 92c29d43ac [diffusion] fix: cache dit with parallel (#15163)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-15 19:15:51 +08:00
Yuhao Yang 01b955ac3d [diffusion] model: support mutli-image input and qwen-image-edit-2509 (#15005) 2025-12-15 16:17:10 +08:00
Xiaoyu Zhang 4513f549ee [diffusion] fix: fix default resolution 720p width from 1080 to 1280 (#15058) 2025-12-15 09:16:47 +08:00
Xiaoyu ZhangandMick 64b5c3ab90 [diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-15 00:33:29 +08:00
Li JinliangandMick 6f0c77d7f8 [diffusion] app: support webui (#14961)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-14 21:07:36 +08:00
Xiaoyu ZhangandMick e3f51e823e [diffusion] feat: add support for additional sampling parameters in video generation API (#15062)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-14 19:44:03 +08:00
Xiaoyu Zhanggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Mick
fdfabb7afc [diffusion] fix: tiny fix _templated_ring_attention bug (#15053)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-14 19:41:53 +08:00
19c16748ce [diffusion] feat: support resolution check for video model (#14881)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-12-14 17:50:13 +08:00
Mick c20d43d2e6 [diffusion] doc: update profiling.md with output location details (#15072) 2025-12-13 23:15:23 +08:00
Xiaoyu ZhangMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
0c23331e2e [diffusion] doc: add multimodal-gen profiling doc (#15069)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-13 22:26:20 +08:00
Fenglin Yu dcc5f5c0da [diffusion] feat: Improve LoRA compatibility by adding unified format detection and diffusers-based normalization (#14659) 2025-12-13 16:04:36 +08:00
Mick 875f84db7b [diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034) 2025-12-13 13:42:38 +08:00
Xiaoyu ZhangMickgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
3e1e71575c [diffusion] docker: Tiny fix Docker Hub link in installation documentation (#14987)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-12-12 20:25:36 +08:00
Mick 82e33170e1 [diffusion] chore: minor code cleanups and improve logging (#14916) 2025-12-12 18:48:07 +08:00
Prozac614 198c8ecf98 [diffusion] fix: support applying different LoRA adapters to different transformers in multi-transformer pipelines (#14839) 2025-12-12 13:08:57 +08:00
Mick ca1144212a [diffusion] UX: suppress excessive loggers (#14900) 2025-12-11 22:10:22 +08:00
Mick 5d804a3767 [diffusion] feat: support sageattn & sageattn3 backend (#14878) 2025-12-11 20:59:44 +08:00
fca8e88f28 [diffusion] feat: enable torch compile to eliminate GPU bubble (#13641)
Co-authored-by: jianyingzhu <53300651@qq.com>
Co-authored-by: Jianying <53503712+jianyingzhu@users.noreply.github.com>
Co-authored-by: root <root@2u2g-spr-0417.ipp4a1.colossus.nvidia.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2025-12-11 19:06:32 +08:00
Mick d659873762 [diffusion] CI: use unified sampling_params for CI (#14045) 2025-12-11 01:18:56 +08:00
Mick 6c5ebc0ef7 [diffusion] parallel: pad tokens for video models under sp (#14833) 2025-12-11 01:15:37 +08:00
Li Jinliang 83e35a7c29 [diffusion] doc: fix tiny typo in multimodal_gen/README.md (#14830) 2025-12-11 00:27:25 +08:00