chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

[Diffusion] [NPU] Wan2.2-T2V-A14B-Diffusers modelslim quantization support (#17996)

Browse Source 
Co-authored-by: ronnie_zheng <zl19940307@163.com>
This commit is contained in:
Артем Савкин
2026-03-07 17:26:44 +03:00
committed by GitHub
co-authored by ronnie_zheng
parent f8d4eb7022
commit 5297b02c88
19 changed files with 808 additions and 166 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/platforms/ascend_npu_quantization.md
+5
View File
@@ -19,3 +19,8 @@ Compressed-tensors (LLM Compressor) on Ascend support:
- [x] [W4A16 MOE](https://github.com/sgl-project/sglang/pull/12759)
- [x] [W8A8 dynamic linear](https://github.com/sgl-project/sglang/pull/14504)
- [x] [W8A8 dynamic MOE](https://github.com/sgl-project/sglang/pull/14504)
Diffusion model [modelslim](https://github.com/sgl-project/sglang/pull/17996) quantization on Ascend support:
- [x] W4A4 dynamic linear
- [x] W8A8 static linear
- [x] W8A8 dynamic linear