chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[Feature][NPU]: add runtime support for AutoRound quantized models (#16699)

Browse Source 
Co-authored-by: root <root@localhost.localdomain>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
This commit is contained in:
YeChang Guo
2026-03-07 18:03:55 +03:00
committed by GitHub
co-authored by root ronnie_zheng
parent fd79cd8d9c
commit 13bdc7bf4a
5 changed files with 181 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/linear.py
+1 -2
View File
@@ -64,10 +64,9 @@ WEIGHT_LOADER_V2_SUPPORTED = [
"GPTQMarlin24LinearMethod",
"TPUInt8LinearMethod",
"GPTQLinearMethod",
"GPTQLinearAscendMethod",
"GPTQMoEAscendMethod",
"FBGEMMFp8LinearMethod",
"GPTQLinearAscendMethod",
"GPTQMoEAscendMethod",
"ModelOptFp8LinearMethod",
"ModelOptFp4LinearMethod",
"IPEXAWQLinearMethod",