chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

Mistral Large 3 NVFP4 support (#14485)

Browse Source 
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
This commit is contained in:
Daniel Cámpora
2025-12-13 13:34:42 +08:00
committed by GitHub
co-authored by Linda-Stadter Xinyuan Tong elvischenv
parent 2a39cfe0ff
commit f6031adf08
11 changed files with 502 additions and 36 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/layers/quantization/compressed_tensors/utils.py
+1
View File
@@ -14,6 +14,7 @@ def is_activation_quantization_format(format: str) -> bool:
CompressionFormat.naive_quantized.value,
CompressionFormat.int_quantized.value,
CompressionFormat.float_quantized.value,
CompressionFormat.nvfp4_pack_quantized.value,
]
return format in _ACTIVATION_QUANTIZATION_FORMATS