chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

[NPU] support model skywork-reward-gemma2-2-27B-v0.2 (#16947)

Browse Source 
Co-authored-by: cy <chenyang08056032@163.com>
This commit is contained in:
McZyWu
2026-02-11 15:34:53 +08:00
committed by GitHub
co-authored by cy
parent 72c1526657
commit 4f7422f7ba
7 changed files with 135 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/environ.py
+4
View File
@@ -294,6 +294,10 @@ class Envs:
SGLANG_NPU_DISABLE_ACL_FORMAT_WEIGHT = EnvBool(False)
SGLANG_NPU_USE_MULTI_STREAM = EnvBool(False)
SGLANG_NPU_USE_MLAPO = EnvBool(False)
# Forward native implementation for activation gelu tanh for model Skywork-Reward-Gemma-2-27B-v0.2
SGLANG_NPU_FORWARD_NATIVE_GELUTANH = EnvBool(False)
# Forward native implementation for gemma rms norm for model Skywork-Reward-Gemma-2-27B-v0.2
SGLANG_NPU_FORWARD_NATIVE_GEMMA_RMS_NORM = EnvBool(False)
# Quantization
SGLANG_INT4_WEIGHT = EnvBool(False)