chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

fix(config): Support setting Mamba state dtype via config file (#18532)

Browse Source 
Co-authored-by: 瑀澈 <yuche.lz@alibaba-inc.com>
This commit is contained in:
Zheng Li
2026-02-11 00:20:06 +08:00
committed by GitHub
co-authored by 瑀澈
parent d0d387dea1
commit 44603764d6
8 changed files with 103 additions and 19 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/environ.py
+1 -1
View File
@@ -418,7 +418,7 @@ class Envs:
# Mamba
SGLANG_MAMBA_CONV_DTYPE = EnvStr("bfloat16")
SGLANG_MAMBA_SSM_DTYPE = EnvStr("float32")
SGLANG_MAMBA_SSM_DTYPE = EnvStr(None)
# Release & Resume Memory
SGLANG_MEMORY_SAVER_CUDA_GRAPH = EnvBool(False)