chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 13 Packages Projects Releases Wiki Activity

Add env var to control custom Triton kernel cache and set CSGMV as default backend. (#12176)

Browse Source
This commit is contained in:
Lifu Huang
2025-10-27 17:49:32 -07:00
committed by GitHub
parent 88596739a4
commit ce832d7034
13 changed files with 24 additions and 25 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/environ.py
+1
View File
@@ -180,6 +180,7 @@ class Envs:
# Triton
SGLANG_TRITON_DECODE_ATTN_STATIC_KV_SPLITS = EnvBool(False)
SGLANG_USE_CUSTOM_TRITON_KERNEL_CACHE = EnvBool(False)
# Torch Compile
SGLANG_ENABLE_TORCH_COMPILE = EnvBool(False)