chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

Revert "Skip weight loading in deepgemm compilation" (#14241)

Browse Source
This commit is contained in:
ishandhanani
2025-12-01 12:59:09 -08:00
committed by GitHub
parent edbeaf3b88
commit 07821352fb
1 changed files with 0 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
python/sglang/compile_deep_gemm.py
View File

@@ -148,9 +148,6 @@ def refine_server_args(server_args: ServerArgs, compile_args: CompileArgs):
server_args.enable_torch_compile = False
print(f"Disable CUDA Graph and Torch Compile to save time...")
server_args.load_format = "dummy"
print(f"Set load format to dummy to save time...")
# Set watchdog timeout to compile_args.timeout because compilation will take a long time
server_args.watchdog_timeout = compile_args.timeout
server_args.warmups = "compile-deep-gemm"