chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

fix: update flashinfer to 0.1.2 to fix sampling for cu118 (#803)

Browse Source
This commit is contained in:
Yineng Zhang
2024-07-29 11:00:52 -07:00
committed by GitHub
parent 7cd4f244a4
commit 87064015d9
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/server.py
+1 -1
View File
@@ -226,7 +226,7 @@ def launch_server(
if not server_args.disable_flashinfer:
assert_pkg_version(
"flashinfer",
"0.1.1",
"0.1.2",
"Please uninstall the old version and "
"reinstall the latest version by following the instructions "
"at https://docs.flashinfer.ai/installation.html.",