chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

[Doc]Update note for Cuda 13 container usage (#16805)

Browse Source
This commit is contained in:
Baizhou Zhang
2026-01-10 14:03:19 +08:00
committed by GitHub
parent 67b61a4e8d
commit 94fc26aad8
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
docs/get_started/install.md
View File

@@ -204,3 +204,4 @@ echo "Build and push completed successfully!"
- [FlashInfer](https://github.com/flashinfer-ai/flashinfer) is the default attention kernel backend. It only supports sm75 and above. If you encounter any FlashInfer-related issues on sm75+ devices (e.g., T4, A10, A100, L4, L40S, H100), please switch to other kernels by adding `--attention-backend triton --sampling-backend pytorch` and open an issue on GitHub.
- To reinstall flashinfer locally, use the following command: `pip3 install --upgrade flashinfer-python --force-reinstall --no-deps` and then delete the cache with `rm -rf ~/.cache/flashinfer`.
- To run sglang in Cuda 13 environment, please use the following docker: `docker pull lmsysorg/sglang:latest-cu130-runtime`.