From ceb105a7802329165a14337eb46c6da6e094f124 Mon Sep 17 00:00:00 2001 From: Kangyan-Zhou Date: Sat, 25 Oct 2025 09:22:00 -0700 Subject: [PATCH] Update setup_github_runner.md --- docs/developer_guide/setup_github_runner.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/docs/developer_guide/setup_github_runner.md b/docs/developer_guide/setup_github_runner.md index 6ed78a247..c6050a6b9 100644 --- a/docs/developer_guide/setup_github_runner.md +++ b/docs/developer_guide/setup_github_runner.md @@ -4,12 +4,13 @@ ### Step 1: Start a docker container. -You can mount a folder for the shared huggingface model weights cache. The command below uses `/tmp/huggingface` as an example. +**You can mount a folder for the shared huggingface model weights cache. ** +The command below uses `/tmp/huggingface` as an example. ``` -docker pull nvidia/cuda:12.1.1-devel-ubuntu22.04 +docker pull nvidia/cuda:12.9.1-devel-ubuntu22.04 # Nvidia -docker run --shm-size 128g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.1.1-devel-ubuntu22.04 /bin/bash +docker run --shm-size 128g -it -v /tmp/huggingface:/hf_home --gpus all nvidia/cuda:12.9.1-devel-ubuntu22.04 /bin/bash # AMD docker run --rm --device=/dev/kfd --device=/dev/dri --group-add video --shm-size 128g -it -v /tmp/huggingface:/hf_home lmsysorg/sglang:v0.5.0rc1-rocm630 /bin/bash # AMD just the last 2 GPUs @@ -22,6 +23,7 @@ Run these commands inside the container. ``` apt update && apt install -y curl python3-pip git +pip install upgrade pip export RUNNER_ALLOW_RUNASROOT=1 ```