Update ascend docs (#20674)
This commit is contained in:
@@ -15,7 +15,7 @@ The GLM (General Language Model) series is an open-source bilingual large langua
|
||||
|
||||
### Installation
|
||||
|
||||
The dependencies required for the NPU runtime environment have been integrated into a Docker image and uploaded to the quay.io platform. You can directly pull it.
|
||||
The dependencies required for the NPU runtime environment have been integrated into a Docker image and uploaded to the Ascend platform. You can directly pull it.
|
||||
|
||||
```{code-block} bash
|
||||
#Atlas 800 A3
|
||||
@@ -32,7 +32,7 @@ docker run -itd --shm-size=16g --privileged=true --name ${NAME} \
|
||||
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver \
|
||||
-v /usr/local/Ascend/firmware:/usr/local/Ascend/firmware \
|
||||
--device=/dev/davinci0:/dev/davinci0 \
|
||||
--device=/dev/davinci1:/dev/avinci1 \
|
||||
--device=/dev/davinci1:/dev/davinci1 \
|
||||
--device=/dev/davinci2:/dev/davinci2 \
|
||||
--device=/dev/davinci3:/dev/davinci3 \
|
||||
--device=/dev/davinci4:/dev/davinci4 \
|
||||
|
||||
@@ -8,9 +8,9 @@ The dependencies required for the NPU runtime environment have been integrated i
|
||||
|
||||
```{code-block} bash
|
||||
#Atlas 800 A3
|
||||
docker pull quay.io/ascend/sglang:v0.5.9-cann8.5.0-a3
|
||||
docker pull quay.io/ascend/sglang:main-cann8.5.0-a3
|
||||
#Atlas 800 A2
|
||||
docker pull quay.io/ascend/sglang:v0.5.9-cann8.5.0-910b
|
||||
docker pull quay.io/ascend/sglang:main-cann8.5.0-910b
|
||||
|
||||
#start container
|
||||
docker run -itd --shm-size=16g --privileged=true --name ${NAME} \
|
||||
|
||||
@@ -124,7 +124,7 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
|
||||
| `--enable-trace` | `False` | bool flag<br/> (set to enable) | A2, A3 |
|
||||
| `--oltp-traces-endpoint` | `localhost:4317` | Type: str | A2, A3 |
|
||||
| `--log-requests-target` | `None` | Type: str | A2, A3 |
|
||||
| `--uvicorn-access-log-exclude-prefixes` | `DEFAULT_UVICORN_ACCESS_LOG_EXCLUDE_PREFIXES` | Type: str | A2, A3 |
|
||||
| `--uvicorn-access-log-exclude-prefixes` | `[]` | List[str] | A2, A3 |
|
||||
|
||||
## RequestMetricsExporter configuration
|
||||
|
||||
@@ -144,7 +144,7 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen
|
||||
| `--chat-template` | `None` | Type: str | A2, A3 |
|
||||
| `--completion-template` | `None` | Type: str | A2, A3 |
|
||||
| `--enable-cache-report` | `False` | bool flag<br/> (set to enable) | A2, A3 |
|
||||
| `--reasoning-parser` | `None` | `deepseek-r1` | A2, A3 |
|
||||
| `--reasoning-parser` | `None` | `deepseek-r1`<br/>`deepseek-v3`<br/>`glm45`<br/>`gpt-oss`<br/>`kimi`<br/>`qwen3`<br/>`qwen3-thinking`<br/>`step3` | A2, A3 |
|
||||
| `--tool-call-parser` | `None` | `deepseekv3`<br/>`deepseekv31`<br/>`glm`<br/>`glm45`<br/>`glm47`<br/>`gpt-oss`<br/>`kimi_k2`<br/>`llama3`<br/>`mistral`<br/>`pythonic`<br/>`qwen`<br/>`qwen25`<br/>`qwen3_coder`<br/>`step3`<br/>`gigachat3` | A2, A3 |
|
||||
| `--sampling-defaults` | `model` | `openai`, `model` | A2, A3 |
|
||||
|
||||
|
||||
Reference in New Issue
Block a user