[GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333)
This commit is contained in:
@@ -1,4 +1,4 @@
|
||||
## Launch GLM-4.5 / GLM-4.6 with SGLang
|
||||
## Launch GLM-4.5 / GLM-4.6 / GLM-4.7 with SGLang
|
||||
|
||||
To serve GLM-4.5 / GLM-4.6 FP8 models on 8xH100/H200 GPUs:
|
||||
|
||||
@@ -35,7 +35,9 @@ python3 -m sglang.launch_server \
|
||||
--enable-custom-logit-processor
|
||||
```
|
||||
|
||||
### Thinking Budget for GLM-4.5 / GLM-4.6
|
||||
**Note**: For GLM-4.7, `--tool-call-parser` should be set to `glm47`, for GLM-4.5 and GLM-4.6, it should be set to `glm45`.
|
||||
|
||||
### Thinking Budget
|
||||
|
||||
In SGLang, we can implement thinking budget with `CustomLogitProcessor`.
|
||||
|
||||
|
||||
Reference in New Issue
Block a user