[GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333)

This commit is contained in:
Yuxuan Zhang
2025-12-20 12:30:44 +08:00
committed by GitHub
parent c0f9b51992
commit b82c7a0ae7
7 changed files with 849 additions and 434 deletions

View File

@@ -1,4 +1,4 @@
## Launch GLM-4.5 / GLM-4.6 with SGLang
## Launch GLM-4.5 / GLM-4.6 / GLM-4.7 with SGLang
To serve GLM-4.5 / GLM-4.6 FP8 models on 8xH100/H200 GPUs:
@@ -35,7 +35,9 @@ python3 -m sglang.launch_server \
--enable-custom-logit-processor
```
### Thinking Budget for GLM-4.5 / GLM-4.6
**Note**: For GLM-4.7, `--tool-call-parser` should be set to `glm47`, for GLM-4.5 and GLM-4.6, it should be set to `glm45`.
### Thinking Budget
In SGLang, we can implement thinking budget with `CustomLogitProcessor`.