improve default glm mtp setting (#14457)

Signed-off-by: Brayden Zhong <b8zhong@users.noreply.github.com>
This commit is contained in:
b8zhong
2025-12-08 13:27:13 -08:00
committed by GitHub
parent b9bef31a15
commit 32f8b6064e
7 changed files with 877 additions and 0 deletions

View File

@@ -4595,6 +4595,7 @@ def auto_choose_speculative_params(self: ServerArgs):
"DeepseekV3ForCausalLM",
"DeepseekV2ForCausalLM",
"GptOssForCausalLM",
"Glm4MoeForCausalLM",
"BailingMoeForCausalLM",
"BailingMoeV2ForCausalLM",
"MistralLarge3ForCausalLM",