From 6c5bf53a36e1fd5e002d11dc72a151190aeac47c Mon Sep 17 00:00:00 2001 From: Matt Van Horn Date: Sat, 14 Mar 2026 16:43:48 -0700 Subject: [PATCH] [Doc] Clarify that --chat-template is required for Qwen3-Reranker (#20596) Co-authored-by: Matt Van Horn <455140+mvanhorn@users.noreply.github.com> Co-authored-by: Claude Opus 4.6 (1M context) Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> --- docs/supported_models/retrieval_ranking/rerank_models.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/supported_models/retrieval_ranking/rerank_models.md b/docs/supported_models/retrieval_ranking/rerank_models.md index bb989128a..12f3e05e2 100644 --- a/docs/supported_models/retrieval_ranking/rerank_models.md +++ b/docs/supported_models/retrieval_ranking/rerank_models.md @@ -161,6 +161,7 @@ Example (with `top_n: 2`): ### Common Pitfalls +- **`--chat-template` is required.** Without `--chat-template examples/chat_template/qwen3_reranker.jinja`, the server does not recognize the model as a decoder-only reranker and returns a 400 error: `"This model does not appear to be an embedding model by default. Please add `--is-embedding`..."`. The fix is to add the chat template flag, NOT `--is-embedding`. - If you launch Qwen3-Reranker with `--is-embedding`, `/v1/rerank` cannot compute yes/no logprob scores. Relaunch **without** `--is-embedding`. - If you see a validation error like "score should be a valid number" and the backend returned a list, upgrade to a version that coerces `embedding[0]` into `score` for rerank responses.