[Qwen3-next] Add PD disaggregation support for mamba with extra_buffer (#15180)

Signed-off-by: Shangming Cai <csmthu@gmail.com> Co-authored-by: ybyang <10629930+whybeyoung@users.noreply.github.com>
2025-12-16 14:36:00 +08:00
parent 6292d97135
commit 36fcf71fff
5 changed files with 79 additions and 7 deletions
--- a/python/sglang/srt/model_executor/model_runner.py
+++ b/python/sglang/srt/model_executor/model_runner.py
@@ -1797,6 +1797,7 @@ class ModelRunner:
                        enable_memory_saver=self.server_args.enable_memory_saver,
                        cache_params=config.mamba2_cache_params,
                        speculative_num_draft_tokens=self.server_args.speculative_num_draft_tokens,
+                        enable_mamba_extra_buffer=self.server_args.enable_mamba_extra_buffer(),
                        pre_alloc_size=pre_alloc_size,
                    )
                else: