fix: re-export log_cp_draft_shared_kv_debug from cp_shared_kv_runtime
nsa_indexer.py imports log_cp_draft_shared_kv_debug from cp_shared_kv_runtime, but ad358d164 defined it in nsa/utils.py. The missing symbol caused deepseek_v2.py import to fail silently (registry.py catches and warns), falling back to transformers.py which loads unsharded 256-expert MoE parameters → OOM on H200. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
This commit is contained in:
@@ -9,6 +9,7 @@ from typing import Any
|
||||
import torch
|
||||
|
||||
from sglang.srt.environ import envs
|
||||
from sglang.srt.layers.attention.nsa.utils import log_cp_draft_shared_kv_debug # noqa: F401
|
||||
from sglang.srt.layers.dp_attention import get_attention_cp_group
|
||||
from sglang.srt.mem_cache.cp_shared_kv_layout import CpSharedKVLayout
|
||||
|
||||
|
||||
Reference in New Issue
Block a user