diff --git a/docs/platforms/ascend_npu_support_features.md b/docs/platforms/ascend_npu_support_features.md index ee233a9f4..a66d044b8 100644 --- a/docs/platforms/ascend_npu_support_features.md +++ b/docs/platforms/ascend_npu_support_features.md @@ -202,23 +202,23 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen ## Speculative decoding -| Argument | Defaults | Options | A2 | A3 | -|------------------------------------------------------------------|-----------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:----------------------------------------:|:----------------------------------------:| -| `--speculative-algorithm` | `None` | `EAGLE3`,
`NEXTN` | **** | **** | -| `--speculative-draft-model-path`
`--speculative-draft-model` | `None` | Type: str | **** | **** | -| `--speculative-draft-model-`
`revision` | `None` | Type: str | **** | **** | -| `--speculative-draft-load-format` | `None` | `auto`,
`pt`,
`safetensors`,
`npcache`,
`dummy`,
`sharded_state`,
`gguf`,
`bitsandbytes`,
`layered`,
`flash_rl`,
`remote`,
`remote_instance`,
`fastsafetensors`,
`private` | **×** | **×** | -| `--speculative-num-steps` | `None` | Type: int | **** | **** | -| `--speculative-eagle-topk` | `None` | Type: int | **** | **** | -| `--speculative-num-draft-tokens` | `None` | Type: int | **** | **** | -| `--speculative-accept-`
`threshold-single` | `1.0` | Type: float | **** | **** | -| `--speculative-accept-`
`threshold-acc` | `1.0` | Type: float | **** | **** | -| `--speculative-token-map` | `None` | Type: str | **×** | **×** | -| `--speculative-attention-`
`mode` | `prefill` | `prefill`,
`decode` | **** | **** | -| `--speculative-moe-runner-`
`backend` | `None` | `auto`,
`deep_gemm`,
`triton`,
`triton_kernel`,
`flashinfer_trtllm`,
`flashinfer_cutlass`,
`flashinfer_mxfp4`,
`flashinfer_cutedsl`,
`cutlass` | **** | **** | -| `--speculative-moe-a2a-`
`backend` | `None` | `none`,
`deepep`,
`mooncake`,
`ascend_fuseep` | **** | **** | -| `--speculative-draft-attention-backend` | `None` | Type: str | **** | **** | -| `--speculative-draft-model-quantization` | `None` | `awq`,
`fp8`,
`gptq`,
`marlin`,
`gptq_marlin`,
`awq_marlin`,
`bitsandbytes`,
`gguf`,
`modelopt`,
`modelopt_fp8`,
`modelopt_fp4`,
`petit_nvfp4`,
`w8a8_int8`,
`w8a8_fp8`,
`moe_wna16`,
`qoq`,
`w4afp8`,
`mxfp4`,
`auto-round`,
`compressed-tensors`,
`modelslim`,
`unquant` | **** | **** | +| Argument | Defaults | Options | A2 | A3 | +|------------------------------------------------------------------|-----------|--------------------------|:----------------------------------------:|:----------------------------------------:| +| `--speculative-algorithm` | `None` | `EAGLE3`,
`NEXTN` | **** | **** | +| `--speculative-draft-model-path`
`--speculative-draft-model` | `None` | Type: str | **** | **** | +| `--speculative-draft-model-`
`revision` | `None` | Type: str | **** | **** | +| `--speculative-draft-load-format` | `None` | `auto` | **×** | **×** | +| `--speculative-num-steps` | `None` | Type: int | **** | **** | +| `--speculative-eagle-topk` | `None` | Type: int | **** | **** | +| `--speculative-num-draft-tokens` | `None` | Type: int | **** | **** | +| `--speculative-accept-`
`threshold-single` | `1.0` | Type: float | **×** | **×** | +| `--speculative-accept-`
`threshold-acc` | `1.0` | Type: float | **×** | **×** | +| `--speculative-token-map` | `None` | Type: str | **×** | **×** | +| `--speculative-attention-`
`mode` | `prefill` | `prefill`,
`decode` | **** | **** | +| `--speculative-moe-runner-`
`backend` | `None` | `auto` | **** | **** | +| `--speculative-moe-a2a-`
`backend` | `None` | `ascend_fuseep` | **** | **** | +| `--speculative-draft-attention-backend` | `None` | `ascend` | **** | **** | +| `--speculative-draft-model-quantization` | `None` | `unquant` | **** | **** | ## Ngram speculative decoding @@ -278,7 +278,7 @@ click [Server Arguments](https://docs.sglang.io/advanced_features/server_argumen | `--radix-eviction-policy` | `lru` | `lru`, `lfu` | **** | **** | | `--hicache-io-backend` | `kernel` | `kernel_ascend`,
`direct` | **** | **** | | `--hicache-mem-layout` | `layer_first` | `page_first_direct`,
`page_first_kv_split` | **** | **** | -| `--hicache-storage-`
`backend` | `None` | `file` | **** | **** | +| `--hicache-storage-`
`backend` | `None` | `file` | **×** | **×** | | `--hicache-storage-`
`prefetch-policy` | `best_effort` | `best_effort`,
`wait_complete`,
`timeout` | **×** | **×** | | `--hicache-storage-`
`backend-extra-config` | `None` | Type: str | **×** | **×** |