[Minor] update docs (#14212)
This commit is contained in:
@@ -1,4 +1,4 @@
|
||||
# https://docs.sglang.ai/platforms/cpu_server.html
|
||||
# https://docs.sglang.io/platforms/cpu_server.html
|
||||
[build-system]
|
||||
requires = ["setuptools>=61.0", "wheel"]
|
||||
build-backend = "setuptools.build_meta"
|
||||
|
||||
@@ -84,7 +84,7 @@ srt_hip = [
|
||||
"wave-lang==3.8.2",
|
||||
]
|
||||
|
||||
# https://docs.sglang.ai/platforms/ascend_npu.html
|
||||
# https://docs.sglang.io/platforms/ascend_npu.html
|
||||
srt_npu = ["sglang[runtime_common]"]
|
||||
|
||||
# For Intel Gaudi(device : hpu) follow the installation guide
|
||||
|
||||
@@ -6,7 +6,7 @@ Related documentation:
|
||||
* [Quick Start: SGLang HiCache with Mooncake Backend](https://kvcache-ai.github.io/Mooncake/getting_started/examples/sglang-integration/hicache-quick-start.html)
|
||||
* [Complete Guide: SGLang HiCache with Mooncake Backend](https://kvcache-ai.github.io/Mooncake/getting_started/examples/sglang-integration/hicache-integration-v1.html)
|
||||
* [Mooncake x SGLang HiCache System Design](https://kvcache-ai.github.io/Mooncake/design/hicache-design.html)
|
||||
* [HiCache System Design and Optimization](https://docs.sglang.ai/advanced_features/hicache_design.html)
|
||||
* [HiCache System Design and Optimization](https://docs.sglang.io/advanced_features/hicache_design.html)
|
||||
* [SGLang HiCache with Mooncake Backend Benchmark](https://kvcache-ai.github.io/Mooncake/performance/sglang-hicache-benchmark-results-v1.html)
|
||||
|
||||
## About Mooncake
|
||||
@@ -252,7 +252,7 @@ In particular, for the `global segment size`, if at least one `store service` in
|
||||
|
||||
**HiCache Related Parameters for SGLang Server**
|
||||
|
||||
For a comprehensive overview of HiCache-related parameters, please refer to [this document](https://docs.sglang.ai/advanced_features/hicache_design.html#related-parameters).
|
||||
For a comprehensive overview of HiCache-related parameters, please refer to [this document](https://docs.sglang.io/advanced_features/hicache_design.html#related-parameters).
|
||||
|
||||
|
||||
Note that, for `--hicache-mem-layout {layer_first,page_first,page_first_direct}`, which specifies the memory layout for the host memory pool, `page_first` or `page_first_direct` are required if use Mooncake backend.
|
||||
|
||||
@@ -28,7 +28,7 @@ class SamplingParams:
|
||||
The sampling parameters.
|
||||
|
||||
See docs/backend/sampling_params.md or
|
||||
https://docs.sglang.ai/backend/sampling_params.html
|
||||
https://docs.sglang.io/backend/sampling_params.html
|
||||
for the documentation.
|
||||
"""
|
||||
|
||||
|
||||
Reference in New Issue
Block a user