Add interface_v1 option for dynamic HiCache backend (#13140)

Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
This commit is contained in:
pansicheng
2025-11-18 09:42:17 +08:00
committed by GitHub
parent e2c9a59023
commit d879e37f1b
2 changed files with 5 additions and 1 deletions

View File

@@ -182,6 +182,7 @@ python3 -m sglang.launch_server \
- `backend_name`: Custom backend identifier
- `module_path`: Python module path to your implementation
- `class_name`: Your HiCache implementation class name
- `interface_v1`: 0 (disable) or 1 (enable) to control usage of batch_get_v1 and batch_set_v1 methods
## Community and Support