chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 11 Packages Projects Releases Wiki Activity

Support data parallelism (static) (#480)

Browse Source 
Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
This commit is contained in:
Ying Sheng
2024-05-27 21:24:10 -07:00
committed by GitHub
co-authored by Ying Sheng Lianmin Zheng Liangsheng Yin Zhiqiang Xie
parent 565d727409
commit 0463f7fb52
32 changed files with 580 additions and 181 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/models/mixtral.py
+1 -1
View File
@@ -35,7 +35,7 @@ from vllm.utils import print_warning_once
from sglang.srt.layers.logits_processor import LogitsProcessor
from sglang.srt.layers.radix_attention import RadixAttention
from sglang.srt.managers.router.model_runner import InputMetadata
from sglang.srt.managers.controller.model_runner import InputMetadata