chenchenghao/sglang
1
0
Fork 0
Code Issues Pull Requests Actions 12 Packages Projects Releases Wiki Activity

[1/2] Add ModelExpress coordination for remote instance weight loading - matching TP (#19920)

Browse Source 
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Ishan Dhanani <ishan@dhanani.dev>
This commit is contained in:
ishandhanani
2026-03-18 13:38:32 -07:00
committed by GitHub
co-authored by Claude Opus 4.6 Ishan Dhanani
parent 6cca5b9b97
commit 8f0f36c64b
6 changed files with 320 additions and 11 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/sglang/srt/configs/load_config.py
+2
View File
@@ -76,6 +76,8 @@ class LoadConfig:
remote_instance_weight_loader_send_weights_group_ports: Optional[List[int]] = None
remote_instance_weight_loader_backend: Optional[str] = None
remote_instance_weight_loader_transfer_engine: Optional[Any] = None
modelexpress_url: Optional[str] = None
modelexpress_model_name: Optional[str] = None
# ModelOpt-specific loading options
modelopt_checkpoint_restore_path: Optional[str] = None