Commit Graph

6624 Commits

Author SHA1 Message Date
Liangsheng Yin
243ea585fc [DP-Attn] Clarify MLP sync / idle batch preparation logic (#12843) 2025-11-08 23:23:14 +08:00
Liangsheng Yin
6fee2c535c [CI] Tiny adjust CI esitmation time (#12886) 2025-11-08 23:02:19 +08:00
Charles Chen
f1a9c72de3 Support capturing aux_hidden_states for minimax m2. (#12798) 2025-11-08 01:54:22 -08:00
YAMY
190002c613 [Docs][DeepseekV3.2] Update deepseekv3.2 docs for mha short seq prefill (#12868) 2025-11-08 00:11:02 -08:00
Lianmin Zheng
0296f1cdad [Auto Sync] Update activation.py, logits_processor.py, rota... (20251107) (#12853)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-07 22:07:51 -08:00
Baizhou Zhang
e039ff382c [CI] Fix huggingface access for test_flash_attention_4.py (#12846) 2025-11-07 20:07:06 -08:00
hlu1
b8ddc296f4 [sgl-kernel][Deepseek V3.2] Add row_starts to topk kernel (#12582)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-07 18:33:27 -08:00
alisonshao
0b88d520a0 Add nightly performance test for GPT-OSS 4GPU models (#12805) 2025-11-07 16:54:07 -08:00
Keyang Ru
d3d7f960b5 [router] Switch MCP tests from DeepWiki to self-hosted Brave search server (#12849) 2025-11-07 16:16:07 -08:00
Chang Su
e434187289 [router][grpc] Move all error logs to their call sites (#12859) 2025-11-07 15:55:34 -08:00
Chang Su
fe19a580fb [router][grpc] Refactor: Add builders for chat and responses (#12852) 2025-11-07 15:43:32 -08:00
b8zhong
55e8e3999c add back flashinfer jit cache to dev docker (#12851)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-11-07 14:51:24 -08:00
Mingyi
32f7982800 sglang diffusion announcement (#12856) 2025-11-07 14:35:25 -08:00
Rain Jiang
0f76976c3c remove the fa4 page_size hardcode to 128 restriction on mla model arch (#12801) 2025-11-07 13:30:30 -08:00
Lianmin Zheng
ae62279071 Fix data parallel controller launch for num nodes > 2 (#12822) 2025-11-07 12:13:21 -08:00
Keyang Ru
5c9273c032 [router] Support structured model output for openai and grpc router (#12431) 2025-11-07 10:16:45 -08:00
Mick
e316bcacb1 update multimodal_gen readme (#12825)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
2025-11-07 09:04:44 -08:00
Ke Bao
0fe9c1f70b Fix piecewise cuda graph ci test (#12836) 2025-11-08 00:25:00 +08:00
Yang Kaiyong
61bfd9fa9b optm(checkpoint-engine): disable multi-thread loading when update weights (#12374)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
2025-11-07 21:30:04 +08:00
Chen1022
c67fce160e Fix missing dp_max_padding argument in set_dp_buffer_len (#12812) 2025-11-07 21:27:43 +08:00
hlu1
bef37d6de8 [Deepseek V3.2] Only skip Indexer logits computation when is_extend_without_speculative (#12816)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-07 01:34:04 -08:00
Jonah Bernard
bc25ea6762 [MoE] Add Comprehensive MoE Integration Tests (#12090) 2025-11-07 00:34:46 -08:00
elvischenv
1fa788ec14 [Bugfix] Fix illegal memory access (#12758) 2025-11-06 21:59:57 -08:00
Johnsonms
125f76ea44 [Test] Add DeepSeekV3.2 NSA Indexer Test Suite (#12520) 2025-11-06 21:28:43 -08:00
Yuhao Yang
d8736c756a fix multimodal gen issues (#12765)
Co-authored-by: Mick <mickjagger19@icloud.com>
2025-11-07 13:19:49 +08:00
Kalyan Kumar
3b1cc466c0 fixes hardcoded "cuda" device references in unit tests to use a dynamic device selection (#12761) 2025-11-07 11:38:35 +08:00
Tianyu Guo
0ee5ab5a74 Add PP support for dots_vlm (#12763) 2025-11-06 19:14:27 -08:00
hzh0425
ed5e905c89 [HotFix]: Add missing SGLANG_EPLB_HEATMAP_COLLECTION_INTERVAL env var (#12776) 2025-11-06 18:58:44 -08:00
hzh0425
d9c812d881 [hotfix]: Resolve ModuleNotFoundError in PD deployment for is_in_ci() (#12772) 2025-11-06 18:48:03 -08:00
YAMY
7257525cce [DeepSeek-V3.2][NSA] Enable MHA Pathway for Short Sequence Prefill on B200 (SM100) (#12788) 2025-11-06 17:26:08 -08:00
Gaurav Verma
34ba10efd6 [AMD] Update wave-lang to 3.8.2 (#12576)
Signed-off-by: xintin <gaurav.verma@amd.com>
2025-11-06 15:51:44 -08:00
Rain Jiang
a119363f08 ignore the deepgemm check when the model weight with nvfp4 and moe ba… (#12782) 2025-11-06 15:27:28 -08:00
alisonshao
fb314d7bb1 Add bot-bump-kernel-version-to-sglang workflow (#12794) 2025-11-06 14:27:40 -08:00
Nicolas Castet
3a64844a1c Fix hang in deepgemm compilation with symmetric memory enabled (#12715) 2025-11-06 14:06:22 -08:00
Yineng Zhang
585c417fc0 chore: update CODEOWNERS (#12795) 2025-11-06 13:11:28 -08:00
Lee Nau
b0d1c21d03 [fix] Only enable flashinfer all reduce fusion by default for single-node servers (#12724) 2025-11-06 11:53:58 -08:00
R0CKSTAR
b07c5e4080 Pin uvloop to 0.21.0 (#12279)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
2025-11-07 03:33:31 +08:00
Rahul Chalamala
1772671be5 [docs] Remove redundant --disable-radix-cache option from (#12717) 2025-11-07 03:25:49 +08:00
jianan-gu
6e6009fb6b [CPU] Fix TP padding case with weight block size (#8243) 2025-11-07 03:24:48 +08:00
Jimmy
88a2a34041 [Fix]HTTP Stream raise exception (#11904) 2025-11-07 03:23:12 +08:00
Teng Ma
78c58621d2 [mem pool] bugfix: wrong position for self.device in Mamba (#12684) 2025-11-07 03:05:42 +08:00
Mattheliu
c3bb348dad [Docs] fix dead links in multiple documentation pages (#12764) 2025-11-06 10:49:32 -08:00
gaopengff
4e234b4cf9 [Intel XPU]Update pytorch xpu to 2.9 (#12363) 2025-11-06 10:34:23 -08:00
gaopengff
4cc725ac1c [Intel]Add 'intel_xpu' attention backend for llama4 (#11051) 2025-11-06 10:33:41 -08:00
Chang Su
2cb42dc184 [router][grpc] Add more mcp test cases to responses api (#12749) 2025-11-06 10:20:00 -08:00
sglang-bot
0c006b8809 chore: bump SGLang version to 0.5.5 (#12739) 2025-11-07 00:46:19 +08:00
Ke Bao
cd135bfe30 Update dsv3 quantization auto setting for sm100 (#12778) 2025-11-06 22:39:13 +08:00
Xiaoyu Zhang
fc84b0730c [Refactor] Refactor fused_moe_triton tuning tools: extract shared utils, add EP/MLLM support, reduce overhead (#12440)
Co-authored-by: xu-yfei <xu-yfei@users.noreply.github.com>
Co-authored-by: Yongfei Xu <xuyongfei.xyf@antgroup.com>
2025-11-06 20:54:42 +08:00
Keyang Ru
8be0e1bc9c fix ci (#12760) 2025-11-06 00:21:11 -08:00
Amit Prakash
8e1d6756d5 docs: document video-capable multimodal models (#12565) 2025-11-06 00:06:19 -08:00