Commit Graph
8020 Commits
Author SHA1 Message Date
Simo Lin 5ee777c98f [router] add ipv6 support across all components (#11219) 2025-10-06 08:16:59 -07:00
sglang-bot a4a3d82393 chore: bump SGLang version to 0.5.3 (#11263) 2025-10-06 20:07:02 +08:00
sglang-botandsglang-bot 0b13cbb7c9 chore: bump SGLang version to 0.5.3rc2 (#11259)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
2025-10-06 01:12:10 -07:00
+2 efbc687c28 Support DeepSeek V3.2 Exp (#11061)
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-06 00:24:15 -07:00
Baizhou Zhang 292a867ad9 Add flashmla and fast hadamard transform to Dockerfile (#11235) 2025-10-05 21:31:28 -07:00
Kangyan-Zhou 8fd41eae93 Improve bot release workflow (#11240) 2025-10-05 21:28:27 -07:00
Xinyuan Tong 0cd1996eae feat: add shortcut detection for multimodal templates in Jinja format (#11209) 2025-10-06 04:13:17 +00:00
Lianmin Zheng b6b4b56395 Update condition for sgl-kernel-benchmark-test (#11254) 2025-10-05 20:55:02 -07:00
Lianmin Zheng f8924ad74b update sgl kernel version to 0.3.14.post1 (#11242) 2025-10-05 20:30:40 -07:00
fzyzcjy 2f80bd9f0e Bump torch_memory_saver 0.0.9rc2 (#11252) 2025-10-05 20:26:20 -07:00
Lianmin Zheng 366a603e95 Use cu128 for torch audio to fix some CI tests (#11251) 2025-10-05 19:52:32 -07:00
Bowen BaoandHaiShaw baee08601b [quantization] Enable aiter mxfp4 fused_moe for Quark (#10048)
Co-authored-by: HaiShaw <hixiao@gmail.com>
2025-10-05 19:51:34 -07:00
Bowen BaoandHAI c7a104c12b [quantization] Fix scale remapping for mllama4 (#10042)
Co-authored-by: HAI <hixiao@gmail.com>
2025-10-05 19:51:15 -07:00
Mick 97d966a7f8 ci: make find_local_hf_snapshot_dir more robust (#11248) 2025-10-05 19:50:11 -07:00
sglang-bot 8e66d87f0a Fix spec_utils.py (#11247) 2025-10-05 19:01:11 -07:00
Kangyan-Zhou a20fc7b7dc Create two new GH workflows to automatically bump SGLang and Kernel version (#10996) 2025-10-05 18:14:05 -07:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>jzhou-xai
6b30e097ab [Auto Sync] Update io_struct.py (20251004) (#11206)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: jzhou-xai <jzhou@x.ai>
2025-10-05 18:06:07 -07:00
Lianmin Zheng d645ae90a3 Rename runner labels (#11228) 2025-10-05 18:05:41 -07:00
Cheng Wan 41763ba079 Remove gdrcopy check in ci_install_deepep.sh (#11237) 2025-10-05 17:35:22 -07:00
Xinyuan Tongandyhyang201 652c24a653 Update transformers package version to 4.57.0 (#11222)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
2025-10-05 23:45:14 +00:00
sunxxunsandroot 5e142484e2 [Fix AMD CI] VRAM cleanup (#11174)
Co-authored-by: root <root@smci350-zts-gtu-e17-15.zts-gtu.dcgpu>
2025-10-05 19:03:53 -04:00
Shangming Cai c560410da7 Refactor and optimize mooncake CI (#11162)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-05 14:08:52 -07:00
Yuan Luoandluoyuan.luo 590f2da052 [Feat] Support Torch Symm Mem AllReduce (#10571)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2025-10-05 13:55:19 -07:00
Lianmin Zheng 148d8d485d Update DeepGEMM repository tag to specific commit (#11229) 2025-10-05 13:47:36 -07:00
PGFLMG 1a599509cc chore: bump sgl-kernel v0.3.14.post1 (#11137) 2025-10-05 13:46:43 -07:00
Vincent Zhong 36a6b8dbfc Update v1/responses to be more OpenAI-compatible. (#9624) 2025-10-05 18:47:46 +00:00
DarkSharpnessandBaizhou Zhang e0b2d3eebe [Feature] Add a fast-topk to sgl-kernel for DeepSeek v3.2 (#11194)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-05 10:19:03 -07:00
Liangsheng Yin 4cb5a5235e Tiny skip_sample adjust (#11225) 2025-10-05 23:41:04 +08:00
Xu Wenqing 85c1f79377 Add DeepSeek-V3.2 Tool Call Template (#11063)
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
2025-10-04 18:53:49 -07:00
yhyang201 48e9e71930 Add --max-new-tokens CLI flag for MMMU evaluation (#11217) 2025-10-04 17:35:53 -07:00
Ke Bao 31b49c0b51 EAGLE cache fix for HiCache (#11215) 2025-10-04 16:53:53 -07:00
Simo Lin d736e0b65e [router] add grpc router pd mode for chat and generate (#11140) 2025-10-04 06:58:28 -07:00
Simo Lin ffd03a9bd3 [router] fix get load response parsing (#11213) 2025-10-04 06:58:02 -07:00
Hank Han 666da3d59f [fix]enable flashmla when using draft model P/D attention select (#11012) 2025-10-04 20:59:34 +08:00
Alex Chi Z d01b921482 fix sampling_seed handling when deterministic is enabled (#11096)
Signed-off-by: Alex Chi <iskyzh@gmail.com>
2025-10-03 20:41:46 -07:00
c70e58e837 [HICache]: Refactor HiCache CI (#11011)
Co-authored-by: pansicheng <sicheng.pan.chn@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
2025-10-03 20:51:56 -04:00
narutolhy c61b9a1d01 fix self.enable_kv_cache_events (#11178) 2025-10-03 14:09:41 -07:00
Hank Han 3c3d6255d9 [fix]missing prefix_lens_cpu init when p/d disaggregation (#11196) 2025-10-03 13:39:59 -07:00
XSongQ 546914fa2d [Fix] Fix the bug of the calculation of base_gpu_id (dp offset) in data_parallel_controller.py (#10741) 2025-10-03 13:25:57 -07:00
Liangsheng Yin 4726c9197f [minor] fix the lint (#11198) 2025-10-04 01:04:58 +08:00
jiapingW a0010bf4e8 fix qwen2 eagle3 runtime error (#10517) 2025-10-04 00:19:52 +08:00
DiweiSun 307fc060e8 fix xeon ci check (#10838) 2025-10-04 00:17:36 +08:00
vikram singh shekhawatandsvc_repro_tool 586e81a28a [Test] Initialize mem_fraction_static in setUpClass to fix pytest VLM test crashes. (#10859)
Co-authored-by: svc_repro_tool <svc_repro_tool@habana.ai>
2025-10-04 00:14:48 +08:00
Praneth Paruchuri fad7ca73f8 model: support starcoder2 (#10609) 2025-10-04 00:11:19 +08:00
pansicheng 08af8ffb5c fix 3fs indices (#10855) 2025-10-04 00:06:38 +08:00
Shangming Cai 2c7f4ca2f2 Optimize debug log position of PD abort request (#11090)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2025-10-03 23:07:02 +08:00
shubham singhal 03def5e3b1 Fix [test]: Env:SGLANG_TORCH_PROFILER_DIR for pytest. (#10780) 2025-10-03 22:59:32 +08:00
ur4t 6ae3f05b33 Fix CUDA illegal memory access issues in speculative decoding (#10892) 2025-10-03 22:44:07 +08:00
fzyzcjy fdc4e1e570 Tiny move files to utils folder (#11166) 2025-10-03 22:40:06 +08:00
Liangsheng Yin 04b86b3c5c [hot-fix] Fix CI break which caused by adding thinking_mode in eval (#11192) 2025-10-03 18:29:27 +08:00