Commit Graph
6846 Commits
Author SHA1 Message Date
Yuwei An eae59b337e Piecewise Cuda Graph Support for gpt-oss model (#13045)
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
2025-11-15 09:28:00 +08:00
Xinyue Zhang 14dc052382 [router]Replace requests lib with openai in e2e_response_api (#13293) 2025-11-14 16:56:40 -08:00
Kangyan-Zhou b223669136 Remove nightly b200 tests and revert a change for test file (#13305) 2025-11-14 16:30:22 -08:00
alisonshao dcc47a56c9 Implement nightly test workflow naming conventions (#13170) 2025-11-14 16:14:53 -08:00
Johnsonms 6448b4cd2c Fix NSA indexer nightly test failed issues (#13298) 2025-11-14 13:14:57 -08:00
Kaixi HouandBaizhou Zhang 5ae0ac4244 [NVIDIA] Fix use case of SGLANG_ENABLE_FLASHINFER_GEMM (#13274)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-11-14 12:51:11 -08:00
Lianmin ZhengandStefan He 22f641ab4f [minor] remove debug code in python/sglang/srt/compilation/weak_ref_tensor_jit.py (#13235)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-14 12:22:24 -08:00
Stefan He 0997c78d2c Support FP8 Per Token Quant Piecewise (#13272) 2025-11-14 11:40:12 -08:00
Zesen SenmiaoORZ fd3be107bb [Doc] Add item for repetition punishment (#13260) 2025-11-14 11:15:56 -08:00
Praneth Paruchuri 665f43bdd8 model: support teleflm (#10573) 2025-11-15 03:14:49 +08:00
Praneth Paruchuri a53f2d6c12 Support orion (#10665) 2025-11-15 03:08:32 +08:00
hlu1 a7002e614b [Deepseek V3.2] Clean up MTP (#13236) 2025-11-14 11:01:37 -08:00
Kshiteej K 84e151ac7f LLama4 Attention: Update assertion msg (#12777) 2025-11-15 02:52:50 +08:00
Yingchun Lai 875a25ddef refactor: remove duplicate function _get_bootstrap_info_from_server (#13277) 2025-11-15 02:48:17 +08:00
Vitaly Tuzov fc55b45e5f Optimized prefill cache allocation for NPU (#13288) 2025-11-15 02:40:17 +08:00
Ling Zhang 0050ff254f [BugFix] fix bench_serving error when multimodal image is testing (#13254) 2025-11-14 22:46:19 +08:00
fzyzcjy af9f71f9c5 Add script to create a model with fewer layers for debugging (#13284) 2025-11-14 22:13:27 +08:00
fzyzcjy 15264232ee Super tiny fix CI (#13283) 2025-11-14 21:45:10 +08:00
Yineng Zhang f8d3d80f63 chore: bump flashinfer v0.5.2 (#13242) 2025-11-14 02:47:09 -08:00
wangyxbh 5027739f2c [CPU] Use covt_e4m3_bf16 to optim BF16 to FP8 convert (#12191) 2025-11-14 17:36:51 +08:00
fzyzcjy 3701f34dab Tiny add utility to parse server logs (#12605) 2025-11-14 17:34:22 +08:00
fzyzcjy 821fb060c3 Enhance dumper comparator with tensor unifier and location finder (#12623) 2025-11-14 17:34:08 +08:00
fzyzcjy ace27c0c01 Tiny enhance dumper with ctx and enable flags (#12622) 2025-11-14 17:33:49 +08:00
fzyzcjy ed1d18d472 Tiny fix update version logic location (#12620) 2025-11-14 17:33:36 +08:00
Morpheus Guoandyuechguo e7b57b0d04 [BugFix] weight load bug when checkpoint expert.gate and exepert.up_proj are not fused (#13113)
Co-authored-by: yuechguo <yuechguo@amd.com>
2025-11-14 00:35:44 -08:00
Kangyan-Zhou 49141df94a Extend lint test to test/ directory (#13247) 2025-11-14 00:01:48 -08:00
b8zhong 7b79cc4fe2 ci: speed up b200 ci (#13237) 2025-11-13 23:57:33 -08:00
Simo Lin 385ff0e56f [model-gateway] change mg labeler from router to model-gateway (#13265) 2025-11-13 23:29:09 -08:00
Muqi Li fc5da1e80b [Tool Call] Steamline function arguments when tool_choice="auto" for deepseekv31_detector (#11589) 2025-11-13 23:06:02 -08:00
Kangyan-Zhou 04848ba7cb Add 3 models to 2 gpu runner in model downloading from nightly tests (#13261) 2025-11-13 22:59:18 -08:00
Kangyan-Zhou 9bc6a9adbe Update model weight validation logic to handle special weight file naming (#13256) 2025-11-13 22:07:49 -08:00
Binyao Jiang 7cdaedb8fb Remove glm41v from CI to speed up CI (#13257) 2025-11-13 21:14:04 -08:00
fzyzcjy 1f134f850a fix outdated router doc (#13255) 2025-11-14 14:00:42 +09:00
alisonshao 5f72d36d40 Fix nightly tests to fail properly when any job fails (#13096) 2025-11-13 19:10:35 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>Stefan He
7a2254b260 [Auto Sync] Update backend.py, forward_batch_info.py, piece... (20251113) (#13221)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
2025-11-13 18:54:11 -08:00
Kshiteej K b5904999c0 docker: Fix apt-add-repository (#13213) 2025-11-13 18:41:29 -08:00
Mick 922525ee6d fix: fix serve command without diffusion dependency (#13246) 2025-11-14 10:24:18 +08:00
billishyahao ee3e337c62 [feat] make warmup timeout configurable through SGLANG_WARMUP_TIMEOUT (#13243) 2025-11-14 10:14:37 +08:00
b8zhong e523e2167a remove deprecated tile_tokens_dim (#13186) 2025-11-13 17:09:27 -08:00
Hubert Lu 2ce2377740 [AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239) 2025-11-13 17:03:41 -08:00
Lianmin Zhenggithub-actions[bot] <github-actions[bot]@users.noreply.github.com>gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
19f6a33ce9 [Auto Sync] Update pynccl_wrapper.py, environ.py, registry.... (20251111) (#13097)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2025-11-13 15:58:47 -08:00
Fan Yin e9c0c55833 [sgl-kernel] clean up fa fetch in CMakeLists.txt (#12392) 2025-11-13 15:42:09 -08:00
Binyao Jiang 9b41f31a66 Use 32x32 black image for VLM server warmup and bring glm4.1v back to UT (#13222) 2025-11-13 14:21:43 -08:00
Binyao Jiang 9db3add319 Update GDN causal conv1d cuda kernel - prepare for new changes (#13188) 2025-11-13 14:09:47 -08:00
Chang Su c9e5799bd1 [router][grpc] Refine docs in minimax_m2 to match other parsers (#13218) 2025-11-14 06:47:24 +09:00
Fan Yin 2966367a31 [sgl-kernel] support custom fp8 flashmla kernel (#13087) 2025-11-13 12:45:21 -08:00
dtc 8779100768 Fix wrong running_bs in priority scheduling (#13142)
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
2025-11-14 03:56:38 +08:00
ykcombat dd192a55f4 [Feature] Enable CUDA graph for PD-Multiplexing. (#11595) 2025-11-14 03:39:40 +08:00
Taishi Nakamura bfe638f7e8 Fix broken Markdown formatting in DeepEP documentation (#13210) 2025-11-13 11:34:57 -08:00
huangtingwei 4ac65e3c7d [PD / HiCache]fix deocde kvcache offload manager memory leak (#12774) 2025-11-14 03:31:53 +08:00