b8zhong
|
7b79cc4fe2
|
ci: speed up b200 ci (#13237)
|
2025-11-13 23:57:33 -08:00 |
|
Simo Lin
|
385ff0e56f
|
[model-gateway] change mg labeler from router to model-gateway (#13265)
|
2025-11-13 23:29:09 -08:00 |
|
Muqi Li
|
fc5da1e80b
|
[Tool Call] Steamline function arguments when tool_choice="auto" for deepseekv31_detector (#11589)
|
2025-11-13 23:06:02 -08:00 |
|
Kangyan-Zhou
|
04848ba7cb
|
Add 3 models to 2 gpu runner in model downloading from nightly tests (#13261)
|
2025-11-13 22:59:18 -08:00 |
|
Kangyan-Zhou
|
9bc6a9adbe
|
Update model weight validation logic to handle special weight file naming (#13256)
|
2025-11-13 22:07:49 -08:00 |
|
Binyao Jiang
|
7cdaedb8fb
|
Remove glm41v from CI to speed up CI (#13257)
|
2025-11-13 21:14:04 -08:00 |
|
fzyzcjy
|
1f134f850a
|
fix outdated router doc (#13255)
|
2025-11-14 14:00:42 +09:00 |
|
alisonshao
|
5f72d36d40
|
Fix nightly tests to fail properly when any job fails (#13096)
|
2025-11-13 19:10:35 -08:00 |
|
Lianmin Zheng
|
7a2254b260
|
[Auto Sync] Update backend.py, forward_batch_info.py, piece... (20251113) (#13221)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-11-13 18:54:11 -08:00 |
|
Kshiteej K
|
b5904999c0
|
docker: Fix apt-add-repository (#13213)
|
2025-11-13 18:41:29 -08:00 |
|
Mick
|
922525ee6d
|
fix: fix serve command without diffusion dependency (#13246)
|
2025-11-14 10:24:18 +08:00 |
|
billishyahao
|
ee3e337c62
|
[feat] make warmup timeout configurable through SGLANG_WARMUP_TIMEOUT (#13243)
|
2025-11-14 10:14:37 +08:00 |
|
b8zhong
|
e523e2167a
|
remove deprecated tile_tokens_dim (#13186)
|
2025-11-13 17:09:27 -08:00 |
|
Hubert Lu
|
2ce2377740
|
[AMD] Fix AITER_MXFP4_MOE_SF setting for gfx950 (#13239)
|
2025-11-13 17:03:41 -08:00 |
|
Lianmin Zheng
|
19f6a33ce9
|
[Auto Sync] Update pynccl_wrapper.py, environ.py, registry.... (20251111) (#13097)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-11-13 15:58:47 -08:00 |
|
Fan Yin
|
e9c0c55833
|
[sgl-kernel] clean up fa fetch in CMakeLists.txt (#12392)
|
2025-11-13 15:42:09 -08:00 |
|
Binyao Jiang
|
9b41f31a66
|
Use 32x32 black image for VLM server warmup and bring glm4.1v back to UT (#13222)
|
2025-11-13 14:21:43 -08:00 |
|
Binyao Jiang
|
9db3add319
|
Update GDN causal conv1d cuda kernel - prepare for new changes (#13188)
|
2025-11-13 14:09:47 -08:00 |
|
Chang Su
|
c9e5799bd1
|
[router][grpc] Refine docs in minimax_m2 to match other parsers (#13218)
|
2025-11-14 06:47:24 +09:00 |
|
Fan Yin
|
2966367a31
|
[sgl-kernel] support custom fp8 flashmla kernel (#13087)
|
2025-11-13 12:45:21 -08:00 |
|
dtc
|
8779100768
|
Fix wrong running_bs in priority scheduling (#13142)
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
|
2025-11-14 03:56:38 +08:00 |
|
ykcombat
|
dd192a55f4
|
[Feature] Enable CUDA graph for PD-Multiplexing. (#11595)
|
2025-11-14 03:39:40 +08:00 |
|
Taishi Nakamura
|
bfe638f7e8
|
Fix broken Markdown formatting in DeepEP documentation (#13210)
|
2025-11-13 11:34:57 -08:00 |
|
huangtingwei
|
4ac65e3c7d
|
[PD / HiCache]fix deocde kvcache offload manager memory leak (#12774)
|
2025-11-14 03:31:53 +08:00 |
|
Junlin Zhou
|
0779c3d148
|
docs: update fused MoE config path (#13211)
|
2025-11-13 11:14:01 -08:00 |
|
Kangyan-Zhou
|
5c2d72ba63
|
Bump actions/download-artifact from v4 to v6 for B200 workers (#13220)
|
2025-11-13 10:23:58 -08:00 |
|
alisonshao
|
9bd511a582
|
Add model validation for all GPU runners to prevent cache corruption (#13171)
Co-authored-by: Kangyan Zhou <zky314343421@gmail.com>
|
2025-11-13 10:16:41 -08:00 |
|
Liangsheng Yin
|
85b8c5c4cd
|
Set max parallel for 1-gpu runner (#13215)
|
2025-11-14 01:36:43 +08:00 |
|
neo
|
c8b7516fe8
|
Fix accept rate in speculative decoding metrics (#13212)
|
2025-11-14 00:54:50 +08:00 |
|
Bowen Bao
|
67e9d287ee
|
[Quantization] Support Quark Dense + MoE FP8 & FP8 PTPC (#10485)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
|
2025-11-13 08:16:00 -08:00 |
|
Sam
|
e7e89349c9
|
Enable Flashinfer TRTLLM-GEN-MoE FP8 blockwise kernel for Qwen3-Next on Blackwell (#12543)
|
2025-11-13 19:44:44 +08:00 |
|
Ling Zhang
|
aead0ef5e5
|
[FEAT][ROCM] enable fused shared expert for Rocm (#12201)
Co-authored-by: ZLkanyo009 <4071250045@qq.com>
Co-authored-by: HAI <hixiao@gmail.com>
|
2025-11-13 00:41:40 -08:00 |
|
Shu Wang
|
6664083522
|
Replace [silu_and_mul_]scaled_fp4_group_quant by Flashinfer equivalent (#12376)
|
2025-11-13 00:26:00 -08:00 |
|
Edmund Suen
|
c2d69e8b56
|
fix: display served_model_name in /v1/models (#13155)
|
2025-11-13 17:07:55 +09:00 |
|
Simo Lin
|
4c1e909a80
|
[router] minmax-m2 xml tool parser (#13148)
|
2025-11-12 23:24:54 -08:00 |
|
Kangyan-Zhou
|
2bb0317e19
|
Remove enable_dp_attention in deepseek nightly tests (#13190)
|
2025-11-12 22:58:57 -08:00 |
|
fzyzcjy
|
86255f27b4
|
Revert "fallback to triton mm_persistent kernel when deepGemm fail" (#13178)
|
2025-11-12 22:03:35 -08:00 |
|
Hubert Lu
|
e4b2937017
|
[AMD] Add AITER Custom All-Reduce (#13102)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
Co-authored-by: HaiShaw <hixiao@gmail.com>
|
2025-11-12 21:53:44 -08:00 |
|
Mayyyy
|
7a8524b444
|
[Ascend] add npu synchronize (#13154)
Co-authored-by: may_feimei <meifei5@huawei.com>
|
2025-11-13 11:03:32 +08:00 |
|
Edmund Suen
|
909d0d382f
|
docker: fix build error in Dockerfile.diffusion (#12975)
|
2025-11-13 09:58:16 +08:00 |
|
Tejesh Anand
|
e42df37df0
|
Remove EBNF Composer (#13163)
|
2025-11-12 17:55:30 -08:00 |
|
Simo Lin
|
6d21392b0e
|
[router] remove worker url requirement (#13172)
|
2025-11-12 17:32:58 -08:00 |
|
Xiaoyu Zhang
|
a1cb717d0b
|
Opt kimi_k2_thinking biased topk module (#13150)
|
2025-11-12 16:52:06 -08:00 |
|
Scott Lee
|
c94564912e
|
Add RequestMetricsExporter utility to export request-level metrics (#10973)
|
2025-11-12 16:33:37 -08:00 |
|
Vladimir Serov
|
c4b74c1db2
|
[Ascend] LoRA: adding Ascend LoRA backend with using kernels from sgl_kernel_npu (#12288)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: ssshinigami <44640852+ssshinigami@users.noreply.github.com>
|
2025-11-12 16:20:34 -08:00 |
|
Shu Wang
|
7aa443903d
|
Fix nan in global scaling factor for large scale nvfp4 EP (#13162)
|
2025-11-12 15:32:23 -08:00 |
|
bingps
|
4eda9969e8
|
[DeepseekV32]: use _concat_mla_absorb_q_general to replace torch.cat (#12215)
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
|
2025-11-12 15:20:01 -08:00 |
|
Douglas Yang
|
03a7e6f4db
|
Add job and runner failure monitor workflow for CI (#13104)
|
2025-11-12 14:04:50 -08:00 |
|
Xinyue Zhang
|
2cdde3d46d
|
[router] Fix Flaky test_circuit_breaker_opens_and_recovers (#13164)
|
2025-11-12 12:07:42 -08:00 |
|
Keyang Ru
|
401ed0c594
|
[router] Add comprehensive validation to Responses API (#13127)
|
2025-11-12 11:19:27 -08:00 |
|