|
d754ce973e
|
[Piecewise Cuda Graph] rename, refactor and add more logging (#13675)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-11-21 13:28:38 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
475962a139
|
[VLM] Support Piecewise CUDA Graph for InternVL (#13640)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-11-21 13:21:51 +08:00 |
|
|
Xiaoyu Zhang
|
bfcf15a129
|
[opt kimi k2 4 / n] Delete useless pad kernel in sgl_moe_align_block_size (#13587)
|
2025-11-21 13:16:42 +08:00 |
|
|
|
fb04d43428
|
[kimi k2 thinking] Avoid useless torch.zeros_ (#13596)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-11-21 13:15:27 +08:00 |
|
|
Mike QiuandMike_Qiu
|
6be65ae462
|
Fix target MLA with eagle3 support for PD disaggregation (#13555)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
|
2025-11-21 12:16:05 +08:00 |
|
|
Glen Liu
|
750084ae08
|
remove unnecessary starvation check (#13619)
|
2025-11-20 19:10:51 -08:00 |
|
|
fzyzcjy
|
3f1cfd87b6
|
Super tiny remove unused MiniMaxM2MLP class (#13659)
|
2025-11-21 07:35:12 +08:00 |
|
|
|
b5344b31b8
|
[Piecewise CUDA Graph] Fix recompile issue for Mixtral and Grok2 (#13667)
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
Co-authored-by: Ke Bao <ISPObaoke@163.com>
Co-authored-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2025-11-20 14:20:11 -08:00 |
|
|
Glen Liu
|
ada8ce1fd0
|
allow loras to be implicitly evicted and loaded based on max_loaded_loras (#11526)
|
2025-11-20 13:34:32 -08:00 |
|
|
b8zhong
|
42028af614
|
enable csgmv automatically on cuda (#13600)
|
2025-11-20 12:53:02 -08:00 |
|
|
hlu1
|
7291c72e57
|
[Deepseek V3.2] Change indexer weights_proj to fp32 (#13459)
|
2025-11-20 12:24:10 -08:00 |
|
|
Vincent Zhong
|
6bc3062894
|
Fix launch of Olmo3 (#13666)
Signed-off-by: Vincent Zhong <207368749+vincentzed@users.noreply.github.com>
|
2025-11-20 12:04:30 -08:00 |
|
|
YAMY
|
fa92441027
|
[DeepseekV3.2] Deepseek fp8 support for MHA path (#12964)
|
2025-11-20 11:13:36 -08:00 |
|
|
Fan Yin
|
2dec555d36
|
[10/n] decouple quantization impl from vllm dependency - fix import (#13524)
|
2025-11-21 01:45:51 +08:00 |
|
|
Lianmin Zheng
|
a352e833c4
|
CI: Kill zombie diffusion processes in CI & minor code style fix on rotary embedding fallback (#13637)
|
2025-11-20 21:57:01 +08:00 |
|
|
Lianmin Zheng
|
7af9b88c6c
|
Revert "[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel)" (#13644)
|
2025-11-20 02:11:12 -08:00 |
|
|
|
c8ede0e93c
|
[ROCM] Optimized deepseek-r1 fp8 model with + triton_gemm_a8w8 + batch_gemm_a8w8 + fused set_mla_kv_buffer kernel (#13617)
Co-authored-by: root <root@smci355-ccs-aus-m12-17.cs-aus.dcgpu>
Co-authored-by: jacky.cheng <yichiche@amd.com>
|
2025-11-20 00:29:56 -08:00 |
|
|
DarkSharpness
|
b51f9bbee7
|
[Feature] Introduce JIT Kernel in sglang (with hicache JIT kernel) (#13453)
|
2025-11-20 00:03:32 -08:00 |
|
|
Thomas Wangandsogalin
|
7dcf910d53
|
Add support for new aiter version (AR accuracy, is_shuffled PR) (#13554)
Co-authored-by: sogalin <39478626+sogalin@users.noreply.github.com>
|
2025-11-19 22:17:57 -08:00 |
|
|
iLeGend
|
10e0b83a4c
|
Add FP32 dtype support for RoPE - Part2 (#13328)
|
2025-11-19 21:19:53 -08:00 |
|
|
Kaixi Hou
|
c3c4da71fb
|
[NVIDIA] Add fp8 gemm benchmark on blackwell (#13528)
|
2025-11-19 19:35:00 -08:00 |
|
|
|
48ca9f7518
|
feat: support external custom models (#13429)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-20 11:16:58 +08:00 |
|
|
|
af6bcadcf7
|
[VLM] Support Piecewise CUDA Graph for Qwen2.5-VL (#13055)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: Yuhao Yang <yhyang201@gmail.com>
|
2025-11-20 10:23:44 +08:00 |
|
|
Binyao Jiang
|
67fca6b297
|
[GDN] Remove unnecessary conv state clone (#13603)
|
2025-11-19 16:09:12 -08:00 |
|
|
Binyao Jiang
|
f88b2aa6af
|
[GDN] Remove unnecessary contiguous() (#13604)
|
2025-11-19 16:07:49 -08:00 |
|
|
|
17b24aca6e
|
[Auto Sync] Update base_grammar_backend.py, collector.py (20251116) (#13357)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Sehoon Kim <sehoon@x.ai>
|
2025-11-19 16:05:50 -08:00 |
|
|
sglang-bot
|
bfaf0b8607
|
chore: bump sgl-kernel version to 0.3.17.post2 (#13570)
|
2025-11-19 14:02:57 -08:00 |
|
|
Xinyuan Tong
|
a355794905
|
Expend compatibility check for all quantized MoE models (#13465)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-11-20 01:24:27 +08:00 |
|
|
Zilin Zhu
|
e197bef5ce
|
[RL] Allow passing tensors of different dtypes for FlattenedTensorBucket (#13413)
|
2025-11-19 17:24:48 +08:00 |
|
|
ykwd
|
075ba74dd4
|
[Doc] Update HiCache and Mooncake docs & Mooncake Setup Error Checking (#12740)
|
2025-11-19 12:03:27 +08:00 |
|
|
Chen Haozhe
|
6c2e5fcd91
|
[feat][Ascend][Mindspore]: support model-impl of mindspore (#9234)
|
2025-11-19 09:17:47 +08:00 |
|
|
Baizhou Zhang
|
9f59194f29
|
[Fix] Fix DeepSeek V3 MTP on B200 (#13548)
|
2025-11-18 16:30:26 -08:00 |
|
|
b8zhong
|
92ad2ff9ce
|
Flashinfer TRTLLM-GEN-MoE + Qwen3 (#13489)
|
2025-11-18 14:18:29 -08:00 |
|
|
Baidu-AIAK
|
9b64f6f359
|
[fix] Fixes accuracy issues caused by incorrect use of rope (#13495)
|
2025-11-18 14:17:33 -08:00 |
|
|
Glen Liu
|
d79e12941c
|
Small cleanups related to LoRA weight loading (#13474)
|
2025-11-18 09:14:34 -08:00 |
|
|
Junrong Lin
|
518467be64
|
[Feature] Re:Enable hybrid mem saver (#12962)
|
2025-11-18 21:29:15 +08:00 |
|
|
Morpheus Guoandyuechguo
|
7e88b9c128
|
[BugFix] Accuracy and function Issue when run ptpc quant model (#13157)
Co-authored-by: yuechguo <yuechguo@amd.com>
|
2025-11-18 01:54:58 -08:00 |
|
|
Zhiqiang XieandHao Chen
|
cfcf2758aa
|
[HiCache] Critical fix to host memory double free (#13501)
Co-authored-by: Hao Chen <cighao@gmail.com>
|
2025-11-18 01:34:23 -08:00 |
|
|
|
ac81db66c2
|
[VLM][feat] Support encoder DP for Qwen2.5-VL (#13126)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: liusy58 <xiehang.lsy@alibaba-inc.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
|
2025-11-18 16:13:18 +08:00 |
|
|
b8zhong
|
f33860777c
|
[Piecewise CUDA Graph] Support ModelOpt FP8 (#13094)
|
2025-11-18 12:46:24 +08:00 |
|
|
Shangming Cai
|
4c3573e493
|
[PD] Clarify init method docstrings for kvsender and kvreceiver (#13476)
|
2025-11-18 12:20:19 +08:00 |
|
|
|
f1be8aa0f2
|
chore: add an unified server arg for multimodal inputs preprocess config(#12149)
Co-authored-by: bianfeng <bianfeng@pinduoduo.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-11-18 12:18:50 +08:00 |
|
|
Zijian Zhang
|
aa8ecbda7a
|
model: support JetVLM (#13289)
|
2025-11-18 12:02:03 +08:00 |
|
|
Binyao Jiang
|
26ca07469b
|
[GLM4.6v] Relax the constraint of non-user role chat completion message schema for new GLM-v release (#13258)
|
2025-11-18 10:58:17 +08:00 |
|
|
Binyao Jiang
|
90c18a16cb
|
[GLM4.6v] Required changes for bumping up to transformer 5.x (#13229)
|
2025-11-18 10:58:00 +08:00 |
|
|
Minglei Zhu
|
9846f8ed72
|
fix MambaPool clear method after refactoring (#13449)
|
2025-11-18 10:03:45 +08:00 |
|
|
Baizhou Zhang
|
85ae508e8b
|
Add bfloat16 tuned fused moe config for Dpsk-MTP layer on B200 (#13455)
|
2025-11-17 17:44:31 -08:00 |
|
|
pansichengandZhiqiang Xie
|
d879e37f1b
|
Add interface_v1 option for dynamic HiCache backend (#13140)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-11-17 17:42:17 -08:00 |
|
|
|
e389f91dec
|
[NVIDIA] Fix broken fp8 MoE of deepseek v3 (#13264)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-11-17 16:13:28 -08:00 |
|
|
Simo Lin
|
25acbbc612
|
Remove verbs from GET endpoint paths to follow REST standards (#13273)
|
2025-11-17 12:34:36 -08:00 |
|