 Ke Bao
|
3aa11ca722
|
Remove hybrid_kvcache_ratio in server args (#16399)
|
2026-01-06 13:13:13 +08:00 |
|
|
Ke Bao
|
b328cd20bb
|
Skip local attn init metadata for mimo swa model (#16349)
|
2026-01-04 22:38:36 +08:00 |
|
|
roikoren755
|
b021332339
|
[NemotronH] Add latent MoE support (#16227)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2026-01-02 22:08:58 +08:00 |
|
|
Ke Bao
|
7b7e357f61
|
Separate swa and local attention chunk cache eviction (#15820)
|
2025-12-26 09:34:22 +08:00 |
|
|
Yuxuan Zhang
|
f3ba711662
|
fix: change class name of GLM-ASR (#15772)
|
2025-12-26 00:15:16 +08:00 |
|
|
Teng MaandXuchun Shang
|
d7301c89ba
|
[Feature] support fastsafetensors (#15091)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-23 22:33:56 +08:00 |
|
|
Yuxuan ZhangandXinyuan Tong
|
82f1d6157f
|
[GLM-ASR] GLM-ASR Support (#15570)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-22 17:37:55 -08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
3c882db3ad
|
Adjust wrong mtp meaning introduce by mimo (#15632)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-23 02:06:46 +08:00 |
|
|
Jackie
|
5045aa34d3
|
Add MiDasheng Model Support (#15219)
|
2025-12-19 21:41:59 +08:00 |
|
|
+6
|
160a06cab2
|
[Feature] Xiaomi MiMo-V2-Flash day0 support (#15207)
Co-authored-by: 谢学扬 <xiexueyang@xiaomi.com>
Co-authored-by: tz <tangzhen3@xiaomi.com>
Co-authored-by: 李家乐 <lijiale10@xiaomi.com>
Co-authored-by: 张晨 <zhangchen50@xiaomi.com>
Co-authored-by: Shaohui Liu <liushaohui3@xiaomi.com>
Co-authored-by: 王晨 <wangchen77@xiaomi.com>
Co-authored-by: jiangzihan <jiangzihan@xiaomi.com>
Co-authored-by: xiexueyang <xyxie_wangyi@163.com>
Co-authored-by: Linghao Zhang <zhanglinghao@xiaomi.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
Co-authored-by: JoyFuture <35593546+JoyFuture@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
Co-authored-by: root <root@bj9-ml-g8h20e-k8s-slave106-20251106.alicn.idc.xiaomi.com>
|
2025-12-19 11:40:07 +08:00 |
|
|
Baizhou Zhang
|
2b0ddf89f5
|
[Tiny]Add warning for deepgemm on Blackwell (#15352)
|
2025-12-18 13:45:26 -08:00 |
|
|
Liangsheng Yin
|
0c00220795
|
tiny unify environ usage (#15335)
|
2025-12-17 23:31:43 +08:00 |
|
|
amysaq2023
|
ccc8f3b266
|
support non disturbing remote instance weight loader v2 (#14997)
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
|
2025-12-16 14:39:56 -08:00 |
|
|
Liwansi
|
30da2f0598
|
[NPU][eagle3] support qwen eagle3 on NPU (#14820)
|
2025-12-16 02:25:13 +08:00 |
|
|
|
9acb21ae27
|
feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2025-12-14 22:30:08 +08:00 |
|
|
Yuhao Yang
|
a81cc1b8b3
|
add transformers version validation for glm-4.6v moe models (#14998)
|
2025-12-13 10:54:08 -08:00 |
|
|
Yineng Zhangandfzyzcjy
|
4b7b5af36a
|
Revert several PRs (#14958)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2025-12-12 11:25:12 -08:00 |
|
|
amysaq2023
|
70758d457e
|
support non-disturbing remote-instance-weight-loader (#13125)
Signed-off-by: Anqi Shen <amy.saq@antgroup.com>
|
2025-12-11 16:45:32 -08:00 |
|
|
Yinghai Lu
|
b05b346a13
|
[loader] enable private loader (#14620)
|
2025-12-11 11:49:46 -08:00 |
|
|
Yuhao Yang
|
c1bd5ee8c5
|
Revert transformers to 4.57.1 (#14801)
|
2025-12-10 11:04:36 -08:00 |
|
|
yrk111222
|
6c9c8da64d
|
fix: add missing logic for SGLANG_USE_MODELSCOPE variable (#14794)
|
2025-12-10 15:49:34 +08:00 |
|
|
|
21028b5507
|
[RL] support weight reload for low-bit rollout (#9650)
Co-authored-by: Hecate0821 <hec4te0821@gmail.com>
Co-authored-by: eternally-z <zzywzj@gmail.com>
Co-authored-by: Wilboludriver <wilbolu@outlook.com>
Co-authored-by: Wilbolu <81792854+Wilboludriver@users.noreply.github.com>
Co-authored-by: Ke Bao <ispobaoke@gmail.com>
|
2025-12-10 15:44:01 +08:00 |
|
|
Yuhao Yang
|
15bc8cbd74
|
fix rope parameter initialization error caused by transformers v5.0 update (#14745)
|
2025-12-09 10:51:26 -08:00 |
|
|
yudian0504andluoyuan.luo
|
9496f12d00
|
[Model] Add PaddleOCR-VL Model Support (#12953)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-09 10:16:02 -08:00 |
|
|
yrk111222
|
98c430e114
|
fix: prevent HugginqFace access when SGLANG_USE_MODELSCOPE is enabled (#12039)
|
2025-12-09 21:02:05 +08:00 |
|
|
Alison Shao
|
08da4c2618
|
[Bugfix] Fix KeyError for Mistral-Large-3 rope_scaling config (#14627)
|
2025-12-08 19:16:00 -08:00 |
|
|
|
cf0478d602
|
[Glm46v] Bug fix for accuracy drop and unable to launch server (#14585)
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Minglei Zhu <mingleizhu1122@gmail.com>
|
2025-12-07 23:45:02 -08:00 |
|
|
elvischenvandLinda-Stadter
|
205f041e96
|
Add Mistral Large 3 Eagle Support (#14466)
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-05 23:11:41 +08:00 |
|
|
Xinyuan TongandYueming Yuan
|
6d37e70883
|
ministral3 (#14251)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
|
2025-12-04 14:31:26 -08:00 |
|
|
|
8428078436
|
Add Mistral Large 3 support. (#14213)
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-04 20:00:05 +08:00 |
|
|
|
64092c8b55
|
[Auto Sync] Rename is_hybrid to is_hybrid_swa (#14252)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
Co-authored-by: Hanming Lu <hanming@x.ai>
|
2025-12-01 23:24:24 -08:00 |
|
|
Netanel Haber
|
082b54c689
|
Support nvidia/NVIDIA-Nemotron-Nano-12B-v2-VL-BF16 (and nvidia/C-RADIOv2-H) (#12277)
|
2025-11-26 16:28:52 -07:00 |
|
|
roikoren755
|
1b48e1b974
|
Feat/nemotron nano v3 support (#12690)
|
2025-11-21 13:53:05 -08:00 |
|
|
|
48ca9f7518
|
feat: support external custom models (#13429)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-11-20 11:16:58 +08:00 |
|
|
Chen Haozhe
|
6c2e5fcd91
|
[feat][Ascend][Mindspore]: support model-impl of mindspore (#9234)
|
2025-11-19 09:17:47 +08:00 |
|
|
Zijian Zhang
|
aa8ecbda7a
|
model: support JetVLM (#13289)
|
2025-11-18 12:02:03 +08:00 |
|
|
Yi Zhang
|
a3e4fe4b41
|
refactor linear memory pool (#13004)
|
2025-11-17 16:24:29 +08:00 |
|
|
|
67e9d287ee
|
[Quantization] Support Quark Dense + MoE FP8 & FP8 PTPC (#10485)
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: kk <43161300+kkHuang-amd@users.noreply.github.com>
|
2025-11-13 08:16:00 -08:00 |
|
|
Mick
|
95876d75cb
|
chore: include a minimum image for vlms when warming-up (#9528)
|
2025-11-10 14:56:59 +08:00 |
|
|
Zijian Zhang
|
3633f8b0cf
|
Add Jet-Nemotron (#12448)
|
2025-11-09 01:32:47 -08:00 |
|
|
jianan-gu
|
6e6009fb6b
|
[CPU] Fix TP padding case with weight block size (#8243)
|
2025-11-07 03:24:48 +08:00 |
|
|
Lianmin Zheng
|
c7d57d5bb3
|
Fix CI and style (#12658)
|
2025-11-05 15:08:15 -08:00 |
|
|
|
f600866a44
|
Improve the metrics for PD (#12580)
Co-authored-by: Kan Wu <wukanustc@gmail.com>
Co-authored-by: cctry <shiyang@x.ai>
|
2025-11-03 22:10:57 -08:00 |
|
|
Lianmin Zheng
|
20315697f4
|
move all get_stream in sgl_kernel to c++ to reduce the launch overhead (#12521)
|
2025-11-02 13:15:05 -08:00 |
|
|
Ke Baoandyizhang2077
|
a4bf5c6ad2
|
Support Kimi Linear (#12469)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-10-31 14:03:35 -07:00 |
|
|
Ke Bao
|
0095e01874
|
Fix lint in deepseek-ocr (#12470)
|
2025-11-01 00:08:19 +08:00 |
|
|
Xinyuan Tongandxinyuant
|
684864814b
|
Feat: deepseek-ocr logits processor (#12415)
Co-authored-by: xinyuant <xinyuant@usc.edu>
|
2025-10-31 23:35:22 +08:00 |
|
|
bppps
|
2f766f381d
|
[Bugfix]: distinguish processors for deepseek_vl2 and deepseek_ocr to p… (#12384)
|
2025-10-30 21:51:30 -07:00 |
|
|
Liana Koleva
|
e03b6beeb1
|
doc: improve modelopt error description (#12269)
|
2025-10-28 20:57:55 -07:00 |
|
|
b8zhong
|
77225d602a
|
Use Flashinfer TRT-LLM as Llama 4 compatible MoE backend (#11928)
|
2025-10-28 10:39:43 -07:00 |
|