Yuan Luo
|
7ef5d8afd4
|
Revise POINTSV15Chat model (#12049)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-10-24 17:09:45 +08:00 |
|
Qiaolin Yu
|
71d41212e4
|
Fix dpsk-r1-fp4 launching crash (#12063)
|
2025-10-24 17:04:50 +08:00 |
|
Xinyuan Tong
|
b9fb74f3bc
|
fix: bench_serving ITL calculation when using spec-decoding (#12064)
|
2025-10-24 17:02:44 +08:00 |
|
ybyang
|
e15b63a182
|
[Fix] fix missing ipc_name of __getitem__ in some IO structs (#12053)
Signed-off-by: ybyang <ybyang7@iflytek.com>
|
2025-10-24 16:59:14 +08:00 |
|
Yuxuan Zhang
|
4060ed37cb
|
Refactoring GLM-4.5 and GLM-4.5V related implementations (#11800)
|
2025-10-24 08:22:36 +00:00 |
|
fzyzcjy
|
2342605ef0
|
Tiny cleanup send_single (#12056)
|
2025-10-23 23:53:42 -07:00 |
|
Simo Lin
|
dbf17a8313
|
[router] Add mTLS Support for Router-to-Worker Communication (#12019)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-10-23 23:14:09 -07:00 |
|
fzyzcjy
|
0f0c430e93
|
Install numactl in Dockerfile for GH200/GB200/GB300 (#11853)
|
2025-10-23 21:39:10 -07:00 |
|
Rain Jiang
|
8e797a47f0
|
fix: the hardcode hf repo name comparison for deepseek-ocr (#12031)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-23 21:37:56 -07:00 |
|
Zaili Wang
|
aa3003f116
|
Add gguf dependency for cpu/xpu (#12041)
|
2025-10-23 21:13:17 -07:00 |
|
Yongfei Xu
|
4793ec7d1a
|
Opt MHA chunked prefix: merge prefix and extend kv cache to run mha once (#10953)
|
2025-10-23 20:58:10 -07:00 |
|
Zaili Wang
|
92009bd28e
|
fix: fix MMMU loading issue (#11759)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-23 20:21:38 -07:00 |
|
Baizhou Zhang
|
4ef981e2b6
|
Revert "[Fix] Fix lint to pass CI" (#12042)
|
2025-10-23 19:44:58 -07:00 |
|
Baizhou Zhang
|
69ed8b67a8
|
[Fix] Fix lint to pass CI (#12037)
|
2025-10-23 19:39:38 -07:00 |
|
narutolhy
|
1801cd199f
|
support more model in piecewise cuda graph (#11745)
|
2025-10-24 10:31:39 +08:00 |
|
Lianmin Zheng
|
ffc722a690
|
Revert "lang: support direct video inference" (#12038)
|
2025-10-23 19:21:31 -07:00 |
|
thelongestusernameofall
|
49afb3d9d9
|
Fix(security): block unsafe pickle deserialization to mitigate CVE-2025-10164 (#11909)
Co-authored-by: Chengxing Xie <xiechengxing34@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-10-23 19:12:40 -07:00 |
|
b8zhong
|
f80371ff8c
|
Use flashinfer_trtllm moe runner backend to gain around 10% perf on b200 fp8 dpsk (#11816)
|
2025-10-23 19:12:15 -07:00 |
|
Jonah Bernard
|
62eff37ba1
|
Refactor Triton-kernel MoE runner integration (#11795)
|
2025-10-23 18:47:28 -07:00 |
|
b8zhong
|
47e12e082e
|
Enable Llama 4 + TRTLLM MHA (#12003)
|
2025-10-23 18:22:58 -07:00 |
|
Mick
|
823b442945
|
lang: support direct video inference (#9936)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-10-23 18:12:39 -07:00 |
|
Fan Yin
|
14a4d80e57
|
[8/n] decouple quantization impl from vllm dependency - gguf srt (#11964)
Co-authored-by: Peng Zhang <zhuangsen.zp@antgroup.com>
|
2025-10-23 18:12:00 -07:00 |
|
sglang-bot
|
1053e1be17
|
chore: bump SGLang version to 0.5.4 (#12027)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-10-23 18:01:40 -07:00 |
|
nvjullin
|
9a71500cfb
|
Fixed aarch64 flash-mla (#12009)
|
2025-10-23 17:47:04 -07:00 |
|
Simo Lin
|
6d6e24bcc4
|
[router] Add builder pattern for RouterConfig with zero duplication (#12030)
|
2025-10-23 16:46:10 -07:00 |
|
Kangyan-Zhou
|
2c057fbfa8
|
Update Github action title for kernel build (#12029)
|
2025-10-23 13:39:40 -07:00 |
|
Roger Young
|
dbd9435dc1
|
Fix mamba radix cache eviction logic in alloc_req_slots (#11616)
Signed-off-by: rogeryoungh <rogeryoungh@foxmail.com>
|
2025-10-23 13:07:43 -07:00 |
|
b8zhong
|
8ae9d4bb41
|
Revert "[ROCm] Remove vLLM rope dependency & use AITER impl" (#12028)
|
2025-10-23 12:42:59 -07:00 |
|
Nicolas Castet
|
1c304aa9bc
|
Log iteration # for prefill and decode (#9366)
|
2025-10-23 12:28:03 -07:00 |
|
Mick
|
770529a731
|
model: support deepseek-ocr (#11891)
Co-authored-by: yhyang201 <47235274+yhyang201@users.noreply.github.com>
Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Shi Shuai <126407087+shuaills@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-10-24 03:15:17 +08:00 |
|
ErvinXie
|
39c237f02c
|
Add AWQ quantization support for NPU. (#10158)
Co-authored-by: Alisehen <814073252@qq.com>
Co-authored-by: Yaochen Han <48639761+Alisehen@users.noreply.github.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
|
2025-10-23 12:08:05 -07:00 |
|
Chang Su
|
28b8a4064d
|
[router][CI] Clean up imports and prints statements in sgl-router/py_test (#12024)
|
2025-10-23 11:56:57 -07:00 |
|
Mick
|
8bd26dd4e6
|
ci: fix night-ci with push retry mechanism (#11765)
|
2025-10-23 11:31:05 -07:00 |
|
Lianmin Zheng
|
ab07cd3e5a
|
[Auto Sync] Update test_deterministic_utils.py (20251023) (#12022)
Co-authored-by: Stefan He <hebiaobuaa@gmail.com>
|
2025-10-23 11:20:45 -07:00 |
|
Netanel Haber
|
a98496834b
|
Feature/nano v2 offline modelopt fp8 and nvfp4 (#12018)
Signed-off-by: Netanel Haber <58652339+netanel-haber@users.noreply.github.com>
|
2025-10-23 11:16:46 -07:00 |
|
Simo Lin
|
a4b637d87a
|
[router] change ci names and update log level in ci (#12021)
|
2025-10-23 10:36:19 -07:00 |
|
Teng Ma
|
96a5e4dd79
|
[Feature] Support loading weights from ckpt engine worker (#11755)
Signed-off-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Signed-off-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Yang Kaiyong <yangkaiyong.yky@antgroup.com>
Co-authored-by: Cruz Zhao <CruzZhao@linux.alibaba.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-10-23 09:23:30 -07:00 |
|
cctry
|
b0b4f71679
|
[Fix] memory leak by overlap + retract (#11981)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-10-23 22:59:23 +08:00 |
|
Liangsheng Yin
|
6c18addb6f
|
Revert "Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4" (#12015)
|
2025-10-23 21:27:58 +08:00 |
|
Liangsheng Yin
|
32852fe9e9
|
Move memory runtime checker to mixin class (#12014)
|
2025-10-23 20:53:26 +08:00 |
|
Arthur Cheng
|
53c2934dce
|
[Router] Consolidate ConnectionMode enum to core module (#11937)
|
2025-10-23 05:15:49 -07:00 |
|
Keyang Ru
|
e321c97113
|
[router] Add comprehensive E2E tests for Response API (#11988)
|
2025-10-23 05:13:51 -07:00 |
|
Netanel Haber
|
d6fee73d1f
|
Support nvidia/NVIDIA-Nemotron-Nano-9B-v2-FP8/NVFP4 (#11866)
|
2025-10-23 17:29:02 +08:00 |
|
Qiaolin Yu
|
36a4cad7b0
|
Support overlap-spec-v2 with trtllm_mla attention backend (#11821)
|
2025-10-23 16:55:35 +08:00 |
|
HAI
|
65d376b491
|
aiter update to v0.1.6.post1 (#12004)
|
2025-10-22 23:53:05 -07:00 |
|
yinghui
|
c23eda8589
|
Fix incorrect KV indices creation when page_size=32 in TRTLLM MLA backend (#11985)
|
2025-10-22 22:44:45 -07:00 |
|
Jue WANG
|
138ff23187
|
Allow to disable batch decoding. (#11944)
|
2025-10-22 21:57:12 -07:00 |
|
blzheng
|
13fb8b5489
|
[CPU] Optimize FP16 decode_attention_cpu (#10652)
|
2025-10-22 21:39:51 -07:00 |
|
Zhengyi Lai
|
81fd2b0ee0
|
fix(deepep): resolve benchmark failure on 4×IB-card setup by aligning tuning config with DeepEP commit bdd119f8 (#11965)
|
2025-10-22 21:20:54 -07:00 |
|
Zaili Wang
|
007b849b0e
|
[CPU] misc updates (#11906)
|
2025-10-22 21:10:05 -07:00 |
|