 Yuan Luoandluoyuan.luo
|
3a42c5e341
|
[VLM] Adopt jit qk_norm kernel in VLM (#16171)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-01 10:10:36 +08:00 |
|
|
Feng Su
|
57d2ba9203
|
SGLang Tracing: Supports propagating trace headers through sgl.Engine… (#15814)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
|
2025-12-31 15:19:53 -08:00 |
|
|
Cheng Wan
|
2b461c15b4
|
Update logprob_start_len handling in scheduler (#16240)
|
2025-12-31 14:11:24 -08:00 |
|
|
siyu
|
abdf65d4f3
|
Fix OOM by offloading multimodal features to CPU after embedding (#16018)
|
2025-12-31 23:02:34 +08:00 |
|
|
Huaixin ChangandLiangsheng Yin
|
c1dfbc777b
|
deprecate prefill-round-robin-balance (#16195)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-31 22:25:33 +08:00 |
|
|
Muqi Li
|
2667c857a7
|
Fix DeepSeekV31's structural tag trigger (#13394)
|
2025-12-31 21:13:52 +08:00 |
|
|
Kangyan-Zhou
|
fc643ffbc9
|
Download missing shards in model weights files when not in CI (#16211)
|
2025-12-31 20:42:34 +08:00 |
|
|
Baizhou Zhang
|
e47afa0237
|
[DP]Fix sync bubble in adjust_num_token_non_padded_for_attn_tp (#16178)
|
2025-12-31 17:58:18 +08:00 |
|
|
cen121212
|
25b48564c3
|
[NPU][Bugfix] fix Qwen3-VL-30B-A3B-Instruct accuracy loss (#15597)
|
2025-12-31 15:57:38 +08:00 |
|
|
Hudson Xing
|
8a9ca41fda
|
Move log_prefill_stats_late to correct location in PP mode (#15946)
|
2025-12-31 12:00:24 +08:00 |
|
|
roikoren755
|
47a660d5b9
|
[NemotronH] PP support (#16172)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2025-12-31 11:16:15 +08:00 |
|
|
liupeng374
|
75b72eb8b2
|
[cp] assert dsv3.2 cp in pd decode mode (#16156)
|
2025-12-31 09:24:46 +08:00 |
|
|
|
bc8b526eda
|
Fix: Handle empty func_name and None values in GLM MoE detectors (#15754)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-30 14:32:35 -08:00 |
|
|
Izzy Putterman
|
3dfff6ae3c
|
Eagle: GPT-OSS Eagle v2 support (#14920)
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
|
2025-12-30 14:23:07 -08:00 |
|
|
EkiRui
|
ad2c1ee352
|
doc: mooncake store add dummy client support (#16050)
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
|
2025-12-30 12:37:57 -08:00 |
|
|
|
00e607111a
|
[Auto Sync] Update request_metrics_exporter.py (20251230) (#16183)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Scott Lee <scottjlee@users.noreply.github.com>
|
2025-12-30 11:09:41 -08:00 |
|
|
Roger Youngandxuebi
|
d17b9e6392
|
Fusing RMSNormTP in minimax_m2 (#14416)
Co-authored-by: xuebi <xuebi@minimaxi.com>
|
2025-12-30 10:22:07 -08:00 |
|
|
Liangsheng Yin
|
ba67e006a7
|
Refactor speculative algorithm registry. (#16168)
|
2025-12-31 01:24:22 +08:00 |
|
|
DarkSharpness
|
45f3ad2f52
|
[Refactor] Rename CustomOp -> MultiPlatformOp (#16175)
|
2025-12-31 01:16:32 +08:00 |
|
|
Ke Bao
|
b973202526
|
Split tp model worker init (#16165)
|
2025-12-30 23:36:03 +08:00 |
|
|
Mufeez Amjad
|
cbff7ad985
|
dp-attention: add follow_bootstrap_room + auto load-balance; drop decode_round_robin (#16110)
|
2025-12-30 22:33:06 +08:00 |
|
|
Ke Bao
|
b3817fa93b
|
Split model_worker init function (#16160)
|
2025-12-30 21:39:11 +08:00 |
|
|
Ke Bao
|
059428bd8a
|
Tiny remove additional args in init_memory_pool (#16158)
|
2025-12-30 21:38:06 +08:00 |
|
|
Jumiarandliusy58
|
664f611e83
|
Add profiling capture support to the encoder server (#15730)
Signed-off-by: liuanqi <liuanqi6@xiaomi.com>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
|
2025-12-30 19:56:25 +08:00 |
|
|
Gaoji Liuandliugaoji.lgj
|
7518dc3532
|
feat(SpecEagleV2): add standalone_worker_v2 (#12625)
Co-authored-by: liugaoji.lgj <liugaoji.lgj@alibaba-inc.com>
|
2025-12-30 17:55:04 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
94bcc19bce
|
[VLM] Support Video for InternVL3_5 (#15942)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-30 17:07:49 +08:00 |
|
|
Shangming Cai
|
db3821a9ef
|
[PP] Add a minimum chunk value for PP dynamic chunking (#16140)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-30 16:35:39 +08:00 |
|
|
Liangsheng Yin
|
c2601f0d21
|
Fix wrong assigning extend_input_len_per_req with eagle. (#16129)
|
2025-12-30 15:51:53 +08:00 |
|
|
Vitaly Tuzov
|
1048803c1f
|
Reworked fast_pos_embed_interpolate() using torch (#10959)
|
2025-12-30 14:45:34 +08:00 |
|
|
Stefan He
|
9416464682
|
Fix Qwen Next GDN w/ Radix Cache (#16053)
|
2025-12-29 21:06:06 -08:00 |
|
|
Cheng Wan
|
5fb734f1a5
|
Enhance comments in set_extend_input_len method (#16130)
|
2025-12-29 20:47:33 -08:00 |
|
|
Cheng Wan
|
60f1ca6925
|
Refactor: Moving extend_logprob_start_len calculation out of prepare_for_extend (#16105)
|
2025-12-30 12:38:33 +08:00 |
|
|
Vladimir Serov
|
9e263c2162
|
[LoRA] Torch native backend: rework implementation and updated tests (#15187)
|
2025-12-30 11:48:51 +08:00 |
|
|
Ke Bao
|
3de23274ee
|
Clean up swa handling in fa3 backend (#15877)
|
2025-12-30 08:51:40 +08:00 |
|
|
Cheng Wan
|
c2e0913e17
|
Fix extend_input_len calculation in decode.py (#16103)
|
2025-12-29 13:13:24 -08:00 |
|
|
Simo LinandChang Su
|
162d1cf9be
|
[model-gateway] Add classification model support infrastructure (#16061)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-29 08:34:05 -08:00 |
|
|
cklxx
|
d48723b77d
|
Clamp logprob tokens with model vocab size (#14414)
|
2025-12-29 20:37:07 +08:00 |
|
|
Xuchun Shang
|
4ab66d956f
|
[HiCache] Fix deadlock when creating new group (#15805)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-29 17:13:04 +08:00 |
|
|
Mike QiuandMike_Qiu
|
2ec6fa3c54
|
feat PD: add eagle3 support for DeepSeek V3 in EP mode (#14280)
Signed-off-by: Michael Qiu <qiudayu.qdy@antgroup.com>
Co-authored-by: Mike_Qiu <qiudayu.qdy@antgroup.com>
|
2025-12-29 11:12:34 +08:00 |
|
|
EkiRuiandTeng Ma
|
ef4b3c0e96
|
Add host tensor allocator for memory_pool_host and support Mooncake standalone storage (#14873)
Signed-off-by: Xingrui Yi <yixingrui@linux.alibaba.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
|
2025-12-28 16:28:50 -08:00 |
|
|
Cheng Wan
|
6f9d0a89a0
|
[scheduler] fix: correcting extend_logprob_start_len calculation (#15922)
|
2025-12-28 14:57:04 -08:00 |
|
|
Lianmin Zheng
|
e6d5a213ad
|
Fix metrics (#15998)
|
2025-12-28 05:03:49 -08:00 |
|
|
fzyzcjy
|
d90f9bfc4e
|
Temporarily disable temp_prefill_info assertion to unblock CI (#16008)
|
2025-12-28 20:13:06 +08:00 |
|
|
Liangsheng Yin
|
be3828a13b
|
Tiny cleanup duplicate code for multi-layer eagle worker. (#16004)
|
2025-12-28 18:08:20 +08:00 |
|
|
lif
|
5969be2f06
|
Apply fixture-kit mode to MMMUVLMMixin (#15615)
|
2025-12-28 17:22:05 +08:00 |
|
|
Liangsheng Yin
|
bf90ea9c5b
|
Unify spec v2's naming manner. (#15990)
|
2025-12-28 14:14:52 +08:00 |
|
|
TZHelloWorld
|
0294844f04
|
[fix]deepgemm precompile when warmup (#15891)
|
2025-12-28 13:47:39 +08:00 |
|
|
Alison ShaoandKangyan-Zhou
|
0e536600e8
|
Refactor: separate CI-specific weight validation into dedicated module (#15216)
Co-authored-by: Kangyan-Zhou <zky314343421@gmail.com>
|
2025-12-27 20:50:39 -08:00 |
|
|
Vladislav Nosivskoyandishandhanani
|
d70c265533
|
SGLang Tracing: fix attribute errors (header extraction & bootstrap span closing) (#15693)
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
Co-authored-by: ishandhanani <82981111+ishandhanani@users.noreply.github.com>
|
2025-12-27 22:44:31 -06:00 |
|
|
Baizhou Zhang
|
656f4d69a1
|
Refactor fp8 nextn layer for DeepSeek nvfp4 checkpoint (#15353)
|
2025-12-28 11:57:09 +08:00 |
|