 fzyzcjy
|
c6a6ba4368
|
Tiny refactor request logger (#15740)
|
2025-12-24 19:51:26 +08:00 |
|
|
vincentzed
|
ddb3970eb4
|
Tiny env cleanup in deepgemm (#15706)
Signed-off-by: vincentzed <207368749+vincentzed@users.noreply.github.com>
|
2025-12-24 00:58:46 -08:00 |
|
|
Liangsheng Yin
|
cb719c74ad
|
[2/N] clean duplicate code of logprob processing in spec. (#15593)
|
2025-12-24 15:21:13 +08:00 |
|
|
Lianmin Zheng
|
ff903a7eea
|
Simplify server args (#15704)
|
2025-12-23 22:46:12 -08:00 |
|
|
|
3bf07c684f
|
[Feature][MM] split the images of one request into multiparts (#11828)
Signed-off-by: Xuchun Shang <xuchun.shang@linux.alibaba.com>
Signed-off-by: Kun(llfl) <i@imux.top>
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
Co-authored-by: Kun(llfl) <llfl@linux.alibaba.com>
Co-authored-by: Kun(llfl) <i@imux.top>
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
|
2025-12-24 11:22:04 +08:00 |
|
|
|
5c64a20da7
|
Update MiniMax-M2 ToolCall and add MiniMax-M2.1 in Docs (#15538)
Co-authored-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-23 15:11:52 -08:00 |
|
|
Lianmin Zheng
|
cf81737693
|
Add kv_transfer_total_mb to metrics (#15667)
|
2025-12-23 11:16:55 -08:00 |
|
|
ratish
|
5f3a47d8a7
|
[model-gateway]: add gRPC router embeddings endpoint implementation (#15273)
|
2025-12-23 09:12:22 -08:00 |
|
|
Liangsheng Yin
|
705287b2e5
|
Tiny add more information in retract logging. (#15694)
|
2025-12-24 00:43:36 +08:00 |
|
|
Yubo WangandLiangsheng Yin
|
762846531f
|
Fix Illegal Memory Access when fa3 + spec + topk + page_size > 1 (#15469)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-24 00:13:57 +08:00 |
|
|
shuwenn
|
53f974b973
|
fix: potential crash for missing stream attribute (#15644)
|
2025-12-23 23:24:31 +08:00 |
|
|
Teng MaandXuchun Shang
|
d7301c89ba
|
[Feature] support fastsafetensors (#15091)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-23 22:33:56 +08:00 |
|
|
Tianyu Guo
|
fa2966983a
|
Support PP for zmq_to_scheduler (#15312)
|
2025-12-23 17:07:55 +08:00 |
|
|
Douglas Yang
|
f9dd90ac35
|
fix: increasing H200 test timeout (#15600)
|
2025-12-23 01:00:37 -08:00 |
|
|
Baidu-AIAKandsunhailiang
|
bc3ca30023
|
[PD] Support fake decode for PD disaggregation without prefill node (#14628)
Co-authored-by: sunhailiang <sunhailiang@baidu.com>
|
2025-12-23 12:43:33 +08:00 |
|
|
yuchengz816-botandRunkai Tao
|
061f41affc
|
MoE: Skip SiLU/GELU activation for masked experts (#15539)
Co-authored-by: Runkai Tao <rt572@physics.rutgers.edu>
|
2025-12-22 19:08:31 -08:00 |
|
|
Yuxuan ZhangandXinyuan Tong
|
82f1d6157f
|
[GLM-ASR] GLM-ASR Support (#15570)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2025-12-22 17:37:55 -08:00 |
|
|
Lianmin Zheng
|
5e1a495c65
|
Improve engine customization interface (#15635)
|
2025-12-22 14:24:16 -08:00 |
|
|
sglang-botandsglang-bot
|
34013d9d5a
|
chore: bump sgl-kernel version to 0.3.20 (#15590)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-12-22 12:32:34 -08:00 |
|
|
|
7759716786
|
bugfix[schedule]: Refactor sort method and add related UT (#13576)
Co-authored-by: Yuxuan Wei <w1300012920@pku.edu.cn>
Co-authored-by: Yuxuan Wei <w1300012920@gmail.com>
Co-authored-by: Yuxuan Wei🚚 <yuxwei@microsoft.com>
|
2025-12-23 03:13:57 +08:00 |
|
|
Liangsheng Yinandgemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
3c882db3ad
|
Adjust wrong mtp meaning introduce by mimo (#15632)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-23 02:06:46 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
828dec1c7c
|
[VLM] Tiny: Unify VLM environment variables (#15572)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-22 17:32:37 +08:00 |
|
|
fzyzcjy
|
e62e17442e
|
Tiny enable soft watchdog in CI for stuck without logs (#15616)
|
2025-12-22 17:01:04 +08:00 |
|
|
fzyzcjy
|
d5431ff894
|
Tiny add stuck simulation (#15613)
|
2025-12-22 17:00:18 +08:00 |
|
|
fzyzcjy
|
454a2544f2
|
Support soft watchdog for tokenizer/detokenizer/dp-controller processes (#15607)
|
2025-12-22 16:59:16 +08:00 |
|
|
fzyzcjy
|
89619a9904
|
Tiny avoid EnvField misuse (#15612)
|
2025-12-22 16:20:47 +08:00 |
|
|
Hexq0210
|
cb30d056e3
|
add decode round robin policy (#15164)
|
2025-12-22 14:48:52 +08:00 |
|
|
Baizhou Zhang
|
468931b572
|
[Tiny]Move deepseek fp4 cutlass moe test to per-commit test (#15565)
|
2025-12-21 18:08:07 -08:00 |
|
|
FlyPanda
|
a3a552232d
|
[feature] support hicache-3fs usrbio lib build for ubuntu24.04 (#15230)
|
2025-12-21 17:00:38 -08:00 |
|
|
Chenxi Li
|
0bf95e6d69
|
Fix type mismatch in LoRA batch validation causing assertion failures (#15427)
|
2025-12-21 15:54:41 -08:00 |
|
|
Qiaolin Yu
|
254de6d2fd
|
Add triton_fused_moe config for GLM-4.6-FP8 tp8 blackwell (#15569)
|
2025-12-21 13:41:22 -08:00 |
|
|
Jincong Chen
|
350fbbf4dc
|
fix ds3.2 nsa backend prefill TBO (#14901)
|
2025-12-21 13:16:46 -08:00 |
|
|
Liangsheng Yin
|
393e2f9b62
|
Revert "[FusedMoE] Fix fused w13 tp sharded weight loading" (#15579)
|
2025-12-22 04:15:24 +08:00 |
|
|
Liangsheng Yin
|
8766a1dd24
|
[1 / N] Clean up logprob utils (#15509)
|
2025-12-22 03:12:25 +08:00 |
|
|
|
bed301a5ac
|
[Feature] Enable return routed experts (#12162)
Co-authored-by: yizhang2077 <1109276519@qq.com>
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-21 15:16:43 +08:00 |
|
|
Ke Bao
|
8fe3e37468
|
Support piecewise cuda graph for dsv3 fp4 (#15531)
|
2025-12-21 14:50:32 +08:00 |
|
|
YAMY
|
6014365564
|
[EAGLE] Fix slow Triton compilation in EAGLE KV cache copy by chunking large num_locs_upper (#15111)
|
2025-12-21 14:14:14 +08:00 |
|
|
Yinghai Lu
|
fc05acc2c7
|
[FusedMoE] Fix fused w13 tp sharded weight loading (#15432)
|
2025-12-21 13:59:36 +08:00 |
|
|
Xiaoyu Zhang
|
4b351f6b95
|
Apply new moe align block size kernel (#14134)
|
2025-12-21 10:13:32 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
050f108c29
|
Optimize Bailing-MoE with FlashInfer Fused All-Reduce (#15526)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-20 17:34:04 -08:00 |
|
|
Xinyuan Tong
|
0a346d3bd9
|
feat: Add limit-mm-data-per-request argument to server arguments (#15418)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-12-20 10:44:47 -08:00 |
|
|
Yuan Luoandluoyuan.luo
|
019517a356
|
[VLM] Support ViT Piecewise CUDA Graph for Qwen3-VL (#15320)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-20 21:00:07 +08:00 |
|
|
|
1f1f05a85e
|
vlm: refactor engine vlm params and support processor output as input (#14091)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: zhaochenyang20 <zhaochenyang20@gmail.com>
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
Co-authored-by: BenYao21 <cyao22@asu.edu>
Co-authored-by: minleminzui <minleminzui@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
|
2025-12-20 18:31:24 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
165f5c04cb
|
Optimize MiMo-V2-Flash by flashinfer fused allreduce (#15464)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-20 17:45:18 +08:00 |
|
|
Артем Савкин
|
3e01f3a533
|
[NPU] [BUGFIX] [CRITICAL!] Fix NPU inference (torch_npu._npu_reshape_and_cache() crash) (#15484)
|
2025-12-20 14:53:46 +08:00 |
|
|
yctseng0211
|
6468cb5823
|
[AMD] remove the redundant projection (#15178)
|
2025-12-19 22:10:46 -08:00 |
|
|
Qiaolin Yu
|
e220da1723
|
tiny fix sampling seed for completion api (#15498)
|
2025-12-19 20:32:13 -08:00 |
|
|
Yuxuan Zhang
|
b82c7a0ae7
|
[GLM-4.7] GLM-4.7 Tool Parser and Doc Update (#15333)
|
2025-12-19 20:30:44 -08:00 |
|
|
Liangsheng Yin
|
b9ebf0ed63
|
Clean hidden_states_before_norm (#15485)
|
2025-12-20 09:38:46 +08:00 |
|
|
YL D
|
6afc5d497b
|
[DSv32] Move deep_gemm.get_paged_mqa_logits_metadata to init time as metadata (#15040)
|
2025-12-19 13:23:33 -08:00 |
|