Frank
|
9749d3e346
|
Update benchmarks to use HF token from environment. (#15421)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 13:47:27 -08:00 |
|
Baizhou Zhang
|
2b0ddf89f5
|
[Tiny]Add warning for deepgemm on Blackwell (#15352)
|
2025-12-18 13:45:26 -08:00 |
|
Shangming Cai
|
17e81c750a
|
[PP] Add dynamic chunking PP test (#15395)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-19 01:09:40 +08:00 |
|
fzyzcjy
|
88a405cc10
|
Support EPLB balancedness prometheus metric without GPU->CPU synchronize (#15401)
|
2025-12-18 22:24:23 +08:00 |
|
fzyzcjy
|
602fe3b296
|
Super tiny add moe_ep_rank to prometheus labels (#15407)
|
2025-12-18 22:23:20 +08:00 |
|
fzyzcjy
|
ad9616f13a
|
Tiny extract ModelRunnerOutput (#15400)
|
2025-12-18 22:18:45 +08:00 |
|
fzyzcjy
|
c5f4e20f2f
|
Support GPU execution time breakdown by forward mode metrics (#15396)
|
2025-12-18 22:18:17 +08:00 |
|
fzyzcjy
|
2c196f95a7
|
Tiny fix unknown route in prometheus metrics (#15404)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 22:17:46 +08:00 |
|
Xiaoyu Zhang
|
9a7641d7bf
|
[diffusion] profiling: include per-denoising-step timings in perf-dump-path (#15397)
|
2025-12-18 18:43:33 +08:00 |
|
Bruce-x-1997
|
793c96c3d2
|
[perf]optimize w4afp8 kernel on deepseek-v3-0324 (#12921)
Signed-off-by: bruce.xu <bruce.x@gmicloud.ai>
|
2025-12-18 18:13:22 +08:00 |
|
Lianmin Zheng
|
d1f0063262
|
Clean up __init__ function of the scheduler and event loop for PD (#15298)
|
2025-12-18 01:35:14 -08:00 |
|
Kevin_Xiong
|
4792d1f452
|
[sgl-kernel][1/2] Fused qk_norm_rope for GLM4.6 (#15141)
|
2025-12-18 17:07:04 +08:00 |
|
Xuchun Shang
|
fea2d5211d
|
[bug fix][pp] fix inconsistent latency between tp (#15379)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-18 16:59:56 +08:00 |
|
Xiaoyu Zhang
|
56d12b4aea
|
Fix warp illegal instruction in kimi k2 thinking PCG (#15306)
|
2025-12-18 16:58:23 +08:00 |
|
Liangsheng Yin
|
374ad4cce0
|
Fix gpt-oss yarn with truncate argument (#14270)
|
2025-12-18 16:31:15 +08:00 |
|
Liangsheng Yin
|
8b0a68f1bf
|
Monkey patch deepseek-ocr's v_head_dim (#15384)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-18 16:28:07 +08:00 |
|
Simo Lin
|
70607e55e8
|
[model-gateway] Replace PolicyRegistry RwLock with DashMap for lock-free policy lookups (#15361)
|
2025-12-18 00:11:20 -08:00 |
|
Shangming Cai
|
ee1ca51de8
|
[PP] Fix dynamic chunking strategy for PP (#15372)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-18 14:24:55 +08:00 |
|
MarcoDWei
|
ef7c29acd7
|
Fix issue: ENABLE_BELOW_SM90 cannot be enabled on aarch64 CPU (#12967)
|
2025-12-18 13:26:42 +08:00 |
|
Alison Shao
|
58c840db6b
|
Split test_piecewise_cuda_graph.py to optimize CI resource usage (#15290)
|
2025-12-17 21:20:21 -08:00 |
|
Yuhao Yang
|
3d42b7e7b0
|
unified management of environment variables for vlm cuda ipc transport (#14501)
|
2025-12-18 12:28:06 +08:00 |
|
elvischenv
|
9970ee34e8
|
Mistral Large 3 NVFP4 TRTLLM MoE support (#15049)
|
2025-12-18 11:11:42 +08:00 |
|
Douglas Yang
|
9e7656be80
|
fix: adjust time for test_epd_disaggregation.py (#15354)
|
2025-12-17 18:30:52 -08:00 |
|
Yi Zhang
|
9d4f066fb9
|
Add doc for qwen3 next (#15337)
|
2025-12-17 17:53:07 -08:00 |
|
Xinyuan Tong
|
41683536d3
|
feat: DeepSeek-V3.2 Streaming tool call output (#15278)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: momaek <momaek17@gmail.com>
Co-authored-by: Muqi Li <muqi1029@gmail.com>
|
2025-12-17 17:43:58 -08:00 |
|
Dongjie Zou
|
891ee8221f
|
Feature/trtllm mha workspace size configurable #15089 (#15131)
|
2025-12-17 17:07:23 -08:00 |
|
Yuan Luo
|
8fa3dc36c5
|
[VLM] Support cos sin cache for Qwen3-VL & GLM-4.1V (#15205)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-18 08:39:50 +08:00 |
|
b8zhong
|
d20699a33c
|
[Deepseek V3.2] Support Overlap Spec + NSA (#15307)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-17 13:35:39 -08:00 |
|
Scott Lee
|
169a75dfb8
|
Add request-level timestamp for when prefill finishes (#14860)
|
2025-12-17 13:34:46 -08:00 |
|
Alison Shao
|
4128d4f5cb
|
[CI] Migrate LoRA tests to test/registered/lora/ (#15176)
|
2025-12-17 13:19:42 -08:00 |
|
Kangyan-Zhou
|
011d8d8970
|
Reserve more memory for DeepSeekOCR model and adjust server start timeout for DeepGEMM to reduce flakiness (#15277)
|
2025-12-17 13:13:05 -08:00 |
|
Cheng Wan
|
5290cef97c
|
Fix condition check for require_gathered_buffer (#15328)
|
2025-12-17 12:42:47 -08:00 |
|
许霖
|
726fe3e72e
|
fix: prevent points regex from matching checkpoints/endpoints (#15120)
|
2025-12-17 12:38:18 -08:00 |
|
kk
|
5d087891c9
|
Fix dp run error with fp8-kv enable in high concurrency test (#15241)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-12-17 11:49:18 -08:00 |
|
Baizhou Zhang
|
8451e22758
|
[DeepSeek-V32]Update nightly performance benchmark (#15308)
|
2025-12-17 11:25:31 -08:00 |
|
Simo Lin
|
53e151945a
|
[model-gateway] optimize worker registry and reduce lock contention in grpc client fetch (#15336)
|
2025-12-17 08:49:10 -10:00 |
|
Simo Lin
|
d747147a26
|
[model-gateway] reduce cpu overhead (#15316)
|
2025-12-17 09:42:01 -08:00 |
|
Liangsheng Yin
|
0c00220795
|
tiny unify environ usage (#15335)
|
2025-12-17 23:31:43 +08:00 |
|
Shangming Cai
|
eeb2b9b259
|
[PP] Minor code cleanup for Pipeline Parallelism (#15329)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-17 23:31:25 +08:00 |
|
fzyzcjy
|
c4aed389da
|
Super tiny rename failure_count for consistency (#15186)
|
2025-12-17 21:21:07 +08:00 |
|
fzyzcjy
|
9d04b570bc
|
Tiny dump native stacktraces in watchdog (#15222)
|
2025-12-17 21:20:41 +08:00 |
|
fzyzcjy
|
3e690cce53
|
Add realtime token counter metrics (#15198)
|
2025-12-17 21:20:24 +08:00 |
|
fzyzcjy
|
b12b40dea4
|
Add cuda_graph_forward_passes_total and num_retracted_reqs_total (#15189)
|
2025-12-17 21:19:42 +08:00 |
|
Xiaoyu Zhang
|
6c4bf8a0be
|
[diffusion] profiling: enhance trace export with gzip and integrity check (#15326)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
|
2025-12-17 20:44:55 +08:00 |
|
Xiaoyu Zhang
|
533851fbcb
|
[diffusion] ci: add flux2 tp2 test into ci to avoid breaking tensor parallel (#15237)
|
2025-12-17 20:44:21 +08:00 |
|
Xuchun Shang
|
0071fe9c40
|
[bug fix][pp] fix weight load for qwen2.5-vl (#15138)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-17 18:33:50 +08:00 |
|
b8zhong
|
ffa7e03506
|
[Piecewise CUDA Graph] Support INT8 (#14918)
|
2025-12-17 18:20:57 +08:00 |
|
LHXuuu
|
712f44ee2b
|
fix qwenvl compressed tensors quantization weight loader (#11914)
Signed-off-by: LHXuuu <xulianhao.xlh@antgroup.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
|
2025-12-17 18:01:43 +08:00 |
|
kk
|
8c34e18140
|
Fix the accuracy issue when running mxfp4 dsv3 model and enable ep (#15304)
Co-authored-by: wunhuang <wunhuang@amd.com>
|
2025-12-17 01:53:22 -08:00 |
|
Xuchun Shang
|
e9abb52576
|
[bug fix][pp] fix qwen3 model load (#15223)
Signed-off-by: Xuchun Shang <xuchun.shang@gmail.com>
|
2025-12-17 17:26:22 +08:00 |
|