fzyzcjy
|
89ad390843
|
Fix num running requests (load) wrong cleared for ongoing requests (#15116)
|
2025-12-15 17:40:04 +08:00 |
|
kk
|
2ea844ec81
|
Fused two elementwise kernels for k_nope and k_pe concat (#14862)
1 TC failure to check, but irrelevant to this code change
|
2025-12-15 01:33:33 -08:00 |
|
Douglas Yang
|
1e2d753804
|
fix: adding date and fixing release name issue (#15174)
|
2025-12-15 17:11:03 +08:00 |
|
blzheng
|
d16ff357db
|
[CPU] Add Gemma3RMSNorm kernel in sgl-kernel and add ut (#9324)
|
2025-12-15 00:24:02 -08:00 |
|
Douglas Yang
|
af49e30242
|
feature: PR wheel (#15170)
|
2025-12-15 00:22:47 -08:00 |
|
Yuhao Yang
|
01b955ac3d
|
[diffusion] model: support mutli-image input and qwen-image-edit-2509 (#15005)
|
2025-12-15 16:17:10 +08:00 |
|
mmdbhs
|
16e6bc20b0
|
fix CompressedTensorsW8A8Int8 min_capability (#13914)
Co-authored-by: Fan Yin <1106310035@qq.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
|
2025-12-15 15:50:39 +08:00 |
|
Liangsheng Yin
|
372507649d
|
Tiny improve summary text in bench_one_batch_server.py (#15158)
|
2025-12-15 14:59:11 +08:00 |
|
Simo Lin
|
7b9156c773
|
[model-gateway] add mcp and discovery metrics (#15156)
|
2025-12-14 22:54:53 -08:00 |
|
Douglas Yang
|
21cfebac65
|
fix: move ci-bot (#15154)
|
2025-12-14 22:47:19 -08:00 |
|
Lianmin Zheng
|
702426b06a
|
Fix import warnings (#15144)
|
2025-12-14 21:25:18 -08:00 |
|
Douglas Yang
|
9e9a61691e
|
ci: adding errors to Github summary (#14778)
|
2025-12-14 21:08:16 -08:00 |
|
Simo Lin
|
bd9c3a47d6
|
[model-gateway] Add streaming metrics for harmony gRPC router (#15147)
|
2025-12-14 20:54:43 -08:00 |
|
Simo Lin
|
1e641ee4a7
|
[model-gateway] upgrade axum and axum server (#15146)
|
2025-12-14 20:54:01 -08:00 |
|
Simo Lin
|
fb96669ff9
|
[model-gateway] Add Layer 3 worker metrics (smg_worker_*) (#15130)
|
2025-12-14 20:25:46 -08:00 |
|
Yuan Luo
|
3912ee4991
|
[VLM] feat: support chunked vit attention (#14907)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-15 12:11:02 +08:00 |
|
b8zhong
|
1ab9b8e0a3
|
Enable TRT AllReduce Fusion by default (#14764)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-14 20:01:49 -08:00 |
|
Hanming Lu
|
e61dabf5e4
|
[Qwen3-next] support mamba radix cache for overlap scheduler (#14792)
|
2025-12-14 18:54:16 -08:00 |
|
Yineng Zhang
|
36e7c8c59f
|
docs: update usage (#15142)
|
2025-12-14 18:42:21 -08:00 |
|
Kangyan-Zhou
|
037c3982af
|
Fix H200 CI by commenting out Warmup Weights and JIT Compilation (#15139)
|
2025-12-14 18:04:28 -08:00 |
|
fzyzcjy
|
62b3fdae43
|
Fix cache aware wrong routing caused by incorrect load tracking (#15101)
|
2025-12-15 10:03:54 +08:00 |
|
Yibo Cai
|
1cd0c3bfb7
|
Add cyb70289 to CI permissions (#14938)
|
2025-12-14 17:51:30 -08:00 |
|
Douglas Yang
|
2c899431f8
|
fix: adjusting frequency for ci failure monitor (#15134)
|
2025-12-14 17:49:57 -08:00 |
|
Xiaoyu Zhang
|
4513f549ee
|
[diffusion] fix: fix default resolution 720p width from 1080 to 1280 (#15058)
|
2025-12-15 09:16:47 +08:00 |
|
YAMY
|
c96903074c
|
[NSA] Fix NSA backend assertion error when running DeepSeek-V3.2 PP with radix-cache (#15086)
|
2025-12-14 17:13:18 -08:00 |
|
fzyzcjy
|
4449c17011
|
[model-gateway] fix circuit breaker metrics (#15099)
Co-authored-by: Simo Lin <linsimo.mark@gmail.com>
|
2025-12-14 15:43:04 -08:00 |
|
fzyzcjy
|
5ca962ce7f
|
[model-gateway] extract circuit breaker state struct (#15098)
|
2025-12-14 15:40:23 -08:00 |
|
Praneth Paruchuri
|
bab20a849e
|
[model-gateway] Parallelize metrics requests (#14953)
|
2025-12-14 15:38:45 -08:00 |
|
ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|
Hudson Xing
|
99cb2ed988
|
[refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044)
|
2025-12-14 15:22:37 -08:00 |
|
Simo Lin
|
0612175ce1
|
[model-gateway] add streaming metrics (TTFT, TPOT, tokens, duration) for gRPC router (#15125)
|
2025-12-14 14:39:10 -08:00 |
|
Douglas Yang
|
8c96fcda70
|
feature: ci failure monitor slack bot (#15110)
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
|
2025-12-14 13:47:15 -08:00 |
|
zhangheng
|
ea7c69ce28
|
[hotfix]: Add missing args for 3FS bench_client.py (#14791)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-12-14 11:13:19 -10:00 |
|
danielafrimi
|
8102e36b5d
|
Add NanoV3 reasoning parser support (#15113)
|
2025-12-14 12:09:44 -08:00 |
|
roikoren755
|
3f0482174a
|
Fix Mamba2-based models' default attention backend (#15117)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2025-12-14 11:08:48 -08:00 |
|
Simo Lin
|
b11af135eb
|
[model-gateway] feat(metrics): implement Layer 2 router metrics (smg_router_*) (#15124)
|
2025-12-14 10:34:12 -08:00 |
|
Simo Lin
|
f9bceea064
|
[model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121)
|
2025-12-14 09:39:15 -08:00 |
|
Ziming Huang
|
997ea57eaf
|
Fix tensor mismatch error in sepc + topk > 1 + page_size > 1 (#14874)
|
2025-12-15 01:10:58 +08:00 |
|
Simo Lin
|
47633c191f
|
[model-gateway] Add new SMG metrics architecture with 6 layers (#15106)
|
2025-12-14 08:37:19 -08:00 |
|
Xiaoyu Zhang
|
64b5c3ab90
|
[diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-15 00:33:29 +08:00 |
|
Shangming Cai
|
d277a86dea
|
[CI] Add disaggregation decode PP test (#15114)
|
2025-12-14 23:54:25 +08:00 |
|
Tianyu Guo
|
9acb21ae27
|
feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2025-12-14 22:30:08 +08:00 |
|
zyl_keep_moving
|
a9ce1623cd
|
[kernel][moe] add moe topk fast (#13969)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-14 22:26:40 +08:00 |
|
Li Jinliang
|
6f0c77d7f8
|
[diffusion] app: support webui (#14961)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 21:07:36 +08:00 |
|
Xiaoyu Zhang
|
e3f51e823e
|
[diffusion] feat: add support for additional sampling parameters in video generation API (#15062)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 19:44:03 +08:00 |
|
Xiaoyu Zhang
|
fdfabb7afc
|
[diffusion] fix: tiny fix _templated_ring_attention bug (#15053)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 19:41:53 +08:00 |
|
blahblah
|
19c16748ce
|
[diffusion] feat: support resolution check for video model (#14881)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 17:50:13 +08:00 |
|
Liangsheng Yin
|
5c75907e62
|
Introduce native kv cache move (#15108)
|
2025-12-14 17:23:28 +08:00 |
|
liupeng374
|
4ea3642250
|
[NPU] bug fix for multi stream (#15048)
|
2025-12-14 16:38:12 +08:00 |
|
liupeng374
|
f50af32d8b
|
[scheduler] remove scheduler allgather for best throughout (#14294)
|
2025-12-14 16:37:49 +08:00 |
|