ratish
|
0e4108ba29
|
feat(gateway): Add server-side TLS support (#15052)
|
2025-12-14 15:37:55 -08:00 |
|
Hudson Xing
|
99cb2ed988
|
[refactor] Move trtllm_fp8_kv_kernel to triton_ops directory (#15044)
|
2025-12-14 15:22:37 -08:00 |
|
Simo Lin
|
0612175ce1
|
[model-gateway] add streaming metrics (TTFT, TPOT, tokens, duration) for gRPC router (#15125)
|
2025-12-14 14:39:10 -08:00 |
|
Douglas Yang
|
8c96fcda70
|
feature: ci failure monitor slack bot (#15110)
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
|
2025-12-14 13:47:15 -08:00 |
|
zhangheng
|
ea7c69ce28
|
[hotfix]: Add missing args for 3FS bench_client.py (#14791)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2025-12-14 11:13:19 -10:00 |
|
danielafrimi
|
8102e36b5d
|
Add NanoV3 reasoning parser support (#15113)
|
2025-12-14 12:09:44 -08:00 |
|
roikoren755
|
3f0482174a
|
Fix Mamba2-based models' default attention backend (#15117)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2025-12-14 11:08:48 -08:00 |
|
Simo Lin
|
b11af135eb
|
[model-gateway] feat(metrics): implement Layer 2 router metrics (smg_router_*) (#15124)
|
2025-12-14 10:34:12 -08:00 |
|
Simo Lin
|
f9bceea064
|
[model-gateway] Implement Layer 1 HTTP metrics instrumentation (#15121)
|
2025-12-14 09:39:15 -08:00 |
|
Ziming Huang
|
997ea57eaf
|
Fix tensor mismatch error in sepc + topk > 1 + page_size > 1 (#14874)
|
2025-12-15 01:10:58 +08:00 |
|
Simo Lin
|
47633c191f
|
[model-gateway] Add new SMG metrics architecture with 6 layers (#15106)
|
2025-12-14 08:37:19 -08:00 |
|
Xiaoyu Zhang
|
64b5c3ab90
|
[diffusion] refactor: refactor fuse qkv with QKVParallelLinear linear (#15090)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-15 00:33:29 +08:00 |
|
Shangming Cai
|
d277a86dea
|
[CI] Add disaggregation decode PP test (#15114)
|
2025-12-14 23:54:25 +08:00 |
|
Tianyu Guo
|
9acb21ae27
|
feat: support EPD disaggregation (#12263)
Co-authored-by: liusy58 <liusy58@linux.alibaba.com>
Co-authored-by: ZhengWG <zwg0606@gmail.com>
Co-authored-by: Nicholas <45984215+liusy58@users.noreply.github.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Yuhao Yang <47235274+yhyang201@users.noreply.github.com>
|
2025-12-14 22:30:08 +08:00 |
|
zyl_keep_moving
|
a9ce1623cd
|
[kernel][moe] add moe topk fast (#13969)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2025-12-14 22:26:40 +08:00 |
|
Li Jinliang
|
6f0c77d7f8
|
[diffusion] app: support webui (#14961)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 21:07:36 +08:00 |
|
Xiaoyu Zhang
|
e3f51e823e
|
[diffusion] feat: add support for additional sampling parameters in video generation API (#15062)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 19:44:03 +08:00 |
|
Xiaoyu Zhang
|
fdfabb7afc
|
[diffusion] fix: tiny fix _templated_ring_attention bug (#15053)
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 19:41:53 +08:00 |
|
blahblah
|
19c16748ce
|
[diffusion] feat: support resolution check for video model (#14881)
Co-authored-by: Brain97 <Brain97@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-14 17:50:13 +08:00 |
|
Liangsheng Yin
|
5c75907e62
|
Introduce native kv cache move (#15108)
|
2025-12-14 17:23:28 +08:00 |
|
liupeng374
|
4ea3642250
|
[NPU] bug fix for multi stream (#15048)
|
2025-12-14 16:38:12 +08:00 |
|
liupeng374
|
f50af32d8b
|
[scheduler] remove scheduler allgather for best throughout (#14294)
|
2025-12-14 16:37:49 +08:00 |
|
Qiaolin Yu
|
729529190d
|
[ci] Move dpsk-r1-fp4 b200 test to stage b (#15084)
|
2025-12-13 23:14:08 -08:00 |
|
monkeyLoveding
|
2ae5bed193
|
[NPU][CI] change de trigger of release image workflow (#14969)
|
2025-12-14 15:11:47 +08:00 |
|
fzyzcjy
|
54df514bac
|
Avoid confusing zero value metric when worker is removed (#15096)
|
2025-12-14 13:57:20 +08:00 |
|
fzyzcjy
|
681c68cfbf
|
Fix issue not reported when load decrement is incorrect (#15061)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-14 13:17:35 +08:00 |
|
Simo Lin
|
74ea45cc4b
|
[model-gateway] optimize metric labels to avoid unnecessary allocations (#15095)
|
2025-12-13 21:10:45 -08:00 |
|
Simo Lin
|
0fa044ad63
|
[model-gateway] Add circuit breaker and discovery watcher metrics (#15094)
|
2025-12-13 20:47:04 -08:00 |
|
Simo Lin
|
7d8e42c979
|
[model-gateway] Fix metric emission gaps and name mismatch (#15093)
|
2025-12-13 20:16:30 -08:00 |
|
Huang Lin
|
6abdf73f4d
|
[Fix] Environment variable SGL_* is deprecated (#14943)
|
2025-12-13 19:55:43 -08:00 |
|
Simo Lin
|
20ce9938b5
|
[model-gateway] Remove unused TokenizerMetrics to reduce CPU overhead (#15087)
|
2025-12-13 18:54:18 -08:00 |
|
fzyzcjy
|
168a31eb00
|
Support prefill max requests limitation (#14993)
|
2025-12-14 10:52:10 +08:00 |
|
narutolhy
|
69cfb17b9a
|
[Fix] avoid stream sync in _compute_mrope_positions (#14956)
|
2025-12-13 18:50:57 -08:00 |
|
Brian
|
a7a4b1755d
|
[Doc][TPU]add sglang-jax tpu docs (#15056)
|
2025-12-14 09:29:41 +08:00 |
|
fzyzcjy
|
fdc93b019c
|
Add sglang:decode_sum_seq_lens metric (#15066)
|
2025-12-14 08:42:45 +08:00 |
|
Simo Lin
|
fd37cc5d38
|
[model-gateway] Refactor worker steps and add update workflow (#15085)
|
2025-12-13 15:00:16 -08:00 |
|
Xinyuan Tong
|
96705514bd
|
fix: dpskv32 chat history processing, default drop_thinking to true (#15064)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2025-12-13 12:16:04 -08:00 |
|
Baizhou Zhang
|
ab3ffd1c8e
|
Add nightly accuracy test for DeepSeek V3.2 (#14935)
|
2025-12-13 12:11:16 -08:00 |
|
Wenyi Xu
|
2285affffa
|
[model-gateway] Avoid MCP Server Initialization Issue (#15065)
|
2025-12-13 11:20:16 -08:00 |
|
Yuhao Yang
|
a81cc1b8b3
|
add transformers version validation for glm-4.6v moe models (#14998)
|
2025-12-13 10:54:08 -08:00 |
|
liupeng374
|
3134d2b2a7
|
[scheduler] enhance scheduler in dp_attention mixed case with spec (#14201)
|
2025-12-14 02:52:26 +08:00 |
|
Yuhao Yang
|
06b58c5dc5
|
fix flaky image access in ci by switching to raw content url (#14940)
|
2025-12-13 10:52:06 -08:00 |
|
Douglas Yang
|
ea07a283b2
|
fix: adding schedule for nightly wheel (#15054)
|
2025-12-13 10:48:21 -08:00 |
|
Douglas Yang
|
ea91a720d5
|
feature: ci failure monitor improvements (#15055)
|
2025-12-13 10:47:52 -08:00 |
|
Simo Lin
|
5d9c6bac07
|
[bug] fix grpc secheduler launcher breaking change (#15080)
|
2025-12-13 10:36:49 -08:00 |
|
Simo Lin
|
e048ee90fc
|
[model-gateway] Simplify error response creation (#15079)
|
2025-12-13 10:28:24 -08:00 |
|
Liangsheng Yin
|
ed52d01b0b
|
Fix spec info's filter when reqs are finished right after prefill (#14742)
|
2025-12-14 00:32:54 +08:00 |
|
Liangsheng Yin
|
90e7d4f78f
|
Tiny adjust CI run suite (#15074)
|
2025-12-14 00:05:19 +08:00 |
|
Mick
|
c20d43d2e6
|
[diffusion] doc: update profiling.md with output location details (#15072)
|
2025-12-13 23:15:23 +08:00 |
|
Liangsheng Yin
|
d977dd2e07
|
Fix IMA with flashinfer + spec + topk & Add radix attention test cases for eagle (#13740)
|
2025-12-13 23:04:41 +08:00 |
|