Simo Lin
|
a4ffd665c0
|
[model-gateway] fix WASM memory limit per module (#14600)
|
2025-12-07 19:15:19 -08:00 |
|
Alison Shao
|
559202b544
|
[CI] Fix unit-test-backend-8-gpu-b200 running on every /rerun-stage (#14591)
|
2025-12-07 18:42:04 -08:00 |
|
Nicholas
|
f57d4fe78e
|
[feat] use cachebuffer to store mm feature to speedup hash (#14386)
|
2025-12-08 10:35:20 +08:00 |
|
wentx
|
b7b7524e95
|
[Tool Call] Fix DeepSeekV32Detector skipping functions with no params in streaming mode (#14573)
|
2025-12-07 18:32:10 -08:00 |
|
Baizhou Zhang
|
6799847ebf
|
[CI]Unblock and split spec v2+dp test (#14551)
|
2025-12-07 17:39:25 -08:00 |
|
Xiaoyu Zhang
|
03b835e7d1
|
Refactor tuning block wise kernel and opt Qwen/Qwen3-VL-32B-Instruct-FP8 (#14141)
|
2025-12-08 09:24:58 +08:00 |
|
Simo Lin
|
aff1238ef2
|
[model-gateway] reorganize metrics, logging, and otel to its own module (#14590)
|
2025-12-07 16:50:39 -08:00 |
|
Simo Lin
|
5e2cda6158
|
[model-gateway] Fixed WASM Security Vulnerability - Execution Timeout (#14588)
|
2025-12-07 16:05:53 -08:00 |
|
Simo Lin
|
b0bbc7f53d
|
[model-gateway] extra accumulator and tool handler in oai router (#14587)
|
2025-12-07 15:52:12 -08:00 |
|
Baizhou Zhang
|
673c11ba73
|
[Minor] Temporarily skipping deepep large mtp test (#14586)
|
2025-12-07 13:59:16 -08:00 |
|
b8zhong
|
3b47973af8
|
[CI] Tiny speed up VLM CI (#14517)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-07 13:30:41 -08:00 |
|
Zhiyu
|
f6423b626c
|
Rename TensorRT Model Optimizer to Model Optimizer (#14455)
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
|
2025-12-07 13:18:20 -08:00 |
|
Hudson Xing
|
84efe54bc4
|
Fix FP8 KV Triton type issue and add regression test (#14553)
|
2025-12-07 10:51:46 -08:00 |
|
khalilzhk
|
948b6acee8
|
[BugFix] fix prefixcache performance and accuracy on ascend (#13573)
|
2025-12-08 02:16:20 +08:00 |
|
Vladimir Serov
|
f124539a01
|
[NPU]LoRA: Adding Torch Native backend (#14132)
|
2025-12-08 02:16:07 +08:00 |
|
AichenF
|
c8683ae305
|
[diffusion] cli: profiling utilities support (#14185)
Co-authored-by: jianyingzhu <53300651@qq.com>
Co-authored-by: Jianying <53503712+jianyingzhu@users.noreply.github.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-08 00:59:45 +08:00 |
|
Liangsheng Yin
|
125e17efd5
|
Add small model test for spec v2 + dp + trtllm_mla (#14576)
|
2025-12-07 23:55:00 +08:00 |
|
Liangsheng Yin
|
88c459c6c8
|
Tiny remove wrong import from python.sglang (#14577)
|
2025-12-07 22:07:49 +08:00 |
|
Xiaoyu Zhang
|
ae6a6630e4
|
Add Expert Parallelism (EP) support for kimi-k2-thinking (#13725)
|
2025-12-07 20:28:57 +08:00 |
|
Yuan Luo
|
26d95008b6
|
[apply][2/2] Fused qk_norm_rope for Qwen3-MoE (#13998)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2025-12-07 20:25:18 +08:00 |
|
Alison Shao
|
f2b5dcc976
|
Add unit-test-backend-8-gpu-b200 to rerun-stage command (#14569)
|
2025-12-07 19:09:07 +08:00 |
|
Tiwei Bie
|
9abcab3ffa
|
[DLLM] feat: Add threshold based parallel decoding support (#14412)
Co-authored-by: Jinwei Yao <jinweiy@illinois.edu>
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com>
|
2025-12-07 18:25:33 +08:00 |
|
Xiaoyu Zhang
|
e5135b73f4
|
Add CUDA kernel size analysis tool for sgl-kernel optimization (#14544)
|
2025-12-07 15:29:41 +08:00 |
|
Alison Shao
|
41d61faa99
|
[FLA] Add explicit kernel arguments to kda.py for Kimi Linear support (#14561)
|
2025-12-06 22:45:41 -08:00 |
|
Chen1022
|
3c7886ec4c
|
Fix attention backend logic for Qwen3-Next on SM100 (#14560)
|
2025-12-06 22:03:34 -08:00 |
|
ishandhanani
|
0e4d8790d7
|
feat(ci): add framework target to release-docker workflows (#14559)
|
2025-12-07 13:25:24 +08:00 |
|
b8zhong
|
6d5d76ad97
|
remove unecessary dual stream token threshold from the rest of models (qwen moe, kimi linear, etc.) (#14337)
|
2025-12-06 19:57:26 -08:00 |
|
George Armstrong
|
91c9c14c28
|
DOC update nemo-skills in docs (#14555)
Signed-off-by: George Armstrong <georgea@nvidia.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
|
2025-12-06 19:03:08 -08:00 |
|
Rain H
|
32a32cf7d2
|
Enhance prefill PP node robustness (#14494)
|
2025-12-06 18:00:54 -08:00 |
|
Minglei Zhu
|
be4a3ec376
|
support piecewise cuda graph for Olmo models (#14476)
|
2025-12-06 17:57:44 -08:00 |
|
almaslof
|
ff6e3ea934
|
[docs] Add missing word in argument description (#14205)
|
2025-12-06 17:56:54 -08:00 |
|
b8zhong
|
dd91d38e6a
|
[Doc] Add short explanation on page size (#14557)
|
2025-12-06 17:26:30 -08:00 |
|
Lee Nau
|
5f6f550af8
|
Update DeepSeek V3 docs to use B200 (#14447)
|
2025-12-06 17:22:11 -08:00 |
|
harrisonlimh
|
5edbe351cb
|
Update CI_PERMISSIONS.json (#14552)
|
2025-12-06 14:01:32 -08:00 |
|
sglang-bot
|
d2b42477c7
|
chore: bump sgl-kernel version to 0.3.18.post3 (#14518)
|
2025-12-06 13:15:16 -08:00 |
|
Baizhou Zhang
|
9dfa01a435
|
[Misc]Register and refactor some environs for dpsk-fp4 and DeepEp (#14538)
|
2025-12-06 12:29:16 -08:00 |
|
Hanming Lu
|
e592ee6545
|
[Qwen3-next] remove heuristics and add radix cache kl test (#14520)
|
2025-12-06 12:11:40 -08:00 |
|
Alison Shao
|
cee93a6f26
|
[Bug fix] Add /model_info endpoint to mini_lb (#14535)
|
2025-12-06 11:34:03 -08:00 |
|
Baizhou Zhang
|
bc388471d2
|
[1/n] Fix hanging during DeepGemm Warmup (#14493)
|
2025-12-06 10:44:02 -08:00 |
|
gongwei-130
|
3e40c63674
|
fix "GrammarMatcher has terminated after accepting the stop token, but is trying to find the next token mask" when both reasoning and spec are enabled (#14464)
|
2025-12-06 06:15:22 -08:00 |
|
WenhaoZhang
|
80122e4f4c
|
[diffusion] lora: fix LoRA dtype handling and weight attribute access for z-image model (#14543)
Co-authored-by: niehen6174 <nihen6174@gmail.com>
|
2025-12-06 22:14:44 +08:00 |
|
Feng Su
|
e12c6b320f
|
[model-gateway][tracing]: implement request tracing using OpenTelemetry with trace context propagation (HTTP) (#13897)
|
2025-12-06 05:59:04 -08:00 |
|
Xiaoyu Zhang
|
6d41791823
|
[diffusion] perf: add QKV fusion optimization for Flux models (#14505)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-06 20:44:16 +08:00 |
|
Mick
|
35a9a07370
|
[diffusion] refactor: simplify sampling params' override logic (#14539)
|
2025-12-06 20:23:49 +08:00 |
|
Rain Jiang
|
ea177372bd
|
support mtp with deepseek r1 nvfp4 model (#13115)
Co-authored-by: Trevor Morris <tmorris@nvidia.com>
|
2025-12-06 00:45:54 -08:00 |
|
Baizhou Zhang
|
42fcf5438f
|
Revert "tiny remove deprecated endpoint call" (#14533)
|
2025-12-05 23:48:54 -08:00 |
|
blzheng
|
d257bf87b9
|
[CPU] add mamba fla kernels for Qwen3-next (#12324)
|
2025-12-06 14:16:23 +08:00 |
|
Yuhao Yang
|
7b0c7ad163
|
Revise DP Multi-Modal Encoder Document (#14290)
|
2025-12-06 12:56:53 +08:00 |
|
Simo Lin
|
d30d6b368f
|
[bug] fix notebook to include new keys from model_info (#14528)
|
2025-12-05 20:44:03 -08:00 |
|
Mick
|
d881f31488
|
[diffusion] chore: temporarily upgrade diffusers to make Z-image compatible with Cache-DiT (#14530)
|
2025-12-06 12:39:37 +08:00 |
|