Fenglin Yu
|
dcc5f5c0da
|
[diffusion] feat: Improve LoRA compatibility by adding unified format detection and diffusers-based normalization (#14659)
|
2025-12-13 16:04:36 +08:00 |
|
Sam
|
4eda4194f2
|
[Fix] Disable trtllm moe backend for draft model for a qucik fix (#15002)
|
2025-12-12 23:58:47 -08:00 |
|
Mick
|
875f84db7b
|
[diffusion] fix: use NDRotaryEmbedding in flux_2 (#15034)
|
2025-12-13 13:42:38 +08:00 |
|
Daniel Cámpora
|
f6031adf08
|
Mistral Large 3 NVFP4 support (#14485)
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Daniel Campora <961215+dcampora@users.noreply.github.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
|
2025-12-13 13:34:42 +08:00 |
|
Chunyuan WU
|
2a39cfe0ff
|
call check_quantized_moe_compatibility after initialize (#13876)
|
2025-12-13 13:32:19 +08:00 |
|
fzyzcjy
|
bf17e769fe
|
Add sgl_router_attempt_http_responses_total for single attempt information (#15037)
|
2025-12-13 13:29:18 +08:00 |
|
fzyzcjy
|
9a5d6a84ab
|
Add error code in prometheus metrics and add X-SMG-Error-Code header (#15036)
|
2025-12-13 13:28:32 +08:00 |
|
fzyzcjy
|
31c23e5fe3
|
Provide more fine grained error reason for reqwest error (#15032)
|
2025-12-13 13:27:06 +08:00 |
|
fzyzcjy
|
06617a9ec8
|
Tiny change http router response format to unify (#15031)
|
2025-12-13 13:25:45 +08:00 |
|
fzyzcjy
|
e79ca95961
|
Tiny unify grpc existing error responses into new format (#15030)
|
2025-12-13 13:25:10 +08:00 |
|
fzyzcjy
|
9d3b411c56
|
Add code field and unify error responses for router (#15028)
|
2025-12-13 13:21:34 +08:00 |
|
fzyzcjy
|
05325db349
|
Super tiny remove unused log_request (#15035)
|
2025-12-13 13:21:24 +08:00 |
|
Liangsheng Yin
|
01e3b3f3a3
|
Fix decode OOM caused by retraction (#14939)
|
2025-12-13 12:59:17 +08:00 |
|
Baizhou Zhang
|
8698867479
|
[CI]Add gb200 runner back (#15024)
|
2025-12-12 20:19:34 -08:00 |
|
Kangyan-Zhou
|
291396544e
|
Add a special label for b200 CI runner that can run kernel tests (#15033)
|
2025-12-12 19:41:36 -08:00 |
|
Shu Wang
|
665cb02003
|
Fix regression caused by fa3 block_table (#15009)
|
2025-12-12 19:11:09 -08:00 |
|
Liangsheng Yin
|
7160283800
|
Tiny remove the duplicate function in spec v2 (#14957)
|
2025-12-13 11:08:27 +08:00 |
|
Qiaolin Yu
|
77873343c4
|
tiny update: use rope kernel in sgl-kernel for amd (#14955)
|
2025-12-12 18:48:12 -08:00 |
|
Lianmin Zheng
|
267170bf1d
|
Clean up server args and engine startup processes (#15015)
|
2025-12-12 18:46:07 -08:00 |
|
fzyzcjy
|
313f59ad80
|
Add soft watchdogs to debug soft hangs (#15023)
|
2025-12-13 10:41:35 +08:00 |
|
fzyzcjy
|
487cf81a68
|
Tiny extract SchedulerWatchdog (#15021)
|
2025-12-13 10:40:32 +08:00 |
|
fzyzcjy
|
df111bc0fe
|
Super tiny add gsp-fast-prepare (#14992)
|
2025-12-13 09:45:21 +08:00 |
|
fzyzcjy
|
6d2b3324ef
|
Super tiny fix confusing slash_command_handler hint (#14976)
|
2025-12-13 09:42:50 +08:00 |
|
fzyzcjy
|
8cc77261ec
|
Super tiny remove unused argument (#14966)
|
2025-12-13 09:41:01 +08:00 |
|
Yinghai Lu
|
d143b02097
|
[registry] Add a strict mode to model registration (#14933)
|
2025-12-13 09:25:48 +08:00 |
|
Chenxi Li
|
9b9d21312a
|
Feature/Fix multi lora scheduler blocking issue and evict LoRA None lastly (#14795)
|
2025-12-12 17:13:05 -08:00 |
|
Qiaolin Yu
|
44fd701732
|
Tune triton fused moe for the case of glm-4.6-fp8 b200 tp4 (#15020)
|
2025-12-12 17:04:56 -08:00 |
|
Simo Lin
|
9a56273ad2
|
[model-gateway] refactor: unify worker management into modular workflow structure (#15010)
|
2025-12-12 15:25:35 -08:00 |
|
Lianmin Zheng
|
b737a125c5
|
Update ci permission (#15014)
|
2025-12-12 14:11:40 -08:00 |
|
Lianmin Zheng
|
1b5e903480
|
Refactor of http and engine entrypoints to allow custom override (#14869)
|
2025-12-12 12:01:08 -08:00 |
|
Ho-Ren (Jack) Chuang
|
171b442ad3
|
Add KV4-capable backend flashmla and update server args (#14989)
Signed-off-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-12 11:50:27 -08:00 |
|
Yineng Zhang
|
4b7b5af36a
|
Revert several PRs (#14958)
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
|
2025-12-12 11:25:12 -08:00 |
|
fzyzcjy
|
ec242f516e
|
Super tiny extract route_typed_request_once (#14951)
|
2025-12-12 11:10:10 -08:00 |
|
Kangyan-Zhou
|
b243154614
|
Fix CI by reverting incorrect metric check logic (#15004)
|
2025-12-12 10:07:38 -08:00 |
|
Simo Lin
|
526fd0082f
|
[model-gateway] refactor: workflow engine cleanup and minor optimization (#15001)
|
2025-12-12 09:03:28 -08:00 |
|
Simo Lin
|
56d0ad47f4
|
[model-gateway] fix: handle workflow deadlock and optimize cycle detection (#15000)
|
2025-12-12 08:53:45 -08:00 |
|
Simo Lin
|
306e5b8d0b
|
[model-gateway] feat: add DAG parallel execution support and workflow optimization (#14999)
|
2025-12-12 08:31:12 -08:00 |
|
Simo Lin
|
10c68f6236
|
[model-gateway] refactor: extract workflow engine to src/workflow module (#14996)
|
2025-12-12 06:29:12 -08:00 |
|
Mick
|
c7c837cd1d
|
Update CODEOWNERS for multimodal_gen (#14995)
|
2025-12-12 22:08:16 +08:00 |
|
Xiaoyu Zhang
|
3e1e71575c
|
[diffusion] docker: Tiny fix Docker Hub link in installation documentation (#14987)
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
|
2025-12-12 20:25:36 +08:00 |
|
Kevin Li
|
8fa8d9d7e8
|
[PD] Add decode PP event loop for PD disaggregation (#14945)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>
|
2025-12-12 20:15:00 +08:00 |
|
Shangming Cai
|
c8cf1cafdb
|
[1/N] Update doc of Pipeline Parallelism (#14985)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: alpha-baby <fujianhao1997@qq.com>
|
2025-12-12 19:32:52 +08:00 |
|
DefTruth
|
d71baa72dc
|
[diffusion] dependency: upgrade cache-dit for better compatibility (#14534)
|
2025-12-12 18:52:58 +08:00 |
|
Mick
|
82e33170e1
|
[diffusion] chore: minor code cleanups and improve logging (#14916)
|
2025-12-12 18:48:07 +08:00 |
|
gongwei-130
|
94e1251131
|
enable flashinfer-jit-cache in image build and ci install to speed up model launch (#14959)
|
2025-12-11 23:20:44 -08:00 |
|
Zaili Wang
|
4dabfbc827
|
[Fix] suppress remote weight loading engine w/o mooncake installed (#14937)
|
2025-12-11 23:12:26 -08:00 |
|
Sam
|
d7ed8a8c24
|
[NVIDIA] Enable TRTLLM BF16 MoE on Blackwell GPUs (#13798)
|
2025-12-11 22:56:13 -08:00 |
|
ZhengdQin
|
c05d3afb5d
|
[NPU] optimization for dsv3.2 (#14572)
|
2025-12-12 14:52:16 +08:00 |
|
fzyzcjy
|
edb172e927
|
Super tiny refactor error.rs logic (#14949)
|
2025-12-12 14:48:18 +08:00 |
|
b8zhong
|
fe6d38d2fa
|
fix: trtllm mha attention auto-selection on sm120 (#14842)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-11 22:35:25 -08:00 |
|