Mick
|
d881f31488
|
[diffusion] chore: temporarily upgrade diffusers to make Z-image compatible with Cache-DiT (#14530)
|
2025-12-06 12:39:37 +08:00 |
|
Vincent Zhong
|
2ac5b98395
|
fix: fix rmsnorm -> layernorm in qwen3 omni (#11791)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
|
2025-12-06 12:12:57 +08:00 |
|
Hanming Lu
|
a0dde90af6
|
[CODEOWNER] update codeowner for qwen3-next related (#14522)
|
2025-12-05 16:15:10 -08:00 |
|
Alison Shao
|
b988c18eae
|
Fix safetensors validation to catch corruption after download (#14465)
|
2025-12-05 16:04:00 -08:00 |
|
Alison Shao
|
e41664ba1a
|
[Docs] Add /rerun-stage command to contribution guide (#14521)
|
2025-12-05 15:46:47 -08:00 |
|
fzyzcjy
|
3d1b591aa1
|
Tiny use trtllm_mha as default when possible (#14291)
|
2025-12-05 14:26:03 -08:00 |
|
sglang-bot
|
e11f795f63
|
chore: bump sgl-kernel version to 0.3.18.post3 (#14427)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2025-12-05 14:09:02 -08:00 |
|
Simo Lin
|
959a17466d
|
[model-gateway] fix code owner for wasm (#14516)
|
2025-12-05 13:48:25 -08:00 |
|
Simo Lin
|
b72f0268c7
|
[model-gateway] fix left over sgl-router names in wasm (#14514)
|
2025-12-05 13:16:58 -08:00 |
|
Simo Lin
|
09376fd738
|
[model-gateway] fix logs in smg workflow (#14513)
|
2025-12-05 12:50:50 -08:00 |
|
Simo Lin
|
aed835e32d
|
[model-gateway] fix left over sgl-router names to sgl-model-gateway (#14512)
|
2025-12-05 12:41:48 -08:00 |
|
Simo Lin
|
49dfa1d891
|
[model-gateway] change sgl-router to sgl-model-gateway (#14312)
|
2025-12-05 12:04:48 -08:00 |
|
Wenyi Xu
|
1ea6b740a7
|
[model-gateway] Make Tokenizer Builder Aware of Env Vars Like HF_ENDPOINT (#14405)
|
2025-12-05 10:42:06 -08:00 |
|
fzyzcjy
|
e73173b0d7
|
Fix removing worker will make it healthy forever in prometheus metrics (#14420)
|
2025-12-05 10:40:42 -08:00 |
|
Alison Shao
|
16e8463a90
|
Add Mistral Large 3 basic test to PR CI (#14460)
|
2025-12-05 10:38:52 -08:00 |
|
Simo Lin
|
cf9a774cf8
|
[model-gateway] fix server info comment (#14508)
|
2025-12-05 10:09:58 -08:00 |
|
b8zhong
|
ec7b2c16d9
|
tiny remove deprecated endpoint call (#13607)
|
2025-12-05 09:54:49 -08:00 |
|
Simo Lin
|
1569fc7f49
|
[model-gateway] reorganized conversation handler (#14507)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 09:31:27 -08:00 |
|
Tony Lu
|
5a46fb153d
|
[model-gateway] Add WASM support for middleware (#12471)
Signed-off-by: Tony Lu <tonylu@linux.alibaba.com>
|
2025-12-05 09:29:07 -08:00 |
|
Hudson Xing
|
38daa29466
|
Add fused FP8 KV cache write kernel for TRTLLM MHA backend (#14093)
Co-authored-by: Qiaolin Yu <liin1211@outlook.com>
|
2025-12-06 00:53:55 +08:00 |
|
blahblah
|
66984a8b3d
|
[diffusion] feat: support cache-dit integration (#14234)
Co-authored-by: shuxiguo <shuxiguo@meituan.com>
Co-authored-by: DefTruth <qiustudent_r@163.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-06 00:52:22 +08:00 |
|
roikoren755
|
889b46ea50
|
[Spec] Mamba2 support in target models (#13434)
|
2025-12-06 00:50:46 +08:00 |
|
Simo Lin
|
05284378d6
|
[model-gateway] move conversation to first class routing (#14506)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-05 08:44:13 -08:00 |
|
Mick
|
a89045603b
|
[diffusion] chore: set allowing overriding protected fields of sampling params as default behavior (#14471)
|
2025-12-06 00:22:42 +08:00 |
|
Alison Shao
|
662809874c
|
Add Mistral Large 3 to nightly CI tests (#14459)
|
2025-12-05 23:16:27 +08:00 |
|
elvischenv
|
205f041e96
|
Add Mistral Large 3 Eagle Support (#14466)
Co-authored-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
|
2025-12-05 23:11:41 +08:00 |
|
Simo Lin
|
7235a7fbe9
|
[misc] add model arch and type to server info and use it for harmony (#14456)
|
2025-12-05 06:51:00 -08:00 |
|
Yuxuan Zhang
|
8fce9e7b2a
|
support GLM-V vision model dp (#14097)
|
2025-12-05 21:03:54 +08:00 |
|
Xiaoyu Zhang
|
5347732219
|
[diffusion] fix: Fix profiler trace missing Python stack in diffusion pipeline (#14499)
|
2025-12-05 12:12:35 +00:00 |
|
roikoren755
|
2ce121a1c3
|
Enable RadixCache for Mamba2 models (#13584)
|
2025-12-05 18:23:58 +08:00 |
|
WenhaoZhang
|
35ba6fe19e
|
[diffusion] fix: fix CLIP text encoder attention mask not used (#14364)
Co-authored-by: niehen6174 <niehen.6174@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-05 16:30:10 +08:00 |
|
ishandhanani
|
498ea41ca6
|
dockerfile: add runtime stage + ubuntu 24.04 (#13861)
|
2025-12-05 00:28:36 -08:00 |
|
GMI Xiao Jin
|
7c744d137d
|
[diffusion] cli: add argument --adjust-frames and --override-protected-fields (#13996)
Co-authored-by: dev <devnull@example.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2025-12-05 15:32:06 +08:00 |
|
zyksir
|
46b05ef58f
|
[diffusion] fix: fix bug about pin memory when offloading (#14472)
|
2025-12-05 15:26:30 +08:00 |
|
Mick
|
beec8eed6a
|
[diffusion] chore: further improve model searching logic (#14484)
|
2025-12-05 15:04:55 +08:00 |
|
Minglei Zhu
|
b76e303e6a
|
clean up gemlite usage (#14444)
|
2025-12-04 21:52:56 -08:00 |
|
Baizhou Zhang
|
80a575e4e8
|
Add YAMY1234 to CI Permission (#14475)
|
2025-12-04 21:25:49 -08:00 |
|
Alison Shao
|
4c5074eb78
|
Add AMD stage support to /rerun-stage command and fix related bugs (#14463)
|
2025-12-04 21:13:52 -08:00 |
|
Yinghai Lu
|
41429a8c10
|
[ez] Fix typing (#14473)
|
2025-12-05 12:23:13 +08:00 |
|
Alison Shao
|
532037df78
|
Add CI permissions for user 'yushengsu-thu' (#14468)
|
2025-12-04 19:01:50 -08:00 |
|
zyksir
|
fa0ca97694
|
[diffusion] improve: further optimize model load (#13836)
|
2025-12-05 10:45:20 +08:00 |
|
sglang-bot
|
b5d3998508
|
Rename secrets.WHL_TOKEN -> secrets.GH_PAT_FOR_WHL_RELEASE (#14421)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
|
2025-12-04 18:24:54 -08:00 |
|
Junrong Lin
|
2ecee7571c
|
[Bug] fix not desired disable fused share experts caused by rocm logic (#14432)
|
2025-12-05 09:55:07 +08:00 |
|
Xinyuan Tong
|
6d37e70883
|
ministral3 (#14251)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Yueming Yuan <yy28@illinois.edu>
|
2025-12-04 14:31:26 -08:00 |
|
Simo Lin
|
c1006fd8a1
|
[model-gateway] grpc to leverage event type (#14450)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 14:30:19 -08:00 |
|
Simo Lin
|
29c6c2ea9d
|
[model-gateway] add mistral 3 image processor (#14445)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
|
2025-12-04 13:16:04 -08:00 |
|
Simo Lin
|
eb85fa6daf
|
[model-gateway] move all responses api event from oai to proto (#14446)
Co-authored-by: key4ng <rukeyang@gmail.com>
|
2025-12-04 13:11:03 -08:00 |
|
Kay Yan
|
0e6441b434
|
fix: Correct environment variable syntax in docker-compose configuration (#8287)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>
|
2025-12-04 13:03:39 -08:00 |
|
b8zhong
|
88d1bab537
|
add doc for quantized kv cache (#14348)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
Co-authored-by: Ho-Ren (Jack) Chuang <horenchuang@bytedance.com>
|
2025-12-04 13:01:05 -08:00 |
|
Sam
|
922756aaa1
|
[FIX] trtllm-moe-fp4-renorm for Qwen series models (#14350)
|
2025-12-04 12:52:21 -08:00 |
|