Stefan He
b6312e62ea
Update CODEOWNERS for layer and executor files ( #14020 )
2025-11-26 12:59:04 -08:00
Kangyan-Zhou
779cbc6e4b
Fix Nvidia nightly test trigger params when it is triggered by parent workflow ( #13966 )
2025-11-26 12:01:48 -08:00
Wenyi Xu
67c8c86722
[model-gateway][doc] Update transport terminology to protocol in README.md ( #13872 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:44:59 -08:00
Simo Lin
69a03bc3f7
[ci] allow manual label to trigger ci in rust, change ci order ( #14016 )
2025-11-26 11:38:50 -08:00
Chang Su
66f242b98f
[model gateway][grpc] Add tojson filter to override minijinja's tojson ( #14013 )
...
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
2025-11-26 11:05:01 -08:00
Baizhou Zhang
8a9b8b8457
Revert "Fix nightly test failures: NSA indexer dtype and CPP radix cache init" ( #14015 )
2025-11-26 10:45:23 -08:00
Simo Lin
7e964b5198
[ci] mark skip as success instead of failure ( #14014 )
2025-11-26 10:39:38 -08:00
Simo Lin
a0d9f6cdd8
[model-gateway] fix xpu ci ( #14012 )
2025-11-26 10:33:59 -08:00
Netanel Haber
8308cd3632
Support internvl on Blackwell (which doesn't support fa3): add SingletonCache support to Vision{Sdpa|Triton|Ascend}Attention ( #13151 )
2025-11-26 10:31:45 -08:00
Da Chen
e0e8a99630
fix: correct usage of minimax-m2 deepep moe forward ( #13892 )
...
Co-authored-by: Dash <dash@minimaxi.com >
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com >
2025-11-26 10:01:23 -08:00
Mick
5102d00901
[diffusion] model: support black-forest-labs/FLUX.2-dev ( #14000 )
2025-11-27 01:49:40 +08:00
Liangsheng Yin
0dd759e087
Put pr-gate after check-changes ( #14009 )
2025-11-27 01:40:16 +08:00
Wenyi Xu
5e70880e64
[model-gateway] Add PostgreSQL support to binding ( #13766 )
...
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Simo Lin <linsimo.mark@gmail.com >
Co-authored-by: Chang Su <chang.s.su@oracle.com >
2025-11-26 09:11:13 -08:00
Vedant V Jhaveri
9dab534b35
fix spec dec request level metrics ( #13754 )
...
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com >
2025-11-27 01:09:21 +08:00
Michelle Wu
262c3c1fde
[Ascend] Support enable-mixed-chunk in non-MLA scenarios ( #12491 )
...
Co-authored-by: ronnie_zheng <zl19940307@163.com >
2025-11-27 00:00:21 +08:00
Liangsheng Yin
6c190cbda0
Rename: --hooks to --forward-hooks ( #13994 )
2025-11-26 22:26:28 +08:00
Liangsheng Yin
eff6a07c8f
Fix get_load API ( #13991 )
2025-11-26 22:07:51 +08:00
Shangming Cai
b704b0a922
Optimize uneven PP layer distribution logic to improve PP performance ( #13977 )
2025-11-26 22:05:03 +08:00
vipwangerxiao
15729dbc8e
Use dynamically maintained num_waiting_tokens in get_load() ( #13203 )
...
Signed-off-by: Peng Wang <peng_wang@linux.alibaba.com >
Co-authored-by: Peng Wang <peng_wang@linux.alibaba.com >
2025-11-26 20:34:45 +08:00
Zehuan Li
21b0582d4b
[feature] Initial block diffusion language model support ( #12588 )
...
Co-authored-by: Tiwei Bie <tiwei.btw@antgroup.com >
2025-11-26 17:57:54 +08:00
Yuhao Yang
5795da5e83
[diffusion] fix: fix the issue where the qwen-edit & wan model produces incorrect output during sequence parallelism ( #13922 )
2025-11-26 15:58:23 +08:00
StonyPort
540d6fee20
Support piecewise CUDA graph for embedding models ( #13852 )
...
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com >
2025-11-26 15:29:46 +08:00
Thomas Wang
5a8adca900
Turn off PREBUILD aiter in MI355 ( #13963 )
2025-11-25 22:30:39 -08:00
ShawnY112358
007c3e234c
[feat] support in-flight weight update ( #10071 )
...
Co-authored-by: 赵晨阳 <zhaochen20@outlook.com >
2025-11-25 22:03:13 -08:00
fzyzcjy
7130ad3a29
Fix SGLANG_ENABLE_HEALTH_ENDPOINT_GENERATION not working ( #13961 )
2025-11-25 21:58:55 -08:00
Zaili Wang
35a4c21a8a
update CI permission list ( #13962 )
2025-11-25 20:16:44 -08:00
alisonshao
846ba3c62c
Fix nightly test failures: NSA indexer dtype and CPP radix cache init ( #13958 )
2025-11-26 11:52:08 +08:00
Yubo Wang
18fb51583f
Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode ( #7725 )
2025-11-26 11:44:41 +08:00
Yuan Luo
ca5c8b16f6
[VLM] Support InternVL Vision Encoder Data Parallelism ( #13925 )
...
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com >
2025-11-26 11:43:05 +08:00
timmy-feng
f33e5d1ef1
fix: spec overlap predict shape does not match verify output shapes ( #12786 )
2025-11-26 11:01:06 +08:00
Kangyan-Zhou
13e5beeab4
Fix Deepseek v3.1 loading issue ( #13954 )
2025-11-25 18:28:52 -08:00
sglang-bot
c53e729d45
chore: bump sgl-kernel version to 0.3.18.post1 ( #13951 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2025-11-25 18:14:28 -08:00
Kangyan-Zhou
03a26557b7
Fix nightly-test-nvidia.yml to have the correct trigger ( #13950 )
2025-11-25 17:34:34 -08:00
Baizhou Zhang
873382a910
[Tiny]Upgrade README for sgl-kernel ( #13945 )
2025-11-25 16:46:30 -08:00
sglang-bot
391a863b3f
chore: bump sgl-kernel version to 0.3.18.post1 ( #13942 )
...
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com >
2025-11-25 15:31:53 -08:00
Fan Yin
36b1bcd242
[chore] update torch version to 2.9 ( #12969 )
...
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com >
2025-11-25 14:47:34 -08:00
fzyzcjy
64a11303ce
Fix update weight error for blackwell DeepGEMM ( #13910 )
2025-11-25 13:28:12 -08:00
Lianmin Zheng
1ab6ce0e62
[Auto Sync] Improve profilers and simplify bench_one_batch_server.py ( #13866 )
2025-11-25 12:13:31 -08:00
Kangyan-Zhou
e99ca6ac74
Improve nightly tests ( #13903 )
2025-11-25 12:04:49 -08:00
Jan Bernlöhr
fcccaf9001
Add Llama4 attention backend auto-selection ( #13421 )
...
Signed-off-by: jbernloehr <jbernloehr@nvidia.com >
2025-11-25 11:54:21 -08:00
Tova Movshovitz
215a97fa6c
Fix docstrings for v1 HiCacheStorage methods ( #13851 )
2025-11-25 11:48:26 -08:00
YAMY
5eed5fc0b0
[DeepSeekV3.2] Centralize NSA dispatch logic in NativeSparseAttnBackend ( #13544 )
...
Co-authored-by: hlu1 <14827759+hlu1@users.noreply.github.com >
2025-11-25 11:32:30 -08:00
Baizhou Zhang
808b6dfdea
[Minor] Fix lint ( #13938 )
2025-11-25 10:57:23 -08:00
Simo Lin
4852aa054c
[misc] add llama3.1 chat template ( #13935 )
2025-11-25 09:31:54 -08:00
Zaili Wang
f922bfd520
[CPU] Apply PR gating rule in CI workflow ( #13933 )
2025-11-26 00:44:16 +08:00
Mick
dfd7ab9682
[diffusion] feat: support LoRA ( #13859 )
2025-11-26 00:21:33 +08:00
Mick
46673b4224
[diffusion] doc: add doc for LoRA usage ( #13931 )
2025-11-26 00:02:14 +08:00
Liangsheng Yin
3421d049aa
[CI] rename: per_commit -> registered ( #13928 )
2025-11-25 23:05:06 +08:00
Liangsheng Yin
d3d404d3d7
[CI] CI registry update ( #13927 )
...
Co-authored-by: alisonshao <54658187+alisonshao@users.noreply.github.com >
2025-11-25 22:43:19 +08:00
luchangli
64225a8ae9
fix nixl prefill crash make decode health check failed ( #13657 )
...
Signed-off-by: liluchang <liluchang@kingsoft.com >
2025-11-25 21:40:11 +08:00
