Commit Graph

10639 Commits

Author SHA1 Message Date
Jason Yao
4dbec2dd2b [typo] Fix typos in comments and log messages in common.py (#20723) 2026-03-16 19:26:59 -07:00
Qiaolin Yu
7d87a6a071 Fix spec v1 token_ids_logprobs (#20718) 2026-03-16 19:23:28 -07:00
Mick
474a851ae3 [diffusion] fix: fix sampling params incorrectly override in cli (#20689) 2026-03-17 08:48:10 +08:00
Mick
1eea744855 [diffusion] CI: enable UT (#20690) 2026-03-17 07:44:04 +08:00
Yuhao Yang
2ccdb7373e [diffusion] CI: fix consistency test workflow (#20704) 2026-03-17 07:42:30 +08:00
Baizhou Zhang
826eb21bca Fix sglang-kernel dependency on CI runners (#20715) 2026-03-16 15:23:01 -07:00
roikoren755
5ef5806160 [Nemotron] Small reasoning parser fix (#20284) 2026-03-16 13:29:40 -07:00
Bruce Wu
70a6fb53af Enable embedding lookup/lora_a logic for chunked backend (#17692)
Co-authored-by: Bruce Wu <mogicianwu@fb.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Ethan (Yusheng) Su <yushengsu.thu@gmail.com>
2026-03-16 11:37:58 -07:00
Douglas Yang
061ec582bf fix: adding teacache.params back to sampling params as intended (#20665) 2026-03-16 11:27:06 -07:00
Shangming Cai
a4528a5737 [CI] Bring back CI test for Mamba PD Disaggregation (#20675) 2026-03-17 01:04:21 +08:00
ybyang
289cbcf482 fix: support PP2+CP8+TP8 (PP with context parallelism) (#19548) 2026-03-16 16:51:47 +00:00
Xiaoyu Zhang
6489f77733 [Diffusion] Fix compile graph broken by flashinfer rope (#20699) 2026-03-16 23:14:27 +08:00
Du Bin
d3c0f4376a Fix AssertionError crash in disagg prefill inflight queue with PP (#20686) 2026-03-16 22:38:59 +08:00
Xiaoyu Zhang
15097c5c3b Release sglang kernel 0.4.0 (#20440)
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-03-16 20:34:58 +08:00
sky
3d58cd16d9 [DP Attention] Optimize dp_padding_mode selection for dp_size=1 in extend mode (#20406)
Signed-off-by: wangfakang <fakangwang@gmail.com>
2026-03-16 18:44:42 +08:00
Xun Sun
549fbcc864 [5/N] (Elastic EP) Use GPU P2P to exchange expert weights during EPLB as much as possible (#12068)
Co-authored-by: Hank Han <hanhan.hank@bytedance.com>
Co-authored-by: Hank Han <hanhan7630@outlook.com>
2026-03-16 18:40:58 +08:00
Xiaoyu Zhang
3055b6906d [Diffusion] Document torch.compile graph-break checks in diffusion benchmark skills (#20681) 2026-03-16 17:41:40 +08:00
Mick
485597e651 [diffusion] fix: fix some sampling args passed via cli are omitted (#20630) 2026-03-16 16:55:30 +08:00
Sugar920
895e56097c Add NPU basic function testcases (#19382)
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: Cherry_ming <136634645@qq.com>
2026-03-16 15:09:56 +08:00
Baizhou Zhang
e96a3752a0 Update timeout for some ci tests (#20664) 2026-03-15 23:58:30 -07:00
shuwenn
42f18fe560 [HiCache] fix: release write-through lock_ref during decode (#20049) 2026-03-16 14:49:31 +08:00
Ke Bao
39336f5812 Precompute swa cache location (#20449) 2026-03-16 14:38:08 +08:00
Zheng Wengang
135af6dc92 [EPD][VLM] support video/audio input (#17824)
Co-authored-by: siyu <liusy58@linux.alibaba.com>
2026-03-16 14:18:21 +08:00
Shangming Cai
738cbde902 [PD] Make pending reqs resolving more robust (#20505)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-03-16 14:12:13 +08:00
YC Yen-Ching Tseng
a92872cbc3 [AMD] CI - skip tests on mi325 (#20660)
Co-authored-by: bingxche <bingxche@amd.com>
2026-03-16 13:35:04 +08:00
Roopak Srivastava
223a4e485b [test] Fix bfloat16 tolerance in test_selective_state_update (#20345) 2026-03-15 21:02:01 -07:00
pansicheng
97b2a89334 [RadixTree][8/N Refactor]: unify lock interface (#20330) 2026-03-16 11:49:51 +08:00
Liangsheng Yin
f0458e0b49 [Utils] Move network/socket utilities from common.py to network.py (#20646) 2026-03-15 20:35:24 -07:00
Javier Torres
afc71bae3a feat: Add 'none' reasoning effort to ChatCompletionRequest (#20556) 2026-03-15 20:25:48 -07:00
amote-i
da1793f63a update ascend feature docs (#20506) 2026-03-15 20:09:20 -07:00
gaopengff
f4393bf3f6 Fix correctness test issue for bench_one_batch (#20650) 2026-03-15 20:05:36 -07:00
Xiaoyu Zhang
e1eb25880f [Diffusion] Add a benchmark for rmsnorm/fuse_add_rmsnorm (#20632) 2026-03-16 09:50:33 +08:00
AnonTokyo
e9fae69e5f docs: align environment variable reference with environ defaults (#20419) 2026-03-15 18:07:29 -07:00
Mohammad Miadh Angkad
3879c466b4 [CI] Add Nemotron 3 Super 120B nightly 8-GPU tests (#20616) 2026-03-15 18:03:20 -07:00
Zhirui
35c249b4de [OpenAI] Log raw request payload for --log-requests (#20605) 2026-03-15 17:45:00 -07:00
Liangsheng Yin
d852f26cb6 Fix dual-stack socket handling: IPV6_V6ONLY, IPv4-first, is_port_available all-family check (#20643) 2026-03-15 17:17:23 -07:00
Teng Ma
7c498a6538 [DOC] add documents for encoder global mm cache (#20636) 2026-03-15 16:44:21 -07:00
Liangsheng Yin
c2245d9b55 ci: add runner dropdown to rerun-ut workflow dispatch (#20645)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
2026-03-15 16:40:14 -07:00
jellysnack
53f831691a fix: propagate grammar errors and improve llguidance backend (#20467) 2026-03-15 16:11:18 -07:00
Liangsheng Yin
116aef8504 [Test] Move embedding tests into test/registered/embedding/ and unit/ (#20642) 2026-03-15 14:48:43 -07:00
psaab
1145805e7d Fix socket utilities and reserve_port for IPv6 dual-stack support (#20491)
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
2026-03-15 14:29:10 -07:00
Liangsheng Yin
8397a8a301 [CI] Extract wait-for-jobs composite action and gate on stage-a-cpu-only (#20641) 2026-03-15 13:52:48 -07:00
Mook
23c191afb6 fix(docs): correct quantization documentation (#20301) (#20619) 2026-03-15 12:33:12 -04:00
Ke Bao
c3483e8e97 [CI] Move existing unit tests into unit directory (#20631) 2026-03-15 23:25:18 +08:00
Ke Bao
e2be31824f [CI] Add ut coverage tool (#20628) 2026-03-15 21:13:45 +08:00
Xiaoyu Zhang
45dd06f4e0 Remove insecure auto-format label workflow (#20629) 2026-03-15 21:04:29 +08:00
Ke Bao
0cff070828 [CI] Add READMEs for unit test directory structure (#20626) 2026-03-15 20:27:05 +08:00
hzh0425
7142a594f9 [CI]: Add CI For HiMambaRadixTree and qwen3.5 (#20540)
Co-authored-by: ispobock <ispobaoke@gmail.com>
2026-03-15 20:16:12 +08:00
Yuhao Yang
1c456a0af5 VLM: add Conv2dLayer/Conv3dLayer to fix PyTorch 2.9.1 CuDNN Conv3d (#20282)
Co-authored-by: wili-65535 <wili-65535@users.noreply.github.com>
2026-03-15 19:17:44 +08:00
Mick
f07529b947 [diffusion] CI: use dedicated HF token for accessing restricted models (#20620) 2026-03-15 19:15:28 +08:00