Commit Graph

9885 Commits

Author SHA1 Message Date
Xiaoyu Zhang
5a5cece561 [Diffusion] clean useless and buggy set_seq_parallel_pg in yunchang (#16669) 2026-01-08 11:08:34 +08:00
Teng Ma
d566739b65 Add sufeng-buaa into CI_PERMISSION (#16625)
Signed-off-by: Teng Ma <teng-ma@linux.alibaba.com>
2026-01-08 11:01:32 +08:00
Simo Lin
4c46ecde80 [smg][ci] delete old responses api ci (#16695) 2026-01-07 18:24:12 -08:00
hlu1
12a0292bfd Revert "[sgl-kernel] Update flashmla to include fp8 sparse_mla optimizations" (#16678) 2026-01-08 10:23:06 +08:00
Simo Lin
a08dc5aa10 [smg][ci] rename 3rd models from cloud backend and delete dead code (#16692) 2026-01-07 18:19:44 -08:00
Junrong Lin
eec7dbd31e remove redundant max_running_reqs calculation in r3 (#16629) 2026-01-08 09:45:21 +08:00
Simo Lin
109fe03ad1 [smg][ci] Migrate Response API e2e tests to shared infrastructure (#16680)
Co-authored-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: key4ng <rukeyang@gmail.com>
2026-01-07 17:40:03 -08:00
Changyi Yang
bb798a1c26 [diffusion] fix: reduce default text length for Qwen-Image from 1024 to 512 (#16445) 2026-01-08 09:32:21 +08:00
Baizhou Zhang
38dc5839dd [1/n]deepseek_v2.py Refactor: attention backend handlers and forward method definition (#16306) 2026-01-08 09:22:31 +08:00
Hexq0210
5e867f60cf [NPU] Update model and features supported (#16652) 2026-01-08 09:13:30 +08:00
gongwei-130
65bed8382b Add google-cloud-storage into Dockerfile (#15343) 2026-01-07 16:54:45 -08:00
Harish
156d97b219 Fix KeyError when logprobs=false in completions endpoint (#16095) 2026-01-07 15:49:02 -08:00
b8zhong
24b30f7757 MoE Refactor: Refactor fp8.py -> flashinfer_trllm.py (#15151)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2026-01-07 15:35:00 -08:00
Alison Shao
3a4767daa3 Fix pytest tests to exit with proper exit code (#16681) 2026-01-07 15:20:46 -08:00
Simo Lin
6037267f5b [smg][ci] Add thread safety to ModelPool and GPUAllocator (#16674) 2026-01-07 13:25:41 -08:00
Alison Shao
0241e0460f Migrate tokenizer tests to test/registered/tokenizer/ (#16457) 2026-01-07 13:21:16 -08:00
Alison Shao
0c474273c5 Fix gpt_oss_common import path and migrate core tests (#16426) 2026-01-07 12:58:32 -08:00
Michael
3e73e12458 Revert "Add SwapAB Optimization for triton fused_moe_kernel on SM90." (#16676) 2026-01-07 11:24:47 -08:00
Douglas Yang
f4742558ac fix: 8-gpu-b200 increase timeout length (#16658) 2026-01-07 09:45:55 -08:00
Simo Lin
7385834c8d Add reference counting to ModelInstance for parallel test safety (#16672) 2026-01-07 08:28:15 -08:00
Ziwen Zhao
b5a94f8a8e [model-gateway] Fix IGW routing for external OpenAI workers (#16633) 2026-01-07 08:15:23 -08:00
Simo Lin
c356ed03dd refactor(e2e): unify RouterInstance into Gateway class, split conftest.py into modular fixtures (#16671) 2026-01-07 07:50:28 -08:00
Insideyyy
ee4d2287ab Add SwapAB Optimization for triton fused_moe_kernel on SM90. (#15712) 2026-01-07 23:45:35 +08:00
Baizhou Zhang
153c69f63d [CI] Enable dpsk v31 test on nightly H200 (#16660) 2026-01-07 23:21:19 +08:00
Simo Lin
55b7936582 refactor(e2e_test): fix smg ci e2e test code quality (#16664) 2026-01-07 06:59:49 -08:00
Yi Zhang
7fc12e0bfa support page size large than 64 for mamba radix cache (#16657)
Co-authored-by: Hanming Lu <hanming@x.ai>
2026-01-07 22:52:24 +08:00
Simo Lin
8729ad5e6c fix(e2e_test): remove dead code and fix type annotations (#16661) 2026-01-07 06:35:15 -08:00
Simo Lin
e432057381 [smg][ci] preserve model launch order with test collected (#16618) 2026-01-07 06:16:59 -08:00
Li Jinliang
4d902c8211 [diffusion] bench: upgrade multimodal benchmarks for diverse applications and create a prettier, more intuitive logger. (#16179) 2026-01-07 22:10:23 +08:00
Douglas Yang
2ff872311b ci: adding llama4 placeholder test to nightly (#16599) 2026-01-07 21:51:30 +08:00
JiLi
fd16c91cb8 Handle Marlin weight restoration and shape recording (QAT INT4 Rollout Part1) (#15238)
Co-authored-by: Gao016 <yngao016@163.com>
Co-authored-by: yefei12 <xjtu_yefeichen@163.com>
Co-authored-by: yzlnew <yzlnew@gmail.com>
Co-authored-by: Peng Zhang <aniz1905@gmail.com>
2026-01-07 21:11:24 +08:00
Xiaoyu Zhang
32a6540afc [Diffusion] Fix Ulysses/Ring process group construction under TP to enable correct Wan2.2 tensor parallelism (#16532)
Co-authored-by: Mick <mickjagger19@icloud.com>
2026-01-07 20:52:36 +08:00
Xiaoyu Zhang
62d0280f62 Tiny fix readme (#16654) 2026-01-07 20:41:07 +08:00
Even Zhou
d4b717c01e [NPU] update docs (#16651) 2026-01-07 20:20:01 +08:00
Hudson Xing
98a107d491 Re-enable temp_prefill_info assertion after pairing fix (#16203) 2026-01-07 18:05:17 +08:00
Hubert Lu
b86bbf841e [AMD] Add 8-GPU MX35X test running DSR1-MXFP4 model for AMD CI (#13602) 2026-01-07 01:43:11 -08:00
YC Tseng
48381c3b6d [AMD] suppress warning for amd (#16620) 2026-01-07 01:37:40 -08:00
YC Tseng
8bce085321 [AMD] CI - add 2 pp test cases to performance-test-2-gpu-amd (#16514) 2026-01-06 23:52:46 -08:00
Alison Shao
6b8a9d7058 fix: update AMD CI estimated time for test_torch_compile (#16631) 2026-01-06 23:42:18 -08:00
Shangming Cai
973116e6bb [Doc] Optimize pipeline parallelism doc (#16630)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-01-07 14:52:42 +08:00
Thomas Wang
820e97d6c9 Upgrade aiter version (#16619) 2026-01-06 22:20:42 -08:00
Minglei Zhu
4c85f9d039 Only allocate encoder metadata for encoder-decoder models (#16527) 2026-01-06 22:17:04 -08:00
Baizhou Zhang
7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
Douglas Yang
5c04088b3a fix: remove performance testing from nightly dpsk v32 cp single node (#16582) 2026-01-07 13:38:31 +08:00
Chi McIsaac
f066036c8b [diffusion] fix: fix ZImage SP sharding for 5D latents and unpad frames (#16418)
Signed-off-by: Chi <chixie.mcisaac@gmail.com>
2026-01-07 13:24:04 +08:00
Alison Shao
52de807dd7 Migrate profiling tests to test/registered/profiling/ (#16459) 2026-01-06 21:04:48 -08:00
Alison Shao
70933f34f1 Migrate attention unit tests to test/registered/attention/ (#16465) 2026-01-06 20:50:54 -08:00
Alison Shao
ce453fa43b Migrate backends tests to CI registration system (#16468) 2026-01-06 20:31:52 -08:00
fzyzcjy
3be1e734ee [model-gateway] extract header extraction in policy and add (#16566) 2026-01-06 20:18:44 -08:00
Alison Shao
38895a0064 ci: adjust partition counts for stage-b and unit tests (#16617) 2026-01-06 20:18:10 -08:00