Commit Graph
9976 Commits
Author SHA1 Message Date
jacky.chengandyichiche@amd.com <jacky.cheng> e138f7960a [AMD] Fix accuracy while using --enable-dp-attention (#19247)
Co-authored-by: yichiche@amd.com <jacky.cheng>
2026-02-24 20:50:28 -08:00
Liangsheng YinandCursor ab0f608788 [PD-Disagg] Fix bootstrap server race condition when prefill workers not yet registered (#19288)
Co-authored-by: Cursor <cursoragent@cursor.com>
2026-02-24 20:22:16 -08:00
Liangsheng YinandRatish P 539f772f54 [PD-Disagg] Fully support external DP dispatch w/ PD-disaggregation mode. (#19268)
Co-authored-by: Ratish P <114130421+ratish1@users.noreply.github.com>
2026-02-24 19:58:01 -08:00
Mick 241ee90164 [diffusion] chore: tiny fix pyproject.toml (#19256) 2026-02-25 11:57:53 +08:00
Xiaoyu Zhang 694924b878 Update .gitignore to remove '.claude/' (#19296) 2026-02-25 11:51:50 +08:00
Michael 23adb50751 [AMD] [GLM-5 Day 0] Add GLM-5 nightly test (#18911) 2026-02-24 19:39:17 -08:00
Feng Su 1dae3e32b9 update code owners for observability (#19294) 2026-02-24 19:26:41 -08:00
Alison Shao f862214c67 ci: temporarily disable GB200 test stage (#19289) 2026-02-24 19:04:23 -08:00
Shangming Cai 0fac2796b6 [PD-Disagg] Improve KVManager init across all backends (#19240)
Signed-off-by: Shangming Cai <csmthu@gmail.com>
2026-02-25 10:37:09 +08:00
siyu c0fdfd4b92 Delete mm.feature after decode phase (#17324) 2026-02-24 18:13:03 -08:00
Xiaoyu Zhang 9dff933164 [Kernel Slimming] Remove sgl-kernel AOT marlin kernels (#19241) 2026-02-25 10:08:22 +08:00
Feng Su 3b89302277 Refactor: observability code cleanup (#17862)
Signed-off-by: Feng Su <sufeng@linux.alibaba.com>
2026-02-24 18:07:29 -08:00
245430eaac Encoder Global Cache Manager (#16137)
Co-authored-by: Zheng Wengang <zwg0606@gmail.com>
Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>
2026-02-24 18:05:43 -08:00
fzyzcjy b7af58b9af Support replication axis in dump comparator (#19282) 2026-02-25 09:48:43 +08:00
fzyzcjy 2e2b18e870 Support context parallel zigzag reordering in dump comparator (#19281) 2026-02-25 09:46:17 +08:00
fzyzcjy 0de1f4b07b Support multi axis unsharding in dump comparator (#19280) 2026-02-25 09:44:07 +08:00
fzyzcjy 4bb678f28a Full test coverage in dump comparator (#19279) 2026-02-25 09:43:29 +08:00
fzyzcjy 94ca2ac5d7 Support TP unification and enhance tests in dump comparator (#19278) 2026-02-25 09:42:56 +08:00
fzyzcjy 39ba9b5ab5 Support simple unsharding in dumper comparator (#19277) 2026-02-25 09:42:21 +08:00
fzyzcjy 02ca107b2c Support dims annotation and enhance dump loader in dumper (#19276) 2026-02-25 09:41:48 +08:00
fzyzcjy 8b1ab4aaf9 Support agent-friendly output formats in dump comparator (#19275) 2026-02-25 09:40:33 +08:00
fzyzcjy d7578ce279 Implement simplest dump comparator v2 (#19274) 2026-02-25 09:37:21 +08:00
wxy 9cec98b445 [diffusion] fix: shard timestep_proj in sequence-sharded ti2v (#19237) 2026-02-25 09:33:45 +08:00
Mick 0ede5c54a8 [diffusion] logging: improve request and component load logs (#19253) 2026-02-25 09:32:36 +08:00
silencejade 15f2e36fb9 [NPU] forward_npu uses native impl by default in MultiPlatformOp (#18545) 2026-02-25 09:16:09 +08:00
Chen, ZhentaoandChen, Todd <zhenchen@amd.com> b9cf1563de [ROCm] Optimize Deepseek R1 on MI300X (#18242)
Co-authored-by: Chen, Todd <zhenchen@amd.com>
2026-02-24 17:01:14 -08:00
Vladimir221 f1088beb6a [NPU]Optimization of forward_npu for UnquantizedFusedMoEMethod (#13158) 2026-02-25 08:55:20 +08:00
Jonah Bernard d7a03c7ebf [MoE Refactor] Refactor FlashInferFusedMoE into FusedMoE and flashinfer_trtllm.py (#19266) 2026-02-24 16:47:53 -08:00
Alison Shao 750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Chen, ZhentaoandChen, Todd <zhenchen@amd.com> c193a52fa2 [AMD] DSR1/V3 use fp8 bmm in MLA for MI300X (#18624)
Co-authored-by: Chen, Todd <zhenchen@amd.com>
2026-02-24 15:33:33 -08:00
Kaiqi Jin 152560d1b9 [PCG] add pcg CI test for gpt-oss model (#18961) 2026-02-24 15:32:34 -08:00
Ratish PandLiangsheng Yin ae6f6e1495 [Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2026-02-24 12:22:01 -08:00
Douglas Yang 65de904130 feature: adding image retag workflow (#19265) 2026-02-24 11:33:05 -08:00
shuwenn 0c224c3c62 docs: Embed release lookup tool into Sphinx documentation site (#19264) 2026-02-24 11:11:27 -08:00
Alec Leng 38f25e802d Fix/deepseek readme link (#19258) 2026-02-24 10:46:56 -08:00
Glen Liu a06425184f [Fix] remove redundant +1 when getting tail_str for Req (#18584) 2026-02-24 10:35:26 -08:00
Makcum888e 9bce3b040c [diffusion] [NPU] Update perf baselines (#19227) 2026-02-24 21:15:16 +03:00
Zihao Wang e6ad58e5da [diffusion] fix: webui not return data (#19244) 2026-02-24 23:39:06 +08:00
Adarsh Shirawalmath 1efc33c640 [diffusion] refactor: remove enums and unify attention backends (#19149) 2026-02-24 21:21:23 +08:00
triple-mu ea1bc1c578 [diffusion] feat: optimize all_to_all (#19157) 2026-02-24 21:20:10 +08:00
husf e3a234478c [NPU][Docs] Add Commonly Used Environment Variables for on NPU (#18556) 2026-02-24 20:05:33 +08:00
Yuan Luoandluoyuan.luo 31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-02-24 19:49:22 +08:00
1a83b2c15d fix: fix the bug blocking completion template application (#17010)
Co-authored-by: xdtbynd <supercluster@vip.qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 18:50:08 +08:00
Cheng Wan 6e54361608 Refactor CUDA graph input buffers with shared buffer pool (#19180) 2026-02-24 02:24:40 -08:00
94946764a4 bugfix: The default value of the environment virable is None, so that… (#18309)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 18:10:21 +08:00
GMI Xiao Jin fcfd964d7d [diffusion] model: LTX-2 Support PR3 (#19151) 2026-02-24 16:55:28 +08:00
Simo Lin b2166a2f33 fix(gateway): pin internal crate dependencies to exact versions (#19224)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 22:35:47 -08:00
Simo Lin 88a7e48108 fix(grpc): handle embedding requests in _handle_batch_output (#19221)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 22:32:16 -08:00
Mickandzyzshishui 2e053d6eb6 [diffusion] quant: support quant for all dits (#19156)
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
2026-02-24 14:20:54 +08:00
fyandsglang-npu-bot 4f25a48d7a support xverse_moe on npu
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 14:11:20 +08:00