Commit Graph

9948 Commits

Author SHA1 Message Date
Alison Shao
750ecf4a45 Add server CUDA graph warmup CI step for cold H200 nodes (#19201) 2026-02-24 16:07:01 -08:00
Chen, Zhentao
c193a52fa2 [AMD] DSR1/V3 use fp8 bmm in MLA for MI300X (#18624)
Co-authored-by: Chen, Todd <zhenchen@amd.com>
2026-02-24 15:33:33 -08:00
Kaiqi Jin
152560d1b9 [PCG] add pcg CI test for gpt-oss model (#18961) 2026-02-24 15:32:34 -08:00
Ratish P
ae6f6e1495 [Refactor] Benchmark: Add typed DatasetArgs/Loader registry and CPU dataset unit tests (#19147)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
2026-02-24 12:22:01 -08:00
Douglas Yang
65de904130 feature: adding image retag workflow (#19265) 2026-02-24 11:33:05 -08:00
shuwenn
0c224c3c62 docs: Embed release lookup tool into Sphinx documentation site (#19264) 2026-02-24 11:11:27 -08:00
Alec Leng
38f25e802d Fix/deepseek readme link (#19258) 2026-02-24 10:46:56 -08:00
Glen Liu
a06425184f [Fix] remove redundant +1 when getting tail_str for Req (#18584) 2026-02-24 10:35:26 -08:00
Makcum888e
9bce3b040c [diffusion] [NPU] Update perf baselines (#19227) 2026-02-24 21:15:16 +03:00
Zihao Wang
e6ad58e5da [diffusion] fix: webui not return data (#19244) 2026-02-24 23:39:06 +08:00
Adarsh Shirawalmath
1efc33c640 [diffusion] refactor: remove enums and unify attention backends (#19149) 2026-02-24 21:21:23 +08:00
triple-mu
ea1bc1c578 [diffusion] feat: optimize all_to_all (#19157) 2026-02-24 21:20:10 +08:00
husf
e3a234478c [NPU][Docs] Add Commonly Used Environment Variables for on NPU (#18556) 2026-02-24 20:05:33 +08:00
Yuan Luo
31c7dc9d99 [VLM] Introduce FlashInfer CUDNN Prefill as ViT Backend (#19003)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
2026-02-24 19:49:22 +08:00
xdtbynd
1a83b2c15d fix: fix the bug blocking completion template application (#17010)
Co-authored-by: xdtbynd <supercluster@vip.qq.com>
Co-authored-by: cy <chenyang08056032@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 18:50:08 +08:00
Cheng Wan
6e54361608 Refactor CUDA graph input buffers with shared buffer pool (#19180) 2026-02-24 02:24:40 -08:00
jianzhao-xu
94946764a4 bugfix: The default value of the environment virable is None, so that… (#18309)
Co-authored-by: ronnie_zheng <zl19940307@163.com>
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 18:10:21 +08:00
GMI Xiao Jin
fcfd964d7d [diffusion] model: LTX-2 Support PR3 (#19151) 2026-02-24 16:55:28 +08:00
Simo Lin
b2166a2f33 fix(gateway): pin internal crate dependencies to exact versions (#19224)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 22:35:47 -08:00
Simo Lin
88a7e48108 fix(grpc): handle embedding requests in _handle_batch_output (#19221)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 22:32:16 -08:00
Mick
2e053d6eb6 [diffusion] quant: support quant for all dits (#19156)
Co-authored-by: zyzshishui <zyzshishui@gmail.com>
2026-02-24 14:20:54 +08:00
fy
4f25a48d7a support xverse_moe on npu
Co-authored-by: sglang-npu-bot <sglangnpu@163.com>
2026-02-24 14:11:20 +08:00
Liangsheng Yin
5e80027ac7 [PD-Disagg] Support FAKE transfer backend for more cases (#19215) 2026-02-23 20:50:43 -08:00
Ratish P
02a646ba4e [CI]: add CI permission (#19214) 2026-02-23 20:37:55 -08:00
jianzhao-xu
d8ef33a551 bugfix: prioritize init_npu_backend to fix various initialization bugs (#17652) 2026-02-24 12:25:20 +08:00
Douglas Yang
59e7ea99c5 fix: release docker worker wrong args (#19207) 2026-02-23 19:51:06 -08:00
Liangsheng Yin
feb041f4e5 [PD-Disagg] Improve type hints across all conn.py (#19208) 2026-02-23 19:44:23 -08:00
Simo Lin
edba96b98a fix(docker): migrate ROCm Dockerfiles from setuptools-rust to maturin (#19210)
Signed-off-by: Simo Lin <linsimo.mark@gmail.com>
2026-02-23 19:00:05 -08:00
Liangsheng Yin
ea7ef63e6d [PD-Disagg] Deduplicate common KVManager methods into CommonKVManager (#19205)
Co-authored-by: Shangming Cai <csmthu@gmail.com>
2026-02-23 18:34:21 -08:00
Kangyan-Zhou
8aeb16f3fc fix: add missing blank line after docstring in serving_transcription.py (#19206)
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 18:29:38 -08:00
Xinyuan Tong
581bf53e03 Whisper model support & /v1/audio/transcriptions endpoint & benchmark (#16983)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: MahmoudAshraf97 <hassouna97.ma@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-23 17:28:37 -08:00
Douglas Yang
3a11e7dad9 fix: patch docker image fixes (#19100) 2026-02-23 16:34:29 -08:00
Liangsheng Yin
d160c5b9bb [PD-Disagg] Unify prefill info data transition flow, all with PrefillServerInfo (#19195) 2026-02-23 16:15:20 -08:00
Liangsheng Yin
9fac90d85d [CI] Tiny enhance the dp attention load blance benchmark (#19194) 2026-02-23 14:33:32 -08:00
narutolhy
672b666057 add new ci user (#19133) 2026-02-23 12:48:04 -08:00
Liangsheng Yin
2aa3fe394e [CI] fix the teardown output of disaggregation test (#19193)
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
2026-02-23 12:41:03 -08:00
Liangsheng Yin
2274bfebb1 [PD-Disagg] Support query dp rank from bootstrap server. (#19168)
Signed-off-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
Co-authored-by: Chang Huaixin (OpenAnolis) <changhuaixin@linux.alibaba.com>
2026-02-23 10:59:30 -08:00
Linyu Wu
2cdde5d4ab [Kernel Slimming] Migrate AWQ marlin repack kernel to JIT (#18949)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
2026-02-23 22:05:27 +08:00
Xiaoyu Zhang
e0e0cad6bc [Diffusion] Match rotary_embedding module name style (#19179) 2026-02-23 21:02:34 +08:00
Xiaoyu Zhang
2717393681 [Refactor] Split rotary_embedding.py into a modular package (#19144) 2026-02-23 20:05:29 +08:00
Even Zhou
27d394a6a5 [NPU] bump sgl-kernel-npu to 2026.02.01.post2 (#19178) 2026-02-23 18:23:02 +08:00
Qiaolin Yu
d80c884a27 Use single mma warp group for short q_len in FA to optimize decoding performance (#18985) 2026-02-23 17:01:28 +08:00
Junrong Lin
6448de7e96 Reorganize topk logic to clean up code and expose logical experts (#16945) 2026-02-23 00:30:57 -08:00
Yuzhen Zhou
4f3dc1ef5b [ROCm] Use unreg path for custom all-reduce during CUDA graph capture (#19162) 2026-02-22 23:27:31 -08:00
Changyi Yang
c3c1532820 [diffusion] feat: detect Flux2 custom VAE path from component_paths (#19170) 2026-02-23 15:19:53 +08:00
HAI
6a999dbdf8 [AMD] ENV flags tuning and cleanup (#19176) 2026-02-22 22:40:00 -08:00
Qiaolin Yu
42b1019881 Fix bench_one_batch_server by moving the print statements (#19175) 2026-02-22 22:06:25 -08:00
Clint
3224836d8b Update rocm7.2 Dockerfile to install amdsmi for QuickReduce Initialization (#19091) 2026-02-22 21:32:14 -08:00
Baizhou Zhang
2472e47d73 Revert "Refactor graph input buffers (#18991)" (#19173) 2026-02-23 13:09:54 +08:00
Baizhou Zhang
fa80b9beba [CI] Skip some subtests for tool call parser (#19172) 2026-02-23 12:20:12 +08:00