 qy-seu
|
456934fed5
|
feat: fix update last_receive_tstamp logic for health-check in multi-token-worker mode (#20256)
|
2026-03-11 00:23:22 -07:00 |
|
|
Liangsheng Yin
|
61cad15d28
|
[Utils] Add NetworkAddress abstraction for IPv6-safe address handling (#20306)
|
2026-03-11 00:07:37 -07:00 |
|
|
Kurkur
|
55e6acf834
|
[NPU][QwenVL] Support qwen image preprocess on npu (#20189)
|
2026-03-11 15:03:08 +08:00 |
|
|
|
57b093dc34
|
[NPU]MindSpore backend support eagle3 (#17098)
Co-authored-by: wangtiance <tiancew@qq.com>
Co-authored-by: Tiance Wang <wangtiance@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: ronnie_zheng <zl19940307@163.com>
|
2026-03-11 09:11:19 +03:00 |
|
|
zhaoshang
|
18cfeabd33
|
Add SGLANG_SORT_WEIGHT_FILES env var for sequential I/O optimization (#20194)
Signed-off-by: zhaoshang <zhaoshangsjtu@linux.alibaba.com>
|
2026-03-11 14:10:53 +08:00 |
|
|
Ke Bao
|
4011065c65
|
Update CODEOWNERS (#20320)
|
2026-03-11 14:08:07 +08:00 |
|
|
Mick
|
8c8a487468
|
[diffusion] doc: add diffusion-optimal-perf (#20311)
|
2026-03-11 12:20:09 +08:00 |
|
|
Aleksi Vesanto
|
c8bbe5010a
|
[diffusion] feat: add AITER Sage attention backend (#20178)
|
2026-03-11 12:17:45 +08:00 |
|
|
xieminghe1andundefined
|
21a0015aa3
|
[PCG]add piecewise cuda graph support for marlin linear (#20119)
Co-authored-by: undefined <zhouchen.arrebol@jd.com>
|
2026-03-11 10:57:08 +08:00 |
|
|
|
fe294904c9
|
[README] Add GB300 NVL72 inference blog post to News section (#20313)
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-03-10 19:31:37 -07:00 |
|
|
Polisetty V R K Jyothendra Varma
|
b2dd104ade
|
[Intel GPU] Upgrade pytorch xpu version to 2.10 (#20254)
Signed-off-by: P V R K Jyothendra Varma <polisetty.v.r.k.jyothendra.varma@intel.com>
|
2026-03-10 18:47:25 -07:00 |
|
|
Kurkur
|
16ec4f3a4a
|
Integrate the AddRmsNorm operator (#19939)
|
2026-03-11 09:05:04 +08:00 |
|
|
Liangsheng Yin
|
50953aea8d
|
[Scheduler] Unify idle checks into is_fully_idle() and fix weight update test (#20296)
|
2026-03-10 17:50:23 -07:00 |
|
|
Michael
|
7a1ca53805
|
[AMD] Fix JSON mode streaming test flake on AMD CI (#20293)
|
2026-03-10 17:24:11 -07:00 |
|
|
Michael
|
dc4380e33a
|
[AMD] [DeepSeek-OCR-2 Day 0] Enable DeepSeek-OCR-2 on AMD GPUs and add nightly test (#19732)
|
2026-03-10 17:04:35 -07:00 |
|
|
Alison ShaoandAlison Shao
|
eea7f8de41
|
[CI] Fix B200 runner label for scheduled runs (#20297)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
|
2026-03-10 16:00:31 -07:00 |
|
|
Alison ShaoandAlison Shao
|
f32882cee5
|
[CI] Relax Eagle infer_b spec accept length threshold (#20300)
Co-authored-by: Alison Shao <alisonshao@Mac.attlocal.net>
|
2026-03-10 15:40:52 -07:00 |
|
|
|
09a118fafe
|
Support return_logprob for spec v2 (overlap safe) (#19801)
Co-authored-by: Ratish1 <ratish1501@gmail.com>
Co-authored-by: Ratish1 <formula733@gmail.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
|
2026-03-10 15:38:27 -07:00 |
|
|
Ziang Li
|
76ee4bb98c
|
[FlashInfer v0.6.4] [RL] Integrate FlashInfer mxfp8 gemm, MoE, and routed MoE (#19537)
|
2026-03-10 15:37:57 -07:00 |
|
|
Qiaolin Yu
|
bd460e9565
|
add logprob related params in bench_serving (#20218)
|
2026-03-10 15:04:57 -07:00 |
|
|
R0CKSTARandMick
|
db97f193b7
|
[diffusion][llm] macOS support (#19549)
Signed-off-by: Xiaodong Ye <yeahdongcn@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-03-10 13:11:07 -07:00 |
|
|
Qiaolin Yu
|
a3d88a247b
|
Enable piecewise-cuda-graph when logprob_start_len = -1 (#19453)
|
2026-03-10 12:50:57 -07:00 |
|
|
fxmarty-amd
|
031d0a2aad
|
[Qwen-MOE] Fix memory duplication issues in case layers weights are re-assigned during weight loading (#18255)
|
2026-03-10 17:34:56 +00:00 |
|
|
Xinyuan Tong
|
11d9c36c2f
|
Replace soundfile+torchaudio with torchcodec AudioDecoder in load_audio (#20190)
|
2026-03-10 17:26:29 +00:00 |
|
|
Mick
|
e1f0b3181a
|
[diffusion] fix: adjust convert_hf_to_fp8 to be compatible with more dits (#20281)
|
2026-03-11 01:21:54 +08:00 |
|
|
Xiaoyu Zhang
|
60cc06297e
|
[4/n jit_kernel restruct] speed up CI tests and add benchmark workflow (#20268)
|
2026-03-10 21:37:41 +08:00 |
|
|
JiaruiChang5268
|
5a7c1b8ec6
|
[NPU] replace swiglu with custom kernel
|
2026-03-10 21:08:37 +08:00 |
|
|
Hexq0210
|
9884957c07
|
[NPU] Bugfix for qwen35 on NPU (#19756)
|
2026-03-10 20:03:26 +08:00 |
|
|
heziiop
|
6ed996bf65
|
[bugfix] disable share input buffer feature on npu due to accuracy issue (#19507)
|
2026-03-10 19:26:46 +08:00 |
|
|
Xiaoyu Zhang
|
51d9d34977
|
[2/n jit_kernel restruct] unify rotary embedding entrypoints under rope.py (#20247)
|
2026-03-10 17:49:57 +08:00 |
|
|
Thomas Wang
|
6407891b4f
|
[AMD] Fp8 prefill integration with radix cache path for dpsk models (#20187)
|
2026-03-10 02:49:47 -07:00 |
|
|
Yuan Luoandluoyuan.luo
|
751c454099
|
Add DeepSeek3.2 and GlmMoeDsa into moe tune (#18876)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-03-10 17:12:58 +08:00 |
|
|
Liangsheng Yin
|
ac07a6d439
|
Revert "[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result" (#20259)
|
2026-03-10 01:58:48 -07:00 |
|
|
LancerandMick
|
8cd1de3354
|
[diffusion] fix: map each prompt to corresponding image in multi-prompt scenario (#20081)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-03-10 16:58:21 +08:00 |
|
|
Lancer
|
2c2003158f
|
[diffusion] fix: fix flux2 lora (#20200)
Signed-off-by: Lancer <maruixiang6688@gmail.com>
|
2026-03-10 16:57:01 +08:00 |
|
|
Xiaoyu Zhang
|
8517da5d08
|
[3/n jit_kernel restruct] Clean up benchmark naming and benchmarking helpers (#20250)
|
2026-03-10 16:39:03 +08:00 |
|
|
Xiaoyu Zhang
|
c812504b92
|
[1/n jit_kernel restruct] unify cache usage and clean up naming in ngram_embedding (#20244)
|
2026-03-10 15:53:43 +08:00 |
|
|
Johnsonms
|
7cf0551014
|
Migrate norm kernels to FlashInfer JIT implementation (#18871)
|
2026-03-10 14:56:07 +08:00 |
|
|
Junrong Lin
|
69158e9d9f
|
[Bugfix] Skip _mamba_verify_update for idle batch (#20167)
|
2026-03-10 14:53:01 +08:00 |
|
|
Yuwei An
|
834795adb8
|
[CI] Refactor PCG related CI (#19994)
Signed-off-by: yuweia <ayw.sirius19@gmail.com>
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
|
2026-03-10 14:49:25 +08:00 |
|
|
liupeng374
|
9b2e5526fb
|
[NPU][Bug fix] context parallel bug fix (#19820)
|
2026-03-10 14:43:49 +08:00 |
|
|
khalilzhk
|
5f717913a0
|
support Kimi-K2.5-w4a8 on ascend
|
2026-03-10 14:43:27 +08:00 |
|
|
Jacob0226andYC Tseng
|
dadd4dde83
|
[AMD] Skip the flaky test for lora ci test. (#20175)
Co-authored-by: YC Tseng <yctseng@amd.com>
|
2026-03-09 23:15:30 -07:00 |
|
|
|
1aa56cca37
|
[AMD] Add wheel support for sglang (#16782)
Co-authored-by: Alan Kao <akao@amd.com>
Co-authored-by: Claude Sonnet 4.6 <noreply@anthropic.com>
|
2026-03-09 22:42:41 -07:00 |
|
|
shuwenn
|
5a11ae19c1
|
[CI] fix: notebook ci often OOM (#20199)
|
2026-03-09 22:32:41 -07:00 |
|
|
Brayden Zhong
|
591e61245a
|
[Doc] Add smal table for GEMM backends (#20213)
|
2026-03-09 22:19:57 -07:00 |
|
|
Liangsheng YinandClaude Opus 4.6
|
208f1428e9
|
[Scheduler] Decouple maybe_send_health_check_signal from process_batch_result (#20227)
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
|
2026-03-09 21:18:56 -07:00 |
|
|
Bingxu Chen
|
2e7682414b
|
[AMD] Fix Aiter Prebuild When Releasing ROCm720 Image (#20195)
|
2026-03-09 21:02:38 -07:00 |
|
|
sfiisfandMick
|
08d37f6955
|
[diffusion] fix: add VAE tiling/slicing argument handling for diffusers backend (#17825)
Co-authored-by: Mick <mickjagger19@icloud.com>
|
2026-03-10 11:38:20 +08:00 |
|
|
Baizhou Zhang
|
a6ae89fe3c
|
Revert "chore: bump sgl-kernel version to 0.3.21.post1" (#20229)
|
2026-03-09 20:32:19 -07:00 |
|