 siyu
|
e18e0057a4
|
Add an env var to allow transferring small metadata via TCP for PD (#16951)
|
2026-01-16 18:32:22 -08:00 |
|
|
Stefan He
|
43779f27b7
|
Disable PCG for draft worker (#16354)
|
2026-01-17 09:56:56 +08:00 |
|
|
Baizhou Zhang
|
8b9e9357fe
|
[2/n] deepseek_v2.py Refactor: Migrate MHA forward method in deepseek_v2.py (#16817)
|
2026-01-17 09:36:25 +08:00 |
|
|
b8zhong
|
d36f6f043c
|
[Fix] flashinfer_trtllm intermediate_size assertion with Qwen3 + TP=8 (#16824)
|
2026-01-17 09:24:05 +08:00 |
|
|
Lingjun WenandXinyuan Tong
|
7f8353aff3
|
[BugFix]: Fix sglang.bench_one_batch (#16925)
Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>
|
2026-01-16 13:15:34 -08:00 |
|
|
Baizhou Zhang
|
a04675892e
|
Update flashinfer to 0.6.1 (#15551)
|
2026-01-17 00:48:30 +08:00 |
|
|
Yongfei Xu
|
82a1b645ba
|
[DeepSeek V3.1/V3.2] Optimize fused moe configs for H20 & H20-3E based on swapab (#17133)
|
2026-01-17 00:10:52 +08:00 |
|
|
billishyahao
|
6f10e17b4a
|
[bugfix] fix qwen3-next alt_stream none issue (#17016)
|
2026-01-16 22:40:25 +08:00 |
|
|
Nicolas Castet
|
9d8bbd4223
|
Add clear error message when OOM with symmetric memory (#17038)
|
2026-01-16 20:44:37 +08:00 |
|
|
Raghav Ravishankar
|
daea51385d
|
Add AFMoE model implementation (#13216)
|
2026-01-16 20:35:42 +08:00 |
|
|
|
3355b6e21b
|
feat: add request queued timeout (#17143)
Co-authored-by: qiuxuan.lzw <qiuxuan.lzw@alibaba-inc.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-16 17:55:09 +08:00 |
|
|
R0CKSTAR
|
a1dd3d48ac
|
[diffusion] hardware: support diffusion (single GPU, 3/N) (#17105)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-01-16 17:01:09 +08:00 |
|
|
Zhiqiang Xie
|
d9ed80b9f1
|
fix AMD CI failure of NUMA binding (#17184)
|
2026-01-16 00:21:04 -08:00 |
|
|
Adarsh Shirawalmath
|
7c39ea68f3
|
[diffusion] model: support flux Klein (#17173)
|
2026-01-16 16:16:17 +08:00 |
|
|
YAMY
|
daa4841e86
|
[ConfigArgumentMerger] Improve ConfigArgumentMerger compatibility with external callers (#17051)
|
2026-01-16 15:32:42 +08:00 |
|
|
Hudson Xing
|
21ee597e4a
|
ci: enable offline mode when local cache is complete to avoid HF Hub … (#16121)
|
2026-01-15 20:15:33 -08:00 |
|
|
Xiaoyu Zhang
|
6ee970a365
|
[Diffusion] Hot fix broken output_path default value (#17180)
|
2026-01-16 12:14:09 +08:00 |
|
|
shuwenn
|
8ec160ed46
|
feature: support uvicorn access log filter(disable logging /metrics) (#15513)
|
2026-01-15 20:00:06 -08:00 |
|
|
YAMY
|
2740ed1ae7
|
[eval] GSM8k support for run_eval (#17041)
|
2026-01-16 11:10:17 +08:00 |
|
|
Lianmin ZhengandLiangsheng Yin
|
e7dc85c50b
|
Fix grammar sync across TP ranks (#17100)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2026-01-15 18:38:01 -08:00 |
|
|
Ratish P
|
c81bad1bf7
|
[diffusion] feat: add cloud storage support for API (#14579)
|
2026-01-16 10:29:38 +08:00 |
|
|
hlu1
|
0e86de7c0b
|
Remove deepseek-r1 from THINKING_MODE_CHOICES in run_eval.py (#17178)
|
2026-01-15 16:53:06 -08:00 |
|
|
PiteXChenandZhiqiang Xie
|
8b22deef5b
|
fix【hicache】fix the KV cache resource occupation and invalid loading from prefetch when pending requests are aborted. (#16369)
Signed-off-by: CLFutureX <chenyongqyl@163.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-15 15:14:38 -08:00 |
|
|
JinYan SuandZhiqiang Xie
|
72e2f70ef7
|
feat(hicache): support numa detect to reduce long tail latency (#11028)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
|
2026-01-15 14:11:49 -08:00 |
|
|
|
77fc4c4a53
|
Add mooncake store read/write bandwidth logs (#10598)
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: Lei Huang <lei.huang@novita.ai>
|
2026-01-15 12:15:41 -08:00 |
|
|
cctry
|
dda35ccbd8
|
Fix gid calculation in per_tensor_absmax_kernel (#17126)
|
2026-01-15 23:21:41 +08:00 |
|
|
wxyandXiaoyu Zhang
|
d11e2dc6f4
|
[diffusion] chore: improve the output_path config and enable the server to return inference duration (#16965)
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
|
2026-01-15 22:31:50 +08:00 |
|
|
Mick
|
16831ab6d7
|
[diffusion] fix: fix using upstream flash_attn on blackwell (#17111)
|
2026-01-15 22:30:48 +08:00 |
|
|
R0CKSTAR
|
c9a45b7e3c
|
[diffusion] fix: fix UMA detection (#17113)
Signed-off-by: Xiaodong Ye <xiaodong.ye@mthreads.com>
|
2026-01-15 22:29:46 +08:00 |
|
|
HuangJi
|
e7df8bdc5c
|
[diffusion] refactor: move SLA to attention_backend folder (#17020)
|
2026-01-15 21:36:48 +08:00 |
|
|
LancerandLancer
|
e997995037
|
[diffusion] fix: optimize text encoder CPU offload initialization to address OOM (#17064)
Signed-off-by: Lancer <maruxiang6688@gmail.com>
Co-authored-by: Lancer <maruxiang6688@gmail.com>
|
2026-01-15 21:28:57 +08:00 |
|
|
Mick
|
68e8d0f68d
|
[diffusion] CI: add testcase for cfg parallel (#17056)
|
2026-01-15 13:13:31 +08:00 |
|
|
sglang-botandsglang-bot
|
000ad42225
|
chore: bump sgl-kernel version to 0.3.21 (#17075)
Co-authored-by: sglang-bot <sglang-bot@users.noreply.github.com>
|
2026-01-15 12:41:17 +08:00 |
|
|
Hanming Lu
|
9d5f16d456
|
[SWA] fix swa radix cache match_len_since_tombstone update when hits swa_tombstone (#17061)
|
2026-01-15 11:28:33 +08:00 |
|
|
Ke Bao
|
7f8a58fffb
|
Refactor prefix cache type checking (#17028)
|
2026-01-15 11:28:13 +08:00 |
|
|
b8zhong
|
4346db5faf
|
[Fix] Remove assertion for padding for NVFP4 weight scales to fix GLM 4.5 NVFP4 (#12497)
|
2026-01-15 08:57:14 +08:00 |
|
|
|
424a380077
|
[NPU] NPU quantization refactoring & more quantization formats support (#14504)
Co-authored-by: TamirBaydasov <mr.jeijy@gmail.com>
Co-authored-by: Tamir Baydasov <41994229+TamirBaydasov@users.noreply.github.com>
Co-authored-by: Савкин Артем <savkinartem@MacBook-Air-Viktoria.local>
Co-authored-by: Edward Shogulin <edward.shogulin@gmail.com>
|
2026-01-15 04:25:15 +08:00 |
|
|
Simo Lin
|
f091858304
|
[gRPC] Add GetLoads RPC for comprehensive load metrics (#17087)
|
2026-01-14 12:05:10 -08:00 |
|
|
Aurick Qiao
|
5b1215d9da
|
fix session request with None tokenizer (#16278)
|
2026-01-14 10:41:08 -08:00 |
|
|
Simo Lin
|
b3a3f51320
|
[API] Add /v1/loads endpoint for load metrics (#16976)
|
2026-01-14 09:13:20 -08:00 |
|
|
shuwennandXinyuan Tong
|
de94d793ad
|
feat: support qwen3(-VL) rerank scoring&chat template (#16403)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
|
2026-01-15 00:45:46 +08:00 |
|
|
Xiaoyu Zhang
|
0d904ef44c
|
[diffusion] fix: fix fsdp tp load make param miss parallel meta data (#17058)
|
2026-01-15 00:12:33 +08:00 |
|
|
Yuan Luoandluoyuan.luo
|
969faaa410
|
[diffusion] fix: revise fa4 backend to support blackwell (#17077)
Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
|
2026-01-14 23:31:46 +08:00 |
|
|
shuwenn
|
48c2aca9ba
|
[Env] centralize pd vars in environ.py (#16264)
|
2026-01-14 23:06:01 +08:00 |
|
|
|
5af84c8af5
|
[AMD][Quantization] Add int4fp8_moe online quantization on ROCm (#7392)
Co-authored-by: Dehua Tang <dehtang@amd.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: YC Tseng <yctseng@amd.com>
|
2026-01-14 01:44:40 -08:00 |
|
|
Yuan Luo
|
feae615b11
|
[VLM] Support ViT CUDA Graph for InternVL (#16732)
|
2026-01-14 17:29:23 +08:00 |
|
|
Netanel HaberandYi Zhang
|
e75299a111
|
Fix issues/16714: Revert comment out of tl.debug_barrier() in causal_conv1d_triton (#16899)
Co-authored-by: Yi Zhang <1109276519@qq.com>
|
2026-01-14 17:26:48 +08:00 |
|
|
roikoren755
|
72bacc88c8
|
[NemotronH] Use ReplicatedLinear for fc1_latent_proj (#16569)
Signed-off-by: Roi Koren <roik@nvidia.com>
|
2026-01-14 17:08:27 +08:00 |
|
|
shaharmor98
|
ba625c2d90
|
Feat/support nemotron h mtp (#17013)
Signed-off-by: Shahar Mor <smor@nvidia.com>
|
2026-01-14 16:30:35 +08:00 |
|
|
HuangJi
|
030496eb06
|
[diffusion] fix: fix --warmup-resolutions' conflict with CacheDiT (#16962)
|
2026-01-14 14:44:10 +08:00 |
|