Commit Graph
41 Commits
Author SHA1 Message Date
Yongfei Xu 17031120b8 [DeepSeek v3.2][Bugfix] get_index_k_scale_buffer support cp (#18280) 2026-03-17 09:54:54 -07:00
Baizhou Zhang be63f982b7 [V32/GLM5] Control the threshold of applying dense attention with an environ (#20062) 2026-03-09 14:36:10 -07:00
Xinyuan Tong 9ebffef1ef [FIX] NSA backend page_table overflow in speculative decoding target_verify (#19016) 2026-03-05 16:04:58 -08:00
Rain Jiang 472eef4071 fa4 cleanup (#19727) 2026-03-05 17:54:25 +08:00
80a6b32703 [Perf] Optimize NSA backend metadata under MTP (#19536)
Co-authored-by: Baidu-AIAK <Baidu_AIAK@163.com>
Co-authored-by: zengpai <zengpai@baidu.com>
2026-03-01 01:59:26 -08:00
wufann 7e46aafebb [AMD] Enable cudagraph for aiter nsa backend and add aiter impl for nsa pr… (#18526) 2026-02-27 13:18:32 -08:00
fxmarty-amd 9496bbd7b1 [AMD] Use tilelang as default NSA attention backend dispatch on AMD Instinct (#18319) 2026-02-27 01:43:34 -08:00
Bingxu Chenandmichaelzhang-ai 462267982b [AMD] Fix mi35x dsv32 mtp nightly (#18978)
Co-authored-by: michaelzhang-ai <michaelzhang-ai@users.noreply.github.com>
2026-02-18 16:23:17 -08:00
Rain Jiang 0ffd0a3995 Nsa trtllm mla sparse fp8 support with Deepseek v3.2 NVFP4 (#18389) 2026-02-16 09:29:54 +08:00
Johnsonms 34132d6da5 Kernel: optimize decoding metadata in NSA multi-spec backend with fused kernels (#17554) 2026-02-14 16:40:15 +08:00
e8a2c13380 Deepseekv32 compatibility with transformers v5 (#18297)
Signed-off-by: Xinyuan Tong <xinyuantong.cs@gmail.com>
Co-authored-by: Xiaoyu Zhang <35585791+BBuf@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2026-02-10 14:50:40 +08:00
Yongfei Xu 677f3c49da [DeepSeek V3.2] [Bugfix] slice indexer and padding fa3 when can not run cuda graph (#17076) 2026-02-03 01:32:20 +08:00
Mohammad Miadh Angkad 1674b9ef44 [DeepSeek-V3.2] Fix TRT-LLM NSA in target_verify/draft_extend (#17662) 2026-01-25 13:10:14 +08:00
akhilg-nvandDarkSharpness 2fb328109f [DeepSeek V3.2] Enable trtllm NSA with bf16 kvcache (#16758)
Co-authored-by: DarkSharpness <76582120+DarkSharpness@users.noreply.github.com>
2026-01-23 20:26:21 +08:00
Yongfei Xu d2105d4abd [DeepSeek v3.2] Opt MTP decode cuda batch sizes and nsa implementation (#16961) 2026-01-19 11:54:11 +08:00
Hubert Luandwufann afe285f7bd [AMD] enable CUDA graph for NSA backend and fix NSA FP8 fused RMSNorm group quant (#16841)
Co-authored-by: wufann <715544327@qq.com>
2026-01-13 17:36:01 -08:00
Baizhou Zhang 7d757d6f17 Clean Some Environment Variables for DeepSeek V32 (#15938) 2026-01-07 14:00:16 +08:00
Yongfei Xu 0d244116d2 [DeepSeek v3.2] opt Context Parallelism: support fused moe, multi batch and fp8 kvcache (#13959) 2026-01-02 23:49:14 +08:00
YL D 6afc5d497b [DSv32] Move deep_gemm.get_paged_mqa_logits_metadata to init time as metadata (#15040) 2025-12-19 13:23:33 -08:00
b8zhong e88e75a9df [Deepseek V3.2] Fix Deepseek MTP in V1 mode (#15429) 2025-12-18 17:56:07 -08:00
Johnsonms e0026f7c92 [Performance] optimize NSA backend metadata computation for multi-step speculative decoding (#14781) 2025-12-18 13:48:27 -08:00
b8zhongandBrayden Zhong d20699a33c [Deepseek V3.2] Support Overlap Spec + NSA (#15307)
Co-authored-by: Brayden Zhong <b8zhong@users.noreply.github.com>
2025-12-17 13:35:39 -08:00
YAMY c96903074c [NSA] Fix NSA backend assertion error when running DeepSeek-V3.2 PP with radix-cache (#15086) 2025-12-14 17:13:18 -08:00
YAMY 1f2b84d28d Fix NSA Bug in Centralize NSA Dispatch Logic (#14245) 2025-12-01 13:18:18 -08:00
YAMY decb48965d [DeepSeekV3.2] Enable pure TP & Partial DP Attention (#13646) 2025-11-30 15:59:23 -08:00
YAMYandhlu1 5eed5fc0b0 [DeepSeekV3.2] Centralize NSA dispatch logic in NativeSparseAttnBackend (#13544)
Co-authored-by: hlu1 <14827759+hlu1@users.noreply.github.com>
2025-11-25 11:32:30 -08:00
YAMY fa92441027 [DeepseekV3.2] Deepseek fp8 support for MHA path (#12964) 2025-11-20 11:13:36 -08:00
hlu1 a8fcbf6fe3 [Deepseek V3.2] Use torch.compile to speed up torch.cat in nsa (#13022)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-17 12:20:49 -08:00
lixiaolx d368c7451a (1/n)support context parallel with deepseekv3.2-DSA (#12065) 2025-11-16 20:12:25 -08:00
hlu1 a7002e614b [Deepseek V3.2] Clean up MTP (#13236) 2025-11-14 11:01:37 -08:00
bingpsandGuangda Liu 4eda9969e8 [DeepseekV32]: use _concat_mla_absorb_q_general to replace torch.cat (#12215)
Co-authored-by: Guangda Liu <bingps@users.noreply.github.com>
2025-11-12 15:20:01 -08:00
hlu1 0d4a418424 [Deepseek V3.2] Fix accuracy bug in the Indexer (#12583)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-11-11 16:15:26 -08:00
YAMY 7257525cce [DeepSeek-V3.2][NSA] Enable MHA Pathway for Short Sequence Prefill on B200 (SM100) (#12788) 2025-11-06 17:26:08 -08:00
YAMY f235498eca DeepSeek-V3.2: Add Adaptive MHA Attention Pathway for Short-Sequence Prefill (#11892) 2025-11-05 19:33:26 -08:00
Baizhou Zhang 621dfb8886 Import flash_mla from sgl-kernel (#12135) 2025-10-29 23:54:21 -07:00
hlu1 42e1a72efb [Deepseek V3.2] Enable flashmla_auto with MTP (#12294)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-10-28 23:51:20 -07:00
hlu1 81a632ace6 [DeepseekV32] Enable flashmla_prefill kernel with fp8 kvcache (#11655)
Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>
2025-10-27 23:11:48 -07:00
Baizhou Zhang ef4a8097b8 Rename flashmla kernel options of nsa backend for better readability (#11876) 2025-10-21 13:14:16 -07:00
PaiiiiandPaiiiiiiiiiiiiii efa473348b [Spec Decoding] Support MTP for dsv3.2 (#11652)
Co-authored-by: Paiiiiiiiiiiiiii <zengpai@baidu.com>
2025-10-19 23:44:22 +08:00
Chang Su 627974405d [Lint] Add python/sglang to ruff F401 checks and remove unused imports in files (#11685) 2025-10-17 16:49:46 -07:00
+2 efbc687c28 Support DeepSeek V3.2 Exp (#11061)
Co-authored-by: Stefan He <11166516+hebiao064@users.noreply.github.com>
Co-authored-by: Liangsheng Yin <95566987+hnyls2002@users.noreply.github.com>
Co-authored-by: Baizhou Zhang <56809903+fridge003@users.noreply.github.com>
Co-authored-by: DarkSharpness <76582120+darksharpness@users.noreply.github.com>
Co-authored-by: ZhengdQin <46387172+zhengdqin@users.noreply.github.com>
Co-authored-by: DarkSharpness <2040703891@qq.com>
Co-authored-by: hnyls2002 <lsyincs@gmail.com>
Co-authored-by: Zhengda Qin <zhengdqin@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: HAI <hixiao@gmail.com>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
2025-10-06 00:24:15 -07:00