Netanel Haber d6837aea4d model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909) ...

Signed-off-by: Netanel Haber <nhaber@nvidia.com>

2025-10-09 00:37:38 +08:00

..

fla

model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)

2025-10-09 00:37:38 +08:00

mamba

model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)

2025-10-09 00:37:38 +08:00

npu_ops

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

nsa

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

triton_ops

Update grok.py and tiktoken tokenizer (#9532)

2025-08-23 05:40:18 -07:00

wave_ops

Update wave-lang to 3.7.0 and unify Wave kernel buffer options (#10069)

2025-09-05 16:01:52 -07:00

aiter_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

ascend_backend.py

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

attention_registry.py

model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)

2025-10-09 00:37:38 +08:00

base_attn_backend.py

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

cutlass_mla_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

double_sparsity_backend.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

dual_chunk_flashattention_backend.py

[1/n] Enable DCA CUDA graph capture (#9537)

2025-10-03 11:30:00 +08:00

flashattention_backend.py

[2/2] Support MHA prefill with FlashAttention 4. (#10937)

2025-10-08 00:54:20 -07:00

flashinfer_backend.py

feat: add fast_decode_plan from flashinfer, flashinfer to 0.4.0rc3 (#10760)

2025-10-01 02:56:13 -07:00

flashinfer_mla_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

flashmla_backend.py

[fix]enable flashmla when using draft model P/D attention select (#11012)

2025-10-04 20:59:34 +08:00

hybrid_attn_backend.py

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

hybrid_linear_attn_backend.py

model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)

2025-10-09 00:37:38 +08:00

intel_amx_backend.py

Add graph runner support with torch compile on CPU (#7843)

2025-09-07 21:33:58 -07:00

merge_state.py

feat: Add a unified merge_state API (#5428)

2025-05-05 10:32:33 -07:00

nsa_backend.py

Support DeepSeek V3.2 Exp (#11061)

2025-10-06 00:24:15 -07:00

tbo_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

torch_flex_backend.py

feat: Add FlexAttention Backend for Efficient Sparse Attention (#9947)

2025-09-18 11:49:17 -07:00

torch_native_backend.py

[bugfix]: use correct cache location for cross attention in torch native backend (#8622)

2025-09-05 13:39:46 -07:00

triton_backend.py

model: Support Hybrid Mamba2 NemotronHForCausalLM (nvidia/NVIDIA-Nemotron-Nano-9B-v2) (#10909)

2025-10-09 00:37:38 +08:00

trtllm_mha_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00

trtllm_mla_backend.py

Fuse quantize and rope in trtllm_mla MTP (#10779)

2025-10-02 17:59:37 +08:00

utils.py

fix: revert #8593 (#9581)

2025-08-25 01:29:06 -07:00

vision_utils.py

[GLM4.1V and GLM4.5V] Add vision transformer num_dummy_head support: max tp=4 -> max tp=8 (#9059)

2025-08-18 14:40:13 -07:00

vision.py

[Ascend] optimize Qwen-vl on Ascend (#10556)

2025-09-22 17:18:16 -07:00

wave_backend.py

Organize spec-related data structures (#10735)

2025-10-01 09:45:30 +08:00