3 people 90a4b7d98a [Feature]Support ragged prefill in flashinfer mla backend (#3967) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>

2025-02-28 18:13:56 -08:00

..

triton_ops

Remove unused imports from rocm mla kernel. (#3963)

2025-02-28 10:01:08 -08:00

__init__.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

double_sparsity_backend.py

Update Triton extend backend interface (#3309)

2025-02-05 18:12:22 +08:00

flashinfer_backend.py

[Feature]Support ragged prefill in flashinfer mla backend (#3967)

2025-02-28 18:13:56 -08:00

flashinfer_mla_backend.py

[Feature]Support ragged prefill in flashinfer mla backend (#3967)

2025-02-28 18:13:56 -08:00

torch_native_backend.py

Support target model verification in the attention backend (#2678)

2024-12-30 22:58:55 -08:00

triton_backend.py

Fix draft decode max batch size (#3676)

2025-02-18 23:03:26 +08:00

vision.py

fix: apply cache size limit of attention mask for VisionAttention (#3657)

2025-02-19 20:16:48 +08:00