leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 27 Packages Projects Releases Wiki Activity

Example 43 - DualGemm (#670)

Browse Source 
* Ex50 wip

* IS_PROFILING mode

* MultiStage2 - but is slower

* Add SwiGLU

* Support SplitKSerial reduction
Support not storing D0/D1
Cleanup code

* Option to disable bias

* Renumber example

* Fix build

* Remove references to pb_size_0 / pb_size_1

* Add support for bf16 inputs with float accum

* small changes

Co-authored-by: danthe3rd <danthe3rd>
Co-authored-by: Haicheng Wu <haichengw@nvidia.com>
This commit is contained in:
dan_the_3rd
2022-10-26 14:04:42 -04:00
committed by GitHub
co-authored by danthe3rd <danthe3rd> Haicheng Wu
parent 8c1bf9b784
commit 1b4e24470a
12 changed files with 3728 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
examples/CMakeLists.txt
+1
View File
@@ -121,6 +121,7 @@ foreach(EXAMPLE
39_gemm_permute
41_multi_head_attention
42_fused_multi_head_attention
43_dual_gemm
)
add_subdirectory(${EXAMPLE})