leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

Example 43 - DualGemm (#670)

Browse Source 
* Ex50 wip

* IS_PROFILING mode

* MultiStage2 - but is slower

* Add SwiGLU

* Support SplitKSerial reduction
Support not storing D0/D1
Cleanup code

* Option to disable bias

* Renumber example

* Fix build

* Remove references to pb_size_0 / pb_size_1

* Add support for bf16 inputs with float accum

* small changes

Co-authored-by: danthe3rd <danthe3rd>
Co-authored-by: Haicheng Wu <haichengw@nvidia.com>
This commit is contained in:
dan_the_3rd
2022-10-26 20:04:42 +02:00
committed by GitHub
parent 8c1bf9b784
commit 1b4e24470a
12 changed files with 3728 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
include/cutlass/gemm/threadblock/mma_base.h
View File

@@ -34,6 +34,7 @@
#pragma once
#include "cutlass/tensor_ref.h"
#include "cutlass/aligned_buffer.h"
#include "cutlass/arch/memory.h"
#include "cutlass/array.h"