leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

b2b bias vector support (#482)

Browse Source 
* b2b bias vector support

* add files

Co-authored-by: Haicheng Wu <haichengw@nvidia.com>
This commit is contained in:
Haicheng Wu
2022-04-30 07:16:15 -04:00
committed by GitHub
parent 86ce09aed1
commit ec2b4fd85d
34 changed files with 1096 additions and 324 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
include/cutlass/epilogue/thread/linear_combination_relu.h
View File

@@ -162,6 +162,8 @@ public:
if (Scale == ScaleType::OnlyAlphaScaling) return false;
if (Scale == ScaleType::OnlyAlphaPerChannelScaling) return false;
if (Scale == ScaleType::Nothing) return false;
return beta_ != ElementCompute(0);
@@ -389,6 +391,8 @@ public:
if (Scale == ScaleType::OnlyAlphaScaling) return false;
if (Scale == ScaleType::OnlyAlphaPerChannelScaling) return false;
if (Scale == ScaleType::Nothing) return false;
return beta_ != ElementCompute(0);