leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity

CUTLASS 2.0 (#62)

Browse Source 
CUTLASS 2.0

Substantially refactored for

- Better performance, particularly for native Turing Tensor Cores
- Robust and durable templates spanning the design space
- Encapsulated functionality embodying modern C++11 programming techniques
- Optimized containers and data types for efficient, generic, portable device code

Updates to:
- Quick start guide
- Documentation
- Utilities
- CUTLASS Profiler

Native Turing Tensor Cores
- Efficient GEMM kernels targeting Turing Tensor Cores
- Mixed-precision floating point, 8-bit integer, 4-bit integer, and binarized operands

Coverage of existing CUTLASS functionality:
- GEMM kernels targeting CUDA and Tensor Cores in NVIDIA GPUs
- Volta Tensor Cores through native mma.sync and through WMMA API
- Optimizations such as parallel reductions, threadblock rasterization, and intra-threadblock reductions
- Batched GEMM operations
- Complex-valued GEMMs

Note: this commit and all that follow require a host compiler supporting C++11 or greater.
This commit is contained in:
Andrew Kerr
2019-11-19 16:55:34 -08:00
committed by GitHub
parent b5cab177a9
commit fb335f6a5f
5434 changed files with 599799 additions and 250176 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/functions_b.html
+177 -79
View File
@@ -3,21 +3,23 @@
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=9"/>
<meta name="generator" content="Doxygen 1.8.14"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<title>Cutlass: Class Members</title>
<meta name="generator" content="Doxygen 1.8.11"/>
<title>CUTLASS: Class Members</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<link href="search/search.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="search/searchdata.js"></script>
<script type="text/javascript" src="search/search.js"></script>
<script type="text/javascript">
$(document).ready(function() { init_search(); });
</script>
<script type="text/x-mathjax-config">
MathJax.Hub.Config({
extensions: ["tex2jax.js"],
jax: ["input/TeX","output/HTML-CSS"],
});
</script><script type="text/javascript" async src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
</script><script type="text/javascript" src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
</head>
<body>
@@ -26,8 +28,9 @@
<table cellspacing="0" cellpadding="0">
<tbody>
<tr style="height: 56px;">
<td id="projectlogo"><img alt="Logo" src="cutlass-logo-small.png"/></td>
<td id="projectalign" style="padding-left: 0.5em;">
<div id="projectname">Cutlass
<div id="projectname">CUTLASS
</div>
<div id="projectbrief">CUDA Templates for Linear Algebra Subroutines and Solvers</div>
</td>
@@ -36,22 +39,81 @@
</table>
</div>
<!-- end header part -->
<!-- Generated by Doxygen 1.8.14 -->
<!-- Generated by Doxygen 1.8.11 -->
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
var searchBox = new SearchBox("searchBox", "search",false,'Search');
/* @license-end */
</script>
<script type="text/javascript" src="menudata.js"></script>
<script type="text/javascript" src="menu.js"></script>
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
$(function() {
initMenu('',true,false,'search.php','Search');
$(document).ready(function() { init_search(); });
});
/* @license-end */</script>
<div id="main-nav"></div>
<div id="navrow1" class="tabs">
<ul class="tablist">
<li><a href="index.html"><span>Main&#160;Page</span></a></li>
<li><a href="modules.html"><span>Modules</span></a></li>
<li><a href="namespaces.html"><span>Namespaces</span></a></li>
<li class="current"><a href="annotated.html"><span>Classes</span></a></li>
<li><a href="files.html"><span>Files</span></a></li>
<li>
<div id="MSearchBox" class="MSearchBoxInactive">
<span class="left">
<img id="MSearchSelect" src="search/mag_sel.png"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
alt=""/>
<input type="text" id="MSearchField" value="Search" accesskey="S"
onfocus="searchBox.OnSearchFieldFocus(true)"
onblur="searchBox.OnSearchFieldFocus(false)"
onkeyup="searchBox.OnSearchFieldChange(event)"/>
</span><span class="right">
<a id="MSearchClose" href="javascript:searchBox.CloseResultsWindow()"><img id="MSearchCloseImg" border="0" src="search/close.png" alt=""/></a>
</span>
</div>
</li>
</ul>
</div>
<div id="navrow2" class="tabs2">
<ul class="tablist">
<li><a href="annotated.html"><span>Class&#160;List</span></a></li>
<li><a href="classes.html"><span>Class&#160;Index</span></a></li>
<li><a href="inherits.html"><span>Class&#160;Hierarchy</span></a></li>
<li class="current"><a href="functions.html"><span>Class&#160;Members</span></a></li>
</ul>
</div>
<div id="navrow3" class="tabs2">
<ul class="tablist">
<li class="current"><a href="functions.html"><span>All</span></a></li>
<li><a href="functions_func.html"><span>Functions</span></a></li>
<li><a href="functions_vars.html"><span>Variables</span></a></li>
<li><a href="functions_type.html"><span>Typedefs</span></a></li>
<li><a href="functions_enum.html"><span>Enumerations</span></a></li>
<li><a href="functions_eval.html"><span>Enumerator</span></a></li>
</ul>
</div>
<div id="navrow4" class="tabs3">
<ul class="tablist">
<li><a href="functions.html#index_a"><span>a</span></a></li>
<li class="current"><a href="functions_b.html#index_b"><span>b</span></a></li>
<li><a href="functions_c.html#index_c"><span>c</span></a></li>
<li><a href="functions_d.html#index_d"><span>d</span></a></li>
<li><a href="functions_e.html#index_e"><span>e</span></a></li>
<li><a href="functions_f.html#index_f"><span>f</span></a></li>
<li><a href="functions_g.html#index_g"><span>g</span></a></li>
<li><a href="functions_h.html#index_h"><span>h</span></a></li>
<li><a href="functions_i.html#index_i"><span>i</span></a></li>
<li><a href="functions_k.html#index_k"><span>k</span></a></li>
<li><a href="functions_l.html#index_l"><span>l</span></a></li>
<li><a href="functions_m.html#index_m"><span>m</span></a></li>
<li><a href="functions_n.html#index_n"><span>n</span></a></li>
<li><a href="functions_o.html#index_o"><span>o</span></a></li>
<li><a href="functions_p.html#index_p"><span>p</span></a></li>
<li><a href="functions_q.html#index_q"><span>q</span></a></li>
<li><a href="functions_r.html#index_r"><span>r</span></a></li>
<li><a href="functions_s.html#index_s"><span>s</span></a></li>
<li><a href="functions_t.html#index_t"><span>t</span></a></li>
<li><a href="functions_u.html#index_u"><span>u</span></a></li>
<li><a href="functions_v.html#index_v"><span>v</span></a></li>
<li><a href="functions_w.html#index_w"><span>w</span></a></li>
<li><a href="functions_y.html#index_y"><span>y</span></a></li>
<li><a href="functions_0x7e.html#index_0x7e"><span>~</span></a></li>
</ul>
</div>
</div><!-- top -->
<!-- window showing the filter options -->
<div id="MSearchSelectWindow"
@@ -70,92 +132,128 @@ $(function() {
<div class="contents">
<div class="textblock">Here is a list of all class members with links to the classes they belong to:</div>
<h3><a id="index_b"></a>- b -</h3><ul>
<h3><a class="anchor" id="index_b"></a>- b -</h3><ul>
<li>B
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#af0ac89b161f9cad96307f1ff3c80a774">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
: <a class="el" href="structcutlass_1_1library_1_1GemmArguments.html#ae3b1c625d32bf5cbdbd4d2f520145efc">cutlass::library::GemmArguments</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmArrayArguments.html#a0c3d185b52998f836fbf4c0d27c6e497">cutlass::library::GemmArrayArguments</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmDescription.html#ad6117aecf9e4d22862e621114e95cccf">cutlass::library::GemmDescription</a>
</li>
<li>B_tile
: <a class="el" href="structcutlass_1_1reference_1_1device_1_1thread_1_1Gemm.html#a5329ece817a4d471dfee042a4eb6f7bd">cutlass::reference::device::thread::Gemm&lt; TensorRefA, TensorRefB, TensorRefC, ScalarType, AccumulatorType, OutputTile, InnerProductOp, ConvertOp &gt;</a>
</li>
<li>back()
: <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01false_01_4.html#a2c1665d0eff4c1788b0a5a3bfa3bc63e">cutlass::Array&lt; T, N, false &gt;</a>
, <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01true_01_4.html#aa193b8e73b93639f84224d1fea46330d">cutlass::Array&lt; T, N, true &gt;</a>
</li>
<li>Base
: <a class="el" href="structcutlass_1_1gemm_1_1GemmCoord.html#a790f6552ad26964fa808b51f4aba433b">cutlass::gemm::GemmCoord</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#ae13e0d30a941e16875f196b4844b03ed">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#a8f8fbb65070589769468c6b1ac6ba7a5">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalTileCdTraits.html#a581b7cdeef3e620f246923fa07f9db5a">cutlass::gemm::GemmGlobalTileCdTraits&lt; Scalar_, Tile_, Threads_, kStrideH_, kAccessSize_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1HgemmCrosswiseGlobalTileTraits.html#ac0c372c24c4c5340153b11edab874741">cutlass::gemm::HgemmCrosswiseGlobalTileTraits&lt; kOperand_, kLayout_, Scalar_, Tile_, Threads_, kAccessSize_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperA_3_01MatrixLayout_1_1kRowMajor_00_01GemmConfig___01_4.html#a7ec19bf90207a7f598f2ec5166649495">cutlass::gemm::HgemmTileTraitsHelperA&lt; MatrixLayout::kRowMajor, GemmConfig_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1HgemmTileTraitsHelperB_3_01MatrixLayout_1_1kColumnMajor_00_01GemmConfig___01_4.html#aca63ec1099444c555299dc144282dded">cutlass::gemm::HgemmTileTraitsHelperB&lt; MatrixLayout::kColumnMajor, GemmConfig_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmEpilogue.html#a07f9a934f04610db41aa1aac2f4cdf04">cutlass::gemm::IgemmEpilogue&lt; GemmEpilogueTraits_, bool &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmEpilogue_3_01GemmEpilogueTraits___00_01true_01_4.html#a98b415dbe6f7b6cb0c41a4e6b3ad5abf">cutlass::gemm::IgemmEpilogue&lt; GemmEpilogueTraits_, true &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmEpilogueTraitsHelper.html#a4b23ba8c14e26672a516aa43063250c2">cutlass::gemm::IgemmEpilogueTraitsHelper&lt; IgemmConfig_, EpilogueFunctor_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmGlobalIteratorAb.html#a82a9cfc61ecc117592bdb30f57bd35c9">cutlass::gemm::IgemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmGlobalTileTraits.html#ac14f4ef560bd8068d16c0471af6df82c">cutlass::gemm::IgemmGlobalTileTraits&lt; kOperand_, kLayout_, Scalar_, Tile_, Threads_, kAccessSize_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmTileTraitsHelperA_3_01MatrixLayout_1_1kColumnMajor_00_01GemmConfig___00_01Index___01_4.html#adbbf19c2f86c198bbe4cc596c63e65ae">cutlass::gemm::IgemmTileTraitsHelperA&lt; MatrixLayout::kColumnMajor, GemmConfig_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmTileTraitsHelperB_3_01MatrixLayout_1_1kRowMajor_00_01GemmConfig___00_01Index___01_4.html#a4f7dfa33f6b6e52aac05ad5072710aa9">cutlass::gemm::IgemmTileTraitsHelperB&lt; MatrixLayout::kRowMajor, GemmConfig_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1LinearScalingDevicePtr.html#ad10463da3f5a421f9b87638775ef0a85">cutlass::gemm::LinearScalingDevicePtr&lt; Scalar_, FragmentMultiplyAdd_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCd.html#aea87c73ae2d4e027014ebd4d8141c89e">cutlass::gemm::WmmaGemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCdTraits.html#a194aa2762885c3d556a84ff410200b86">cutlass::gemm::WmmaGemmGlobalIteratorCdTraits&lt; Scalar_, Tile_, Threads_, kAccessSize_ &gt;</a>
, <a class="el" href="structcutlass_1_1MatrixCoord.html#a07f7e0ff4347aa6d75a5b3a63676d51d">cutlass::MatrixCoord</a>
, <a class="el" href="structcutlass_1_1PredicatedTileLoadStream.html#ac7f57248d3e10c9309f042e5d41440c1">cutlass::PredicatedTileLoadStream&lt; Iterator_, PredicateFunctor_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1PredicatedTileStoreStream.html#afc320f4d29f05102e9de0064ca31e49b">cutlass::PredicatedTileStoreStream&lt; Iterator_, PredicateFunctor_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1TensorRefBatchStrided.html#ac92b0cbb46cea7a04ee4660c2603b000">cutlass::TensorRefBatchStrided&lt; Storage_, Rank_, MapFunc_, StorageRank_, Index_, LongIndex_ &gt;</a>
, <a class="el" href="classcutlass_1_1TensorView.html#a2d0d8ed1c19485318e84db99b8b4e9e6">cutlass::TensorView&lt; Storage_, Rank_, MapFunc_, StorageRank_, Index_, LongIndex_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileCoord.html#ab40c6bb58967d6be5a349bf6276c2eca">cutlass::TileCoord&lt; Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a1dcbf633eac61ff06980e4992fbe8264">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#a24fa369165de783a72311d8ec3115c48">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
</li>
<li>BaseParams
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#a09268125f1e323874f6c12b50185c517">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCd.html#afd2bed46f4cf04aaf331fb2ecae953f8">cutlass::gemm::WmmaGemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a9aebb9153659320f1391671c215c519e">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#a5dd2a31d41d9098e928c559af12cbe66">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
: <a class="el" href="classcutlass_1_1epilogue_1_1threadblock_1_1Epilogue.html#a2d4a8adca40586b504f4e0a7630afa0a">cutlass::epilogue::threadblock::Epilogue&lt; Shape_, WarpMmaOperator_, PartitionsK, OutputTileIterator_, AccumulatorFragmentIterator_, WarpTileIterator_, SharedLoadIterator_, OutputOp_, Padding_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1BatchedGemmCoord.html#a9c7b499ed35589e62393f002f175f0d7">cutlass::gemm::BatchedGemmCoord</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmCoord.html#a278900b72f38c7566adbe5937d9f86ae">cutlass::gemm::GemmCoord</a>
, <a class="el" href="classcutlass_1_1gemm_1_1threadblock_1_1MmaPipelined.html#a1ca2ed2c51ec508a6b6bb4af5f969076">cutlass::gemm::threadblock::MmaPipelined&lt; Shape_, IteratorA_, SmemIteratorA_, IteratorB_, SmemIteratorB_, ElementC_, LayoutC_, Policy_, TransformA_, TransformB_, Enable &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1threadblock_1_1MmaSingleStage.html#a6bca25698296c416c9e0661789b25a41">cutlass::gemm::threadblock::MmaSingleStage&lt; Shape_, IteratorA_, SmemIteratorA_, IteratorB_, SmemIteratorB_, ElementC_, LayoutC_, Policy_, Enable &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operand___0b84f53cd44b339eccc12067c9f86e11c.html#a8af5160e9f060dd3709a468ef82a3f81">cutlass::gemm::warp::MmaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::ColumnMajorTensorOpMultiplicandCongruous&lt; sizeof_bits&lt; Element_ &gt;::value, int(128/sizeof(Element_))&gt;, InstructionShape_, OpDelta_, 32, PartitionsK_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operand___0e52ad425e1ee3e68544873f66733237b.html#af497c01bcf8f48ec2ec4a90df6eaec11">cutlass::gemm::warp::MmaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::ColumnMajorTensorOpMultiplicandCrosswise&lt; sizeof_bits&lt; Element_ &gt;::value, Crosswise &gt;, InstructionShape_, OpDelta_, 32, PartitionsK_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operand___039819fb3ccd43786d556c2c9669508ef.html#ae9d2a2b4d378e778e1ca6b60d96aa250">cutlass::gemm::warp::MmaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::RowMajorTensorOpMultiplicandCongruous&lt; sizeof_bits&lt; Element_ &gt;::value, int(128/sizeof(Element_))&gt;, InstructionShape_, OpDelta_, 32, PartitionsK_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operand___0352e0dcab42bc8360606874e00173556.html#a8bcdfb8d9705c2b7fb0943d3ce8ab51e">cutlass::gemm::warp::MmaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::RowMajorTensorOpMultiplicandCrosswise&lt; sizeof_bits&lt; Element_ &gt;::value, Crosswise &gt;, InstructionShape_, OpDelta_, 32, PartitionsK_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaVoltaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operan0d3248553e52cd61ed8a2b3b12a20343.html#a7d9a8331610332f9a7beafc6bea5b8f9">cutlass::gemm::warp::MmaVoltaTensorOpMultiplicandTileIterator&lt; Shape_, Operand::kA, Element_, cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCongruous&lt; sizeof_bits&lt; Element_ &gt;::value &gt;, InstructionShape_, OpDelta_, 32 &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaVoltaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operand734577b7e54a074d143aba59828c2f2.html#a52032223ac0c998e52019aa4e79c0a63">cutlass::gemm::warp::MmaVoltaTensorOpMultiplicandTileIterator&lt; Shape_, Operand::kB, Element_, cutlass::layout::RowMajorVoltaTensorOpMultiplicandBCongruous&lt; sizeof_bits&lt; Element_ &gt;::value &gt;, InstructionShape_, OpDelta_, 32 &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaVoltaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operan5a221944f4a0e16ccab77ba684856942.html#ae619ae19915d8b45d59e5793ae677cfa">cutlass::gemm::warp::MmaVoltaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCrosswise&lt; sizeof_bits&lt; Element_ &gt;::value, KBlock &gt;, InstructionShape_, OpDelta_, 32 &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1warp_1_1MmaVoltaTensorOpMultiplicandTileIterator_3_01Shape___00_01Operandcc9821c435540895138bc9af495f321.html#a38a52b712c92dc68384501d415cc4538">cutlass::gemm::warp::MmaVoltaTensorOpMultiplicandTileIterator&lt; Shape_, Operand_, Element_, cutlass::layout::RowMajorVoltaTensorOpMultiplicandCrosswise&lt; sizeof_bits&lt; Element_ &gt;::value, KBlock &gt;, InstructionShape_, OpDelta_, 32 &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorTensorOpMultiplicandCongruous.html#a3e44a55d0be474138fce394480c8267e">cutlass::layout::ColumnMajorTensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorTensorOpMultiplicandCrosswise.html#a9c459438e8660304b6f75bde269cf958">cutlass::layout::ColumnMajorTensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandBCongruous.html#af70725b417f2c35e19866be8d57487be">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandBCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandCongruous.html#a6d02cbf1ad87aac334582cd91f0c2bd0">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandCrosswise.html#a9ea316d870cf7abc6f1f6bb193af9b9b">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCrosswise&lt; ElementSize, KBlock &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1PitchLinearCoord.html#a523ef51c4cd7be7743c91e9af619eff2">cutlass::layout::PitchLinearCoord</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorTensorOpMultiplicandCongruous.html#a726c11e5c883a32a6948d5d8092c00a9">cutlass::layout::RowMajorTensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorTensorOpMultiplicandCrosswise.html#aaf70fbe057aede83fa9b66ea84d1f687">cutlass::layout::RowMajorTensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandBCongruous.html#a8b6ca2d7852ba45313d67cf83536bd1e">cutlass::layout::RowMajorVoltaTensorOpMultiplicandBCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandCongruous.html#acb7a21efe21bed04ecf46a705745d8bb">cutlass::layout::RowMajorVoltaTensorOpMultiplicandCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandCrosswise.html#aca6bbb33a339a182fbc6b7cb40938d0c">cutlass::layout::RowMajorVoltaTensorOpMultiplicandCrosswise&lt; ElementSize, KBlock &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1TensorOpMultiplicandCongruous.html#ae830ff3cb6bf7a23f9b07097cfb92a59">cutlass::layout::TensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1TensorOpMultiplicandCrosswise.html#a1634bc35ab63daec869b61382543c764">cutlass::layout::TensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1MatrixCoord.html#ab0ac39fff446bb681b94de36e3f3650a">cutlass::MatrixCoord</a>
, <a class="el" href="structcutlass_1_1Tensor4DCoord.html#a367dd7e307c7e8e2aa7396d027e8891e">cutlass::Tensor4DCoord</a>
, <a class="el" href="classcutlass_1_1TensorView.html#a3c2ec2c816648b7c95d9b9e4b24311ae">cutlass::TensorView&lt; Element_, Layout_ &gt;</a>
, <a class="el" href="classcutlass_1_1thread_1_1Matrix.html#a2abcd8b9b18c88f3e60941b4ca315c25">cutlass::thread::Matrix&lt; Element, Rows, Columns, Layout &gt;</a>
</li>
<li>batch()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmCoord.html#ac441e93411ed6954a93ab36f0c747d26">cutlass::gemm::GemmCoord</a>
: <a class="el" href="structcutlass_1_1gemm_1_1BatchedGemmCoord.html#a40582b341f6916b17105377a64743682">cutlass::gemm::BatchedGemmCoord</a>
</li>
<li>batch_stride
: <a class="el" href="structcutlass_1_1gemm_1_1GlobalLoadStream_1_1Params.html#ab5d9e5de9b1cc3462920ce7a8f52bbec">cutlass::gemm::GlobalLoadStream&lt; Operand, LoadIterator_, StoreIterator_, Transformer_ &gt;::Params</a>
<li>batch_count
: <a class="el" href="structcutlass_1_1gemm_1_1device_1_1GemmBatched_1_1Arguments.html#ac99ca8f9d8a0053e647a6c99b018bda5">cutlass::gemm::device::GemmBatched&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, LayoutC_, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, Operator_ &gt;::Arguments</a>
, <a class="el" href="structcutlass_1_1gemm_1_1device_1_1GemmBatched_3_01ElementA___00_01LayoutA___00_01ElementB___00_213d78696663f4231cd52c6a277c60e5.html#adb66f3083f56c15578b139b7935452b5">cutlass::gemm::device::GemmBatched&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, layout::ColumnMajor, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, Operator_ &gt;::Arguments</a>
, <a class="el" href="structcutlass_1_1gemm_1_1kernel_1_1GemmBatched_1_1Params.html#a7ed96fc1c9cba288ec807736a3ed96e7">cutlass::gemm::kernel::GemmBatched&lt; Mma_, Epilogue_, ThreadblockSwizzle_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmArrayConfiguration.html#a10fe15d9179998530d3fdd86c78d4a15">cutlass::library::GemmArrayConfiguration</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmBatchedConfiguration.html#ae6cc3b877a073bedb8e4d1c91423b0f5">cutlass::library::GemmBatchedConfiguration</a>
</li>
<li>batch_stride_A
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#a8b5a86d14eba0d3c5173753212d62599">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
: <a class="el" href="structcutlass_1_1library_1_1GemmBatchedConfiguration.html#a7bea2035164b174c45a7589d8132f2af">cutlass::library::GemmBatchedConfiguration</a>
</li>
<li>batch_stride_B
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#a95e3fe05e4ca0d4019cbef2b1a54419a">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
: <a class="el" href="structcutlass_1_1library_1_1GemmBatchedConfiguration.html#ac85cb497652f997f8fa3143be70ac77a">cutlass::library::GemmBatchedConfiguration</a>
</li>
<li>batch_stride_C
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#aad3590dffa2e1ba82c834efae6b35ad2">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmEpilogueTraits_1_1Params.html#a4aa03c14de3f0c3c1cf46c3d5f52d802">cutlass::gemm::GemmEpilogueTraits&lt; OutputTile_, Accumulators_, GlobalLoadIteratorC_, GlobalTransformerC_, GlobalTransformerD_, GlobalStoreIteratorD_, SharedStoreIteratorD_, SharedStoreTransformerD_, SharedLoadStreamD_, Iterations_, Delta_, Functor_, Index_ &gt;::Params</a>
: <a class="el" href="structcutlass_1_1library_1_1GemmBatchedConfiguration.html#a1225f9ce96f9819d6d0cfde7a664b921">cutlass::library::GemmBatchedConfiguration</a>
</li>
<li>batch_stride_D
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#a7b9afcc7e3105da1d002b1baa68d83de">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmEpilogueTraits_1_1Params.html#a5208998277daef204983989d24707008">cutlass::gemm::GemmEpilogueTraits&lt; OutputTile_, Accumulators_, GlobalLoadIteratorC_, GlobalTransformerC_, GlobalTransformerD_, GlobalStoreIteratorD_, SharedStoreIteratorD_, SharedStoreTransformerD_, SharedLoadStreamD_, Iterations_, Delta_, Functor_, Index_ &gt;::Params</a>
: <a class="el" href="structcutlass_1_1library_1_1GemmBatchedConfiguration.html#aa0b8603417007880a9882774f0f5c988">cutlass::library::GemmBatchedConfiguration</a>
</li>
<li>batched_stride_A
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a68643eb068634c6f96719d871363bc09">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
</li>
<li>batched_stride_B
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a0472cd678eeb71d5ffd42fdcab5af409">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
</li>
<li>batched_stride_C
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#ab3519e652b982d3b3fdf4c788342bda9">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
</li>
<li>batched_stride_D
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a7245398f9aa9754f6501edf95a8a3ab5">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
</li>
<li>BatchedGemmCoord()
: <a class="el" href="structcutlass_1_1gemm_1_1BatchedGemmCoord.html#ae1065cdcd7d6d99f971cba5c2565fe7d">cutlass::gemm::BatchedGemmCoord</a>
</li>
<li>BatchedReduction()
: <a class="el" href="structcutlass_1_1reduction_1_1BatchedReduction.html#a9d76da3dcf4d8ec0cfeb2134f73ea22b">cutlass::reduction::BatchedReduction&lt; BatchedReductionTraits_ &gt;</a>
</li>
<li>begin()
: <a class="el" href="structcutlass_1_1PredicateVector.html#a649045d8224514a4c28bcaf4b247b4a5">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;</a>
, <a class="el" href="structcutlass_1_1TensorRefArray.html#a6b0f0d9cef4a2f3f4a8bf6c192a282db">cutlass::TensorRefArray&lt; Storage_, Rank_, MapFunc_, StorageRank_, Index_, LongIndex_ &gt;</a>
, <a class="el" href="structcutlass_1_1TensorRefBatchStrided.html#a4f4a2f860cc10688ee27cc9ce1df1015">cutlass::TensorRefBatchStrided&lt; Storage_, Rank_, MapFunc_, StorageRank_, Index_, LongIndex_ &gt;</a>
: <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01false_01_4.html#a6e9dbf4a486f07dc72dd5140a7628971">cutlass::Array&lt; T, N, false &gt;</a>
, <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01true_01_4.html#acf5a84cce457d31be7d30c57ab52f64c">cutlass::Array&lt; T, N, true &gt;</a>
, <a class="el" href="classcutlass_1_1library_1_1Manifest.html#aa8a131b4258bfda04fdba4449520c587">cutlass::library::Manifest</a>
, <a class="el" href="structcutlass_1_1PredicateVector.html#a649045d8224514a4c28bcaf4b247b4a5">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;</a>
</li>
<li>beta
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#adac41a0baad9e65aa4a6fe12d249a02b">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1LinearScaling_1_1Params.html#a0e455ad2e4eba67259867f9123ca817b">cutlass::gemm::LinearScaling&lt; Scalar_, FragmentMultiplyAdd_ &gt;::Params</a>
, <a class="el" href="classcutlass_1_1gemm_1_1LinearScalingDevicePtr_1_1Params.html#a0938bcb61d2572d5cf6cf2de95d11816">cutlass::gemm::LinearScalingDevicePtr&lt; Scalar_, FragmentMultiplyAdd_ &gt;::Params</a>
: <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombination_1_1Params.html#a9677cb04e23e9afa9fcdc3f34074bb56">cutlass::epilogue::thread::LinearCombination&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationClamp_1_1Params.html#a11eb2330d28b470366032dd8f549fe33">cutlass::epilogue::thread::LinearCombinationClamp&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu_1_1Params.html#a7f3cb135884b5ef89bdef997159a3844">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu_3_01ElementOutput___00_01Count_00_00274a94522c46cd041d0b10d484e2ef3.html#af607bd78ed05e98af8dfe0c413e25091">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, int, float, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1kernel_1_1detail_1_1GemvBatchedStridedEpilogueScaling.html#abcd99b63173e4330a75558e78a756296">cutlass::gemm::kernel::detail::GemvBatchedStridedEpilogueScaling&lt; ElementAlphaBeta, BetaIsZero &gt;</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmArguments.html#a91f68b30afc142ea697707fa752c9526">cutlass::library::GemmArguments</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmArrayArguments.html#ac84f31989db6018f465019cf81f83978">cutlass::library::GemmArrayArguments</a>
, <a class="el" href="structcutlass_1_1reduction_1_1BatchedReductionTraits_1_1Params.html#a805f78cae27c3305c988f251207d85f7">cutlass::reduction::BatchedReductionTraits&lt; ScalarA_, ScalarC_, ScalarD_, ScalarAlphaBeta_, ScalarAccum_, ReductionSize_, OutputTile_, SubTile_, ThreadShape_, Index_, BlockSwizzle_, maxInReg_, maxOutReg_, Functor_ &gt;::Params</a>
</li>
<li>beta_ptr
: <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombination_1_1Params.html#a01f730dac9a4500cb857bf4ca272bc7b">cutlass::epilogue::thread::LinearCombination&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationClamp_1_1Params.html#adae7ef1a432b24d148df0662954b5bd0">cutlass::epilogue::thread::LinearCombinationClamp&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu_1_1Params.html#a2dfa5dc3c851915d39d27bf6b4cc68e6">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu_3_01ElementOutput___00_01Count_00_00274a94522c46cd041d0b10d484e2ef3.html#a3b26637eb910d79d8ae6a79011ca85e3">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, int, float, Round &gt;::Params</a>
</li>
<li>bitcast()
: <a class="el" href="structcutlass_1_1half__t.html#acb746c82bd4dd496f79b7e611e3653dd">cutlass::half_t</a>
</li>
<li>block
: <a class="el" href="structcutlass_1_1KernelLaunchConfiguration.html#a09535026bf08f94c6940c358d95d1edd">cutlass::KernelLaunchConfiguration</a>
</li>
<li>block_shape()
: <a class="el" href="classcutlass_1_1reduction_1_1kernel_1_1ReduceSplitK.html#af788ae48c72021b8ce49da15dfa72be3">cutlass::reduction::kernel::ReduceSplitK&lt; Shape_, OutputOp_, ReductionOp_, PartitionsPerStage &gt;</a>
</li>
<li>BlockForEach()
: <a class="el" href="structcutlass_1_1reference_1_1device_1_1BlockForEach.html#a161e212b9b7ddbac36888de97538e106">cutlass::reference::device::BlockForEach&lt; Element, Func &gt;</a>
, <a class="el" href="structcutlass_1_1reference_1_1host_1_1BlockForEach.html#aa2e578397b5cd68214736c2437f92480">cutlass::reference::host::BlockForEach&lt; Element, Func &gt;</a>
</li>
<li>BlockSwizzle
: <a class="el" href="structcutlass_1_1gemm_1_1GemmTraits.html#a50672b5fa67d858aeff8f254cf28e941">cutlass::gemm::GemmTraits&lt; GemmConfig_, GlobalLoadStreamA_, GlobalLoadStreamB_, SharedLoadStreamA_, SharedLoadStreamB_, Epilogue_, BlockSwizzle_, Index_, ClearAccumulators_ &gt;</a>
, <a class="el" href="structcutlass_1_1reduction_1_1BatchedReductionTraits.html#ae0c016bcbe687063774d8abd554939b6">cutlass::reduction::BatchedReductionTraits&lt; ScalarA_, ScalarC_, ScalarD_, ScalarAlphaBeta_, ScalarAccum_, ReductionSize_, OutputTile_, SubTile_, ThreadShape_, Index_, BlockSwizzle_, maxInReg_, maxOutReg_, Functor_ &gt;</a>
</li>
<li>bounds
: <a class="el" href="structcutlass_1_1RegularTilePredicateFunctor.html#ac2f49374e6f0a27ad2daffcb1f74708a">cutlass::RegularTilePredicateFunctor&lt; Delta_ &gt;</a>
</li>
<li>Boustrophedon
: <a class="el" href="structcutlass_1_1gemm_1_1swizzleDirection.html#aba1528de966f236380c5f55942802fb8a3172f5122c4348fdf4eb2480601249fa">cutlass::gemm::swizzleDirection</a>
</li>
<li>BType
: <a class="el" href="structcutlass_1_1gemm_1_1GemmDesc.html#a23317c22122ea2721a7a3e0c12e07a49">cutlass::gemm::GemmDesc&lt; AType_, BType_, CType_, DType_, SType_, Index_ &gt;</a>
: <a class="el" href="structcutlass_1_1reduction_1_1BatchedReductionTraits.html#ae0c016bcbe687063774d8abd554939b6">cutlass::reduction::BatchedReductionTraits&lt; ScalarA_, ScalarC_, ScalarD_, ScalarAlphaBeta_, ScalarAccum_, ReductionSize_, OutputTile_, SubTile_, ThreadShape_, Index_, BlockSwizzle_, maxInReg_, maxOutReg_, Functor_ &gt;</a>
</li>
<li>byte
: <a class="el" href="structcutlass_1_1platform_1_1alignment__of_1_1pad.html#a86f075f91b80918e968951713430f0b4">cutlass::platform::alignment_of&lt; value_t &gt;::pad</a>
@@ -164,9 +262,9 @@ $(function() {
</div><!-- contents -->
<!-- start footer part -->
<hr class="footer"/><address class="footer"><small>
Generated on Fri Oct 26 2018 14:53:41 for Cutlass by &#160;<a href="http://www.doxygen.org/index.html">
Generated by &#160;<a href="http://www.doxygen.org/index.html">
<img class="footer" src="doxygen.png" alt="doxygen"/>
</a> 1.8.14
</a> 1.8.11
</small></address>
</body>
</html>