CUTLASS 2.0 (#62)

CUTLASS 2.0

Substantially refactored for

- Better performance, particularly for native Turing Tensor Cores
- Robust and durable templates spanning the design space
- Encapsulated functionality embodying modern C++11 programming techniques
- Optimized containers and data types for efficient, generic, portable device code

Updates to:
- Quick start guide
- Documentation
- Utilities
- CUTLASS Profiler

Native Turing Tensor Cores
- Efficient GEMM kernels targeting Turing Tensor Cores
- Mixed-precision floating point, 8-bit integer, 4-bit integer, and binarized operands

Coverage of existing CUTLASS functionality:
- GEMM kernels targeting CUDA and Tensor Cores in NVIDIA GPUs
- Volta Tensor Cores through native mma.sync and through WMMA API
- Optimizations such as parallel reductions, threadblock rasterization, and intra-threadblock reductions
- Batched GEMM operations
- Complex-valued GEMMs

Note: this commit and all that follow require a host compiler supporting C++11 or greater.
This commit is contained in:
Andrew Kerr
2019-11-19 16:55:34 -08:00
committed by GitHub
parent b5cab177a9
commit fb335f6a5f
5434 changed files with 599799 additions and 250176 deletions
+157 -109
View File
@@ -3,21 +3,23 @@
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=9"/>
<meta name="generator" content="Doxygen 1.8.14"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<title>Cutlass: Class Members - Functions</title>
<meta name="generator" content="Doxygen 1.8.11"/>
<title>CUTLASS: Class Members - Functions</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<link href="search/search.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="search/searchdata.js"></script>
<script type="text/javascript" src="search/search.js"></script>
<script type="text/javascript">
$(document).ready(function() { init_search(); });
</script>
<script type="text/x-mathjax-config">
MathJax.Hub.Config({
extensions: ["tex2jax.js"],
jax: ["input/TeX","output/HTML-CSS"],
});
</script><script type="text/javascript" async src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
</script><script type="text/javascript" src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
</head>
<body>
@@ -26,8 +28,9 @@
<table cellspacing="0" cellpadding="0">
<tbody>
<tr style="height: 56px;">
<td id="projectlogo"><img alt="Logo" src="cutlass-logo-small.png"/></td>
<td id="projectalign" style="padding-left: 0.5em;">
<div id="projectname">Cutlass
<div id="projectname">CUTLASS
</div>
<div id="projectbrief">CUDA Templates for Linear Algebra Subroutines and Solvers</div>
</td>
@@ -36,22 +39,80 @@
</table>
</div>
<!-- end header part -->
<!-- Generated by Doxygen 1.8.14 -->
<!-- Generated by Doxygen 1.8.11 -->
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
var searchBox = new SearchBox("searchBox", "search",false,'Search');
/* @license-end */
</script>
<script type="text/javascript" src="menudata.js"></script>
<script type="text/javascript" src="menu.js"></script>
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
$(function() {
initMenu('',true,false,'search.php','Search');
$(document).ready(function() { init_search(); });
});
/* @license-end */</script>
<div id="main-nav"></div>
<div id="navrow1" class="tabs">
<ul class="tablist">
<li><a href="index.html"><span>Main&#160;Page</span></a></li>
<li><a href="modules.html"><span>Modules</span></a></li>
<li><a href="namespaces.html"><span>Namespaces</span></a></li>
<li class="current"><a href="annotated.html"><span>Classes</span></a></li>
<li><a href="files.html"><span>Files</span></a></li>
<li>
<div id="MSearchBox" class="MSearchBoxInactive">
<span class="left">
<img id="MSearchSelect" src="search/mag_sel.png"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
alt=""/>
<input type="text" id="MSearchField" value="Search" accesskey="S"
onfocus="searchBox.OnSearchFieldFocus(true)"
onblur="searchBox.OnSearchFieldFocus(false)"
onkeyup="searchBox.OnSearchFieldChange(event)"/>
</span><span class="right">
<a id="MSearchClose" href="javascript:searchBox.CloseResultsWindow()"><img id="MSearchCloseImg" border="0" src="search/close.png" alt=""/></a>
</span>
</div>
</li>
</ul>
</div>
<div id="navrow2" class="tabs2">
<ul class="tablist">
<li><a href="annotated.html"><span>Class&#160;List</span></a></li>
<li><a href="classes.html"><span>Class&#160;Index</span></a></li>
<li><a href="inherits.html"><span>Class&#160;Hierarchy</span></a></li>
<li class="current"><a href="functions.html"><span>Class&#160;Members</span></a></li>
</ul>
</div>
<div id="navrow3" class="tabs2">
<ul class="tablist">
<li><a href="functions.html"><span>All</span></a></li>
<li class="current"><a href="functions_func.html"><span>Functions</span></a></li>
<li><a href="functions_vars.html"><span>Variables</span></a></li>
<li><a href="functions_type.html"><span>Typedefs</span></a></li>
<li><a href="functions_enum.html"><span>Enumerations</span></a></li>
<li><a href="functions_eval.html"><span>Enumerator</span></a></li>
</ul>
</div>
<div id="navrow4" class="tabs3">
<ul class="tablist">
<li><a href="functions_func.html#index_a"><span>a</span></a></li>
<li><a href="functions_func_b.html#index_b"><span>b</span></a></li>
<li><a href="functions_func_c.html#index_c"><span>c</span></a></li>
<li><a href="functions_func_d.html#index_d"><span>d</span></a></li>
<li><a href="functions_func_e.html#index_e"><span>e</span></a></li>
<li><a href="functions_func_f.html#index_f"><span>f</span></a></li>
<li><a href="functions_func_g.html#index_g"><span>g</span></a></li>
<li><a href="functions_func_h.html#index_h"><span>h</span></a></li>
<li class="current"><a href="functions_func_i.html#index_i"><span>i</span></a></li>
<li><a href="functions_func_k.html#index_k"><span>k</span></a></li>
<li><a href="functions_func_l.html#index_l"><span>l</span></a></li>
<li><a href="functions_func_m.html#index_m"><span>m</span></a></li>
<li><a href="functions_func_n.html#index_n"><span>n</span></a></li>
<li><a href="functions_func_o.html#index_o"><span>o</span></a></li>
<li><a href="functions_func_p.html#index_p"><span>p</span></a></li>
<li><a href="functions_func_q.html#index_q"><span>q</span></a></li>
<li><a href="functions_func_r.html#index_r"><span>r</span></a></li>
<li><a href="functions_func_s.html#index_s"><span>s</span></a></li>
<li><a href="functions_func_t.html#index_t"><span>t</span></a></li>
<li><a href="functions_func_u.html#index_u"><span>u</span></a></li>
<li><a href="functions_func_v.html#index_v"><span>v</span></a></li>
<li><a href="functions_func_w.html#index_w"><span>w</span></a></li>
<li><a href="functions_func_0x7e.html#index_0x7e"><span>~</span></a></li>
</ul>
</div>
</div><!-- top -->
<!-- window showing the filter options -->
<div id="MSearchSelectWindow"
@@ -70,118 +131,105 @@ $(function() {
<div class="contents">
&#160;
<h3><a id="index_i"></a>- i -</h3><ul>
<li>IdentityBlockSwizzle()
: <a class="el" href="structcutlass_1_1gemm_1_1IdentityBlockSwizzle.html#a046a5dfd01164df2abd514e9a52987c3">cutlass::gemm::IdentityBlockSwizzle</a>
</li>
<li>IgemmEpilogue()
: <a class="el" href="structcutlass_1_1gemm_1_1IgemmEpilogue.html#a599a50becefed561d063c1b834188aca">cutlass::gemm::IgemmEpilogue&lt; GemmEpilogueTraits_, bool &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmEpilogue_3_01GemmEpilogueTraits___00_01true_01_4.html#a0a1be1aab827127161406871ca75cbe0">cutlass::gemm::IgemmEpilogue&lt; GemmEpilogueTraits_, true &gt;</a>
</li>
<li>IgemmFloatToInt8Converter()
: <a class="el" href="structcutlass_1_1gemm_1_1IgemmFloatToInt8Converter.html#ac65f020e93584b1bd3cdb849ff625026">cutlass::gemm::IgemmFloatToInt8Converter&lt; kElements_ &gt;</a>
</li>
<li>IgemmGlobalIteratorAb()
: <a class="el" href="structcutlass_1_1gemm_1_1IgemmGlobalIteratorAb.html#a37672bf5444d07c5ff56d4e710a7ff94">cutlass::gemm::IgemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
</li>
<li>IgemmInt8ToFloatConverter()
: <a class="el" href="structcutlass_1_1gemm_1_1IgemmInt8ToFloatConverter.html#a88a55a494d3a30d50477d50bf6a8804d">cutlass::gemm::IgemmInt8ToFloatConverter&lt; kElements_ &gt;</a>
</li>
<li>IgemmSwizzle()
: <a class="el" href="structcutlass_1_1gemm_1_1IgemmSwizzle.html#ac041d287c966cf568599d7e462e81d5a">cutlass::gemm::IgemmSwizzle&lt; GlobalIterator_ &gt;</a>
<h3><a class="anchor" id="index_i"></a>- i -</h3><ul>
<li>IdentityTensorLayout()
: <a class="el" href="classcutlass_1_1IdentityTensorLayout.html#a2aff6124a25853f227cdd7f3b36733c4">cutlass::IdentityTensorLayout&lt; Rank &gt;</a>
</li>
<li>imag()
: <a class="el" href="classcutlass_1_1platform_1_1complex.html#a57360dbcada12083ecb92fba32fae801">cutlass::platform::complex&lt; T &gt;</a>
: <a class="el" href="classcutlass_1_1complex.html#aa2c8964e10eeaa99b2d1a18cdcbd0105">cutlass::complex&lt; T &gt;</a>
</li>
<li>inc_advance()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#ae3ecef6501f0761051f298eb7cefcacf">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#aeac77cdc31ce151634b7c27ccdaf5552">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a9bda55335fb2e90af2ee7d20571f3d9b">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#a3ecd73de1202f7e4a0db86d9fe9de38d">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
<li>infinity()
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#ab7a40820e64282376a050095d5004b74">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>inc_c()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#a365eb7c90a79c9ab32f603c6985a0316">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
</li>
<li>inc_d()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#a2ad473e8f2fa2694617ee39ead5c41b3">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#a49d7db2dab7a6d1e496ebff0e67039bc">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#aeb92092230ae933ff6cc4a36960d0674">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#abcb7af7b35e605dfda5ce6a37a02f975">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
</li>
<li>inc_h()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#a1d86f7e16bd11e10c94b0c14111c8c14">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#a40144d869b56b46cf1dd8f9941e61e77">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a1b94be88a160b21347c0eb58ed8e1b51">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#aaec63ca7faf0cf4f54cac31c7d6e0d3d">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
</li>
<li>inc_stage()
: <a class="el" href="structcutlass_1_1gemm_1_1SharedLoadStream.html#acf22fd09aa537943c16b900d66f1ec6f">cutlass::gemm::SharedLoadStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1SharedStreamPair.html#ad4b9b1c1fe4b0c6961842d0eff6d7db7">cutlass::gemm::SharedStreamPair&lt; StreamA_, StreamB_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a64ce59c5deb58e208529761a44c7661d">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#ad61206a742c8c5ab5bcd64b76ece9f74">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
</li>
<li>inc_w()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#a760404b7879a38364d7eef47fc1fe209">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd.html#ab1d9e606a89d3dd315df3d3efa48bcc2">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#af4f964364fc54a2b9a431fa529f6c44c">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#aa676184bbd4c2e3f6c09dbc548e6c4e1">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
</li>
<li>increment()
: <a class="el" href="classcutlass_1_1ZipTileIterator.html#a738f23c02f4a7437981d9e3e22470808">cutlass::ZipTileIterator&lt; First_, Second_ &gt;</a>
</li>
<li>init_problem()
: <a class="el" href="structcutlass_1_1gemm_1_1SplitkPIGemmTraits_1_1Params.html#ae447cd662efb8099f040fb0dffc4f104">cutlass::gemm::SplitkPIGemmTraits&lt; GemmTraits_, ReductionTraits_ &gt;::Params</a>
<li>initial_offset()
: <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1InterleavedOutputTileThreadMap.html#af0ec4c4a46c5a83150b3f1ac80ca8e2d">cutlass::epilogue::threadblock::InterleavedOutputTileThreadMap&lt; WarpCount_, MmaCount_, Threads, ElementsPerAccess, ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1OutputTileOptimalThreadMap_1_1CompactedThreadMap.html#a78883d7cac3a619cce6006dde714cfda">cutlass::epilogue::threadblock::OutputTileOptimalThreadMap&lt; Shape_, Count_, Threads, ElementsPerAccess, ElementSize &gt;::CompactedThreadMap</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1OutputTileOptimalThreadMap.html#a39026f56939737423ace3f6471b4c159">cutlass::epilogue::threadblock::OutputTileOptimalThreadMap&lt; Shape_, Count_, Threads, ElementsPerAccess, ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1OutputTileThreadMap.html#acd308197f2e234388a824273d592d965">cutlass::epilogue::threadblock::OutputTileThreadMap&lt; ThreadMap_, Shape_, Iterations_, Delta_, Count_ &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinear2DThreadTileStripminedThreadMap_3_01Shape___00_01Thread0082c3467229b12cc9dd996283ee7160.html#a96ac336cac3a8b4d10f1764a925e0902">cutlass::transform::PitchLinear2DThreadTileStripminedThreadMap&lt; Shape_, Threads, cutlass::layout::PitchLinearShape&lt; 4, 4 &gt; &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinearStripminedThreadMap.html#aeb09f5131cac18bfd820d2ab4cb06c49">cutlass::transform::PitchLinearStripminedThreadMap&lt; Shape_, Threads, ElementsPerAccess &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinearTilePolicyStripminedThreadContiguous.html#ab397cf8fa1f24bf54352e1352a9af1c9">cutlass::transform::PitchLinearTilePolicyStripminedThreadContiguous&lt; Shape, Threads, ElementsPerAccess &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinearTilePolicyStripminedThreadStrided.html#ab970c0505583b4e6f928b9a790c03856">cutlass::transform::PitchLinearTilePolicyStripminedThreadStrided&lt; Shape, Threads, ElementsPerAccess &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinearWarpRakedThreadMap.html#a495158bd07a83fa73c78bc4e41b92c86">cutlass::transform::PitchLinearWarpRakedThreadMap&lt; Shape_, Threads, WarpThreadArrangement_, ElementsPerAccess &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1PitchLinearWarpStripedThreadMap.html#acc6d9ccbb71792f3dea2e7c6c88f3a07">cutlass::transform::PitchLinearWarpStripedThreadMap&lt; Shape_, Threads, WarpThreadArrangement_, ElementsPerAccess &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1TransposePitchLinearThreadMap2DThreadTile.html#a93bf84427a6f28f45df317200ee2a404">cutlass::transform::TransposePitchLinearThreadMap2DThreadTile&lt; ThreadMap_ &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1TransposePitchLinearThreadMap.html#a1efbb1ee0b34e0d258fc74c201d9ee02">cutlass::transform::TransposePitchLinearThreadMap&lt; ThreadMap_, WarpThreadArrangement_ &gt;</a>
, <a class="el" href="structcutlass_1_1transform_1_1TransposePitchLinearThreadMapSimt.html#a7f8daecfdf34c489e01a1fb47fd486a5">cutlass::transform::TransposePitchLinearThreadMapSimt&lt; ThreadMap_ &gt;</a>
</li>
<li>initialize()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmEpilogueTraits_1_1Params.html#a13395bf81eabdc539c935e179c31d7ca">cutlass::gemm::GemmEpilogueTraits&lt; OutputTile_, Accumulators_, GlobalLoadIteratorC_, GlobalTransformerC_, GlobalTransformerD_, GlobalStoreIteratorD_, SharedStoreIteratorD_, SharedStoreTransformerD_, SharedLoadStreamD_, Iterations_, Delta_, Functor_, Index_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb_1_1Params.html#a2eeb499326e3f595bd1d23d7214b2f62">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd_1_1Params.html#acee5d95468f486fe4e49e954dd410a89">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GemmTraits_1_1Params.html#a40023f0ffdd8bee4ccbcaac28222e983">cutlass::gemm::GemmTraits&lt; GemmConfig_, GlobalLoadStreamA_, GlobalLoadStreamB_, SharedLoadStreamA_, SharedLoadStreamB_, Epilogue_, BlockSwizzle_, Index_, ClearAccumulators_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1GlobalLoadStream_1_1Params.html#aeb306cd3cb97471774b425fb50a861ae">cutlass::gemm::GlobalLoadStream&lt; Operand, LoadIterator_, StoreIterator_, Transformer_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1LinearScaling_1_1Params.html#ad4089906220d4656ba075fb9afd1012c">cutlass::gemm::LinearScaling&lt; Scalar_, FragmentMultiplyAdd_ &gt;::Params</a>
, <a class="el" href="classcutlass_1_1gemm_1_1LinearScalingDevicePtr_1_1Params.html#ad1b2291b898091ee1966b73bd1ad56fa">cutlass::gemm::LinearScalingDevicePtr&lt; Scalar_, FragmentMultiplyAdd_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1SharedLoadStream.html#a9b62788c187fff49b0250c0070a41fa0">cutlass::gemm::SharedLoadStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1SharedLoadStream_1_1Params.html#adb66103b905b35a1594c6f0bab65758a">cutlass::gemm::SharedLoadStream&lt; Iterator_, Transformer_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1SplitkPIGemmTraits_1_1Params.html#aec998017d6046436cd4e4c933a2a89a6">cutlass::gemm::SplitkPIGemmTraits&lt; GemmTraits_, ReductionTraits_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCd_1_1Params.html#a98867f4fc4daf790e309f8365e71cc8f">cutlass::gemm::WmmaGemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;::Params</a>
: <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1InterleavedPredicatedTileIterator_1_1Params.html#a6f0ad92d44376e1bf61e7fb6932a3dfd">cutlass::epilogue::threadblock::InterleavedPredicatedTileIterator&lt; ThreadMap_, Element_, InterleavedK &gt;::Params</a>
, <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1PredicatedTileIterator_1_1Params.html#ad5da25e1dd34da92acbb00b25f4be7f5">cutlass::epilogue::threadblock::PredicatedTileIterator&lt; ThreadMap_, Element_ &gt;::Params</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1Gemm.html#a53d79d1b434100da1e466e6378ec43ab">cutlass::gemm::device::Gemm&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, LayoutC_, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, SplitKSerial, Operator_, IsBetaZero &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1Gemm_3_01ElementA___00_01LayoutA___00_01ElementB___00_01Layout4d0960ae6b1d1bf19e6239dbd002249c.html#a7a14474e4238d2fac92ad71c6de087d8">cutlass::gemm::device::Gemm&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, layout::ColumnMajor, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, SplitKSerial, Operator_, IsBetaZero &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmBatched.html#aa2670ac441f48f6a0a2071c67c743ab8">cutlass::gemm::device::GemmBatched&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, LayoutC_, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, Operator_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmBatched_3_01ElementA___00_01LayoutA___00_01ElementB___00_0c9bb6f4463ab6085e6008b5d5ad6abfd.html#a428d8b1c4ac36040145a59d8e4cff3d2">cutlass::gemm::device::GemmBatched&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, layout::ColumnMajor, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, AlignmentA, AlignmentB, Operator_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmComplex.html#acec1cbb9d876e0d7ee8e8e9992e592ae">cutlass::gemm::device::GemmComplex&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, LayoutC_, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, TransformA, TransformB, SplitKSerial &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmComplex_3_01ElementA___00_01LayoutA___00_01ElementB___00_07c56401b4df75709ae636675d9980a9a.html#a5c3286631f254746c9eb788b780cdca3">cutlass::gemm::device::GemmComplex&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, layout::ColumnMajor, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ThreadblockSwizzle_, Stages, TransformA, TransformB, SplitKSerial &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmSplitKParallel.html#a7085b7cf85bc1bcd202ea6928656d966">cutlass::gemm::device::GemmSplitKParallel&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, LayoutC_, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ConvertScaledOp_, ReductionOp_, ThreadblockSwizzle_, Stages, kAlignmentA, kAlignmentB, Operator_ &gt;</a>
, <a class="el" href="classcutlass_1_1gemm_1_1device_1_1GemmSplitKParallel_3_01ElementA___00_01LayoutA___00_01ElementBbe7c1f7154ad5b5bf9d4d28301e2b457.html#a4d9f086305f76d7f885bf032f3d2c7c9">cutlass::gemm::device::GemmSplitKParallel&lt; ElementA_, LayoutA_, ElementB_, LayoutB_, ElementC_, layout::ColumnMajor, ElementAccumulator_, OperatorClass_, ArchTag_, ThreadblockShape_, WarpShape_, InstructionShape_, EpilogueOutputOp_, ConvertScaledOp_, ReductionOp_, ThreadblockSwizzle_, Stages, kAlignmentA, kAlignmentB, Operator_ &gt;</a>
, <a class="el" href="classcutlass_1_1library_1_1Manifest.html#a23feae702cfd606ed14d1407bb9d799d">cutlass::library::Manifest</a>
, <a class="el" href="classcutlass_1_1library_1_1Operation.html#a649274fbec9e5f2e6dbad128f7780166">cutlass::library::Operation</a>
, <a class="el" href="structcutlass_1_1reduction_1_1BatchedReductionTraits_1_1Params.html#ac27f42beb3625c5183b76b26677c0cb0">cutlass::reduction::BatchedReductionTraits&lt; ScalarA_, ScalarC_, ScalarD_, ScalarAlphaBeta_, ScalarAccum_, ReductionSize_, OutputTile_, SubTile_, ThreadShape_, Index_, BlockSwizzle_, maxInReg_, maxOutReg_, Functor_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileIteratorBase_1_1Params.html#a9d376b0b6e6cf6b8285eb2a30536c772">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator_1_1Params.html#a3175746438646453e93e6e08e954bc8d">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator_1_1Params.html#aca14058b112b7d5105658457341726cb">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
</li>
<li>initialize_predicates()
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorAb.html#aba8142a7a3b43da97f7968d98f3ba018">cutlass::gemm::GemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IgemmGlobalIteratorAb.html#a51b852a4023411020cb44c292f109e3d">cutlass::gemm::IgemmGlobalIteratorAb&lt; TileTraits_, Index_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileIteratorBase.html#aa58daf082cf97108e2e2ad0b1fd89208">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadIterator.html#a60bbb4d4a6a5b8fb32e176e7d33f9e82">cutlass::TileLoadIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreIterator.html#acb6bc889b93d25c9e483a0b7297d7c89">cutlass::TileStoreIterator&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;</a>
, <a class="el" href="classcutlass_1_1ZipTileIterator.html#a8f334010614b50d962e4769904d7b76f">cutlass::ZipTileIterator&lt; First_, Second_ &gt;</a>
<li>integer_subbyte()
: <a class="el" href="structcutlass_1_1integer__subbyte.html#a83fbb796074a21304ca685ac3fb2d02b">cutlass::integer_subbyte&lt; Bits, Signed &gt;</a>
</li>
<li>intermediate_fragment()
: <a class="el" href="structcutlass_1_1TileLoadStream.html#af2727fc0ddeffd1cdaef751140aa6093">cutlass::TileLoadStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreStream.html#aff77aed0f1b1583b01a427fc935c5d71">cutlass::TileStoreStream&lt; Iterator_, Transformer_ &gt;</a>
<li>InterleavedEpilogue()
: <a class="el" href="classcutlass_1_1epilogue_1_1threadblock_1_1InterleavedEpilogue.html#a2e1f4ab98f9c69170bbcf05037c78eaf">cutlass::epilogue::threadblock::InterleavedEpilogue&lt; Shape_, WarpMmaOperator_, PartitionsK, OutputTileIterator_, AccumulatorFragmentIterator_, OutputOp_, InterleavedK, IsBetaZero &gt;</a>
</li>
<li>is_last_partition()
: <a class="el" href="structcutlass_1_1gemm_1_1ColumnMajorBlockSwizzle.html#a5ae6e14979379e5c917309896bd6d483">cutlass::gemm::ColumnMajorBlockSwizzle&lt; groupCols, swDirection &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1IdentityBlockSwizzle.html#afb0d53bc4c077c787f01e17931e06564">cutlass::gemm::IdentityBlockSwizzle</a>
, <a class="el" href="structcutlass_1_1gemm_1_1RowMajorBlockSwizzle.html#aba2c62f525e46ba1e4e55bd60868b505">cutlass::gemm::RowMajorBlockSwizzle&lt; groupRows, swDirection &gt;</a>
<li>InterleavedPredicatedTileIterator()
: <a class="el" href="classcutlass_1_1epilogue_1_1threadblock_1_1InterleavedPredicatedTileIterator.html#aab0960ebd371ed02c4c7c5f8e2c2caf5">cutlass::epilogue::threadblock::InterleavedPredicatedTileIterator&lt; ThreadMap_, Element_, InterleavedK &gt;</a>
</li>
<li>is_pointer()
: <a class="el" href="classcutlass_1_1detail_1_1ScalarOrPointer.html#a95373f3d1b286c61cb204ba6a1282ce0">cutlass::detail::ScalarOrPointer&lt; Scalar_ &gt;</a>
<li>inverse()
: <a class="el" href="classcutlass_1_1layout_1_1ColumnMajor.html#a4d2ea34ea48b0702da0d20ffcd21be30">cutlass::layout::ColumnMajor</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorBlockLinear.html#aaf2b7966340292ba65e3cb6163b4348a">cutlass::layout::ColumnMajorBlockLinear&lt; BlockRows, BlockColumns &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorInterleaved.html#a7e5a49fed5354bfaf49213bf9b2483dd">cutlass::layout::ColumnMajorInterleaved&lt; Interleave &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorTensorOpMultiplicandCongruous.html#ae7834e63ec3b61d181f847011be413ab">cutlass::layout::ColumnMajorTensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorTensorOpMultiplicandCrosswise.html#a09eaa824aea4b98af2e71c14f572fd56">cutlass::layout::ColumnMajorTensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandBCongruous.html#ab83e570cf85596c1639c8eac50ae8597">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandBCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandCongruous.html#adc9104c8495005e5df53accd5aca86d4">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ColumnMajorVoltaTensorOpMultiplicandCrosswise.html#a5b7ac45dcec3ffdee65117ab9d9c439d">cutlass::layout::ColumnMajorVoltaTensorOpMultiplicandCrosswise&lt; ElementSize, KBlock &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1ContiguousMatrix.html#ab85bae46a22d05a7d216aefa68188c7f">cutlass::layout::ContiguousMatrix</a>
, <a class="el" href="classcutlass_1_1layout_1_1PitchLinear.html#a1e71c63f9ba751f1415492ef581fd93a">cutlass::layout::PitchLinear</a>
, <a class="el" href="classcutlass_1_1layout_1_1RowMajor.html#ac2508255cec15a07a2c082f9a58b7e6d">cutlass::layout::RowMajor</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorBlockLinear.html#abcb565659a5e7e3a601eb993d43ea71c">cutlass::layout::RowMajorBlockLinear&lt; BlockRows, BlockColumns &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorInterleaved.html#a34770f321b9fefd9c8052abbb1643deb">cutlass::layout::RowMajorInterleaved&lt; Interleave &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorTensorOpMultiplicandCongruous.html#a67e0749e995824bc35a8cde478f7c631">cutlass::layout::RowMajorTensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorTensorOpMultiplicandCrosswise.html#a1fa92e43f3d6b1874f9fe5c1f87b8ee0">cutlass::layout::RowMajorTensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandBCongruous.html#ab5bc99d0b654ac8a086e1f8012fe2f16">cutlass::layout::RowMajorVoltaTensorOpMultiplicandBCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandCongruous.html#a49a401c647d68b6f845ccd704e7328bb">cutlass::layout::RowMajorVoltaTensorOpMultiplicandCongruous&lt; ElementSize &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1RowMajorVoltaTensorOpMultiplicandCrosswise.html#a36a240a540307090f18c6ed152deeae2">cutlass::layout::RowMajorVoltaTensorOpMultiplicandCrosswise&lt; ElementSize, KBlock &gt;</a>
, <a class="el" href="classcutlass_1_1layout_1_1TensorNHWC.html#ac172f5707f9eb601046c8fde392a2bf6">cutlass::layout::TensorNHWC</a>
, <a class="el" href="structcutlass_1_1layout_1_1TensorOpMultiplicandCongruous.html#a6ef0968585fcb6bb564e1ea6c4bdc9a3">cutlass::layout::TensorOpMultiplicandCongruous&lt; ElementSize, Crosswise &gt;</a>
, <a class="el" href="structcutlass_1_1layout_1_1TensorOpMultiplicandCrosswise.html#ac4ff3d7bfc5303cb2dee432a7cc430da">cutlass::layout::TensorOpMultiplicandCrosswise&lt; ElementSize, Crosswise &gt;</a>
</li>
<li>is_source_ever_needed()
: <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1Convert.html#a3dbcb283d1a62392cb0f00d7334952ea">cutlass::epilogue::thread::Convert&lt; ElementOutput_, Count, ElementAccumulator_, Round &gt;</a>
</li>
<li>is_source_needed()
: <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1Convert.html#a7dc10ee38d2433e1e0d5cb4edac38a42">cutlass::epilogue::thread::Convert&lt; ElementOutput_, Count, ElementAccumulator_, Round &gt;</a>
, <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1LinearCombination.html#a0c576129fa70b60d7ad81ebbc8b8f22d">cutlass::epilogue::thread::LinearCombination&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;</a>
, <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1LinearCombinationClamp.html#a3567f90bb09ece3311af0c28e6784c91">cutlass::epilogue::thread::LinearCombinationClamp&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;</a>
, <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu.html#a6ba2de177b25375afc33043d665a5114">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, ElementAccumulator_, ElementCompute_, Round &gt;</a>
, <a class="el" href="classcutlass_1_1epilogue_1_1thread_1_1LinearCombinationRelu_3_01ElementOutput___00_01Count_00_01int_00_01float_00_01Round_01_4.html#af360ea56761af5fe2904ad1d7ff799c3">cutlass::epilogue::thread::LinearCombinationRelu&lt; ElementOutput_, Count, int, float, Round &gt;</a>
</li>
<li>is_zero()
: <a class="el" href="structcutlass_1_1PredicateVector.html#a1c4fe2bec906cd7937428ed6561ac79a">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;</a>
: <a class="el" href="structcutlass_1_1PredicateVector.html#a29b6a3044b89d0b3ff98fd571e12cdd8">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;</a>
</li>
<li>iterator()
: <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01false_01_4_1_1iterator.html#adb69680f23a0ba9bbe107900fa537228">cutlass::Array&lt; T, N, false &gt;::iterator</a>
, <a class="el" href="classcutlass_1_1Array_3_01T_00_01N_00_01true_01_4_1_1iterator.html#ac50cf5822b023f4752d80f71963990cb">cutlass::Array&lt; T, N, true &gt;::iterator</a>
</li>
<li>Iterator()
: <a class="el" href="classcutlass_1_1PredicateVector_1_1Iterator.html#a91b7d25cbd64e696ef23c87671f0b077">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;::Iterator</a>
: <a class="el" href="classcutlass_1_1PredicateVector_1_1Iterator.html#a08a7c4bd292f3dde6fdb7b8ae3eac4eb">cutlass::PredicateVector&lt; kPredicates_, kPredicatesPerByte_, kPredicateStart_ &gt;::Iterator</a>
</li>
</ul>
</div><!-- contents -->
<!-- start footer part -->
<hr class="footer"/><address class="footer"><small>
Generated on Fri Oct 26 2018 14:53:41 for Cutlass by &#160;<a href="http://www.doxygen.org/index.html">
Generated by &#160;<a href="http://www.doxygen.org/index.html">
<img class="footer" src="doxygen.png" alt="doxygen"/>
</a> 1.8.14
</a> 1.8.11
</small></address>
</body>
</html>