leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 30 Packages Projects Releases Wiki Activity

CUTLASS 2.0 (#62)

Browse Source 
CUTLASS 2.0

Substantially refactored for

- Better performance, particularly for native Turing Tensor Cores
- Robust and durable templates spanning the design space
- Encapsulated functionality embodying modern C++11 programming techniques
- Optimized containers and data types for efficient, generic, portable device code

Updates to:
- Quick start guide
- Documentation
- Utilities
- CUTLASS Profiler

Native Turing Tensor Cores
- Efficient GEMM kernels targeting Turing Tensor Cores
- Mixed-precision floating point, 8-bit integer, 4-bit integer, and binarized operands

Coverage of existing CUTLASS functionality:
- GEMM kernels targeting CUDA and Tensor Cores in NVIDIA GPUs
- Volta Tensor Cores through native mma.sync and through WMMA API
- Optimizations such as parallel reductions, threadblock rasterization, and intra-threadblock reductions
- Batched GEMM operations
- Complex-valued GEMMs

Note: this commit and all that follow require a host compiler supporting C++11 or greater.
This commit is contained in:
Andrew Kerr
2019-11-19 16:55:34 -08:00
committed by GitHub
parent b5cab177a9
commit fb335f6a5f
5434 changed files with 599799 additions and 250176 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/functions_vars_i.html
+133 -48
View File
@@ -3,21 +3,23 @@
<head>
<meta http-equiv="Content-Type" content="text/xhtml;charset=UTF-8"/>
<meta http-equiv="X-UA-Compatible" content="IE=9"/>
<meta name="generator" content="Doxygen 1.8.14"/>
<meta name="viewport" content="width=device-width, initial-scale=1"/>
<title>Cutlass: Class Members - Variables</title>
<meta name="generator" content="Doxygen 1.8.11"/>
<title>CUTLASS: Class Members - Variables</title>
<link href="tabs.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="jquery.js"></script>
<script type="text/javascript" src="dynsections.js"></script>
<link href="search/search.css" rel="stylesheet" type="text/css"/>
<script type="text/javascript" src="search/searchdata.js"></script>
<script type="text/javascript" src="search/search.js"></script>
<script type="text/javascript">
$(document).ready(function() { init_search(); });
</script>
<script type="text/x-mathjax-config">
MathJax.Hub.Config({
extensions: ["tex2jax.js"],
jax: ["input/TeX","output/HTML-CSS"],
});
</script><script type="text/javascript" async src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
</script><script type="text/javascript" src="http://cdn.mathjax.org/mathjax/latest/MathJax.js"></script>
<link href="doxygen.css" rel="stylesheet" type="text/css" />
</head>
<body>
@@ -26,8 +28,9 @@
<table cellspacing="0" cellpadding="0">
<tbody>
<tr style="height: 56px;">
<td id="projectlogo"><img alt="Logo" src="cutlass-logo-small.png"/></td>
<td id="projectalign" style="padding-left: 0.5em;">
<div id="projectname">Cutlass
<div id="projectname">CUTLASS
</div>
<div id="projectbrief">CUDA Templates for Linear Algebra Subroutines and Solvers</div>
</td>
@@ -36,22 +39,78 @@
</table>
</div>
<!-- end header part -->
<!-- Generated by Doxygen 1.8.14 -->
<!-- Generated by Doxygen 1.8.11 -->
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
var searchBox = new SearchBox("searchBox", "search",false,'Search');
/* @license-end */
</script>
<script type="text/javascript" src="menudata.js"></script>
<script type="text/javascript" src="menu.js"></script>
<script type="text/javascript">
/* @license magnet:?xt=urn:btih:cf05388f2679ee054f2beb29a391d25f4e673ac3&amp;dn=gpl-2.0.txt GPL-v2 */
$(function() {
initMenu('',true,false,'search.php','Search');
$(document).ready(function() { init_search(); });
});
/* @license-end */</script>
<div id="main-nav"></div>
<div id="navrow1" class="tabs">
<ul class="tablist">
<li><a href="index.html"><span>Main&#160;Page</span></a></li>
<li><a href="modules.html"><span>Modules</span></a></li>
<li><a href="namespaces.html"><span>Namespaces</span></a></li>
<li class="current"><a href="annotated.html"><span>Classes</span></a></li>
<li><a href="files.html"><span>Files</span></a></li>
<li>
<div id="MSearchBox" class="MSearchBoxInactive">
<span class="left">
<img id="MSearchSelect" src="search/mag_sel.png"
onmouseover="return searchBox.OnSearchSelectShow()"
onmouseout="return searchBox.OnSearchSelectHide()"
alt=""/>
<input type="text" id="MSearchField" value="Search" accesskey="S"
onfocus="searchBox.OnSearchFieldFocus(true)"
onblur="searchBox.OnSearchFieldFocus(false)"
onkeyup="searchBox.OnSearchFieldChange(event)"/>
</span><span class="right">
<a id="MSearchClose" href="javascript:searchBox.CloseResultsWindow()"><img id="MSearchCloseImg" border="0" src="search/close.png" alt=""/></a>
</span>
</div>
</li>
</ul>
</div>
<div id="navrow2" class="tabs2">
<ul class="tablist">
<li><a href="annotated.html"><span>Class&#160;List</span></a></li>
<li><a href="classes.html"><span>Class&#160;Index</span></a></li>
<li><a href="inherits.html"><span>Class&#160;Hierarchy</span></a></li>
<li class="current"><a href="functions.html"><span>Class&#160;Members</span></a></li>
</ul>
</div>
<div id="navrow3" class="tabs2">
<ul class="tablist">
<li><a href="functions.html"><span>All</span></a></li>
<li><a href="functions_func.html"><span>Functions</span></a></li>
<li class="current"><a href="functions_vars.html"><span>Variables</span></a></li>
<li><a href="functions_type.html"><span>Typedefs</span></a></li>
<li><a href="functions_enum.html"><span>Enumerations</span></a></li>
<li><a href="functions_eval.html"><span>Enumerator</span></a></li>
</ul>
</div>
<div id="navrow4" class="tabs3">
<ul class="tablist">
<li><a href="functions_vars.html#index_a"><span>a</span></a></li>
<li><a href="functions_vars_b.html#index_b"><span>b</span></a></li>
<li><a href="functions_vars_c.html#index_c"><span>c</span></a></li>
<li><a href="functions_vars_d.html#index_d"><span>d</span></a></li>
<li><a href="functions_vars_e.html#index_e"><span>e</span></a></li>
<li><a href="functions_vars_f.html#index_f"><span>f</span></a></li>
<li><a href="functions_vars_g.html#index_g"><span>g</span></a></li>
<li><a href="functions_vars_h.html#index_h"><span>h</span></a></li>
<li class="current"><a href="functions_vars_i.html#index_i"><span>i</span></a></li>
<li><a href="functions_vars_k.html#index_k"><span>k</span></a></li>
<li><a href="functions_vars_l.html#index_l"><span>l</span></a></li>
<li><a href="functions_vars_m.html#index_m"><span>m</span></a></li>
<li><a href="functions_vars_n.html#index_n"><span>n</span></a></li>
<li><a href="functions_vars_o.html#index_o"><span>o</span></a></li>
<li><a href="functions_vars_p.html#index_p"><span>p</span></a></li>
<li><a href="functions_vars_r.html#index_r"><span>r</span></a></li>
<li><a href="functions_vars_s.html#index_s"><span>s</span></a></li>
<li><a href="functions_vars_t.html#index_t"><span>t</span></a></li>
<li><a href="functions_vars_u.html#index_u"><span>u</span></a></li>
<li><a href="functions_vars_v.html#index_v"><span>v</span></a></li>
<li><a href="functions_vars_w.html#index_w"><span>w</span></a></li>
</ul>
</div>
</div><!-- top -->
<!-- window showing the filter options -->
<div id="MSearchSelectWindow"
@@ -70,50 +129,76 @@ $(function() {
<div class="contents">
&#160;
<h3><a id="index_i"></a>- i -</h3><ul>
<li>idx
: <a class="el" href="structcutlass_1_1Coord.html#a872e1e0d9cc255fa438c04daaf10ad68">cutlass::Coord&lt; Rank_, Index_ &gt;</a>
<h3><a class="anchor" id="index_i"></a>- i -</h3><ul>
<li>imag
: <a class="el" href="structcutlass_1_1TypeTraits_3_01complex_3_01double_01_4_01_4_1_1integer__type.html#a48561bb780126ee1ed97a018f07d89e5">cutlass::TypeTraits&lt; complex&lt; double &gt; &gt;::integer_type</a>
, <a class="el" href="structcutlass_1_1TypeTraits_3_01complex_3_01double_01_4_01_4_1_1unsigned__type.html#a8227d537a527c7c577a23c1abd89cee2">cutlass::TypeTraits&lt; complex&lt; double &gt; &gt;::unsigned_type</a>
</li>
<li>inc_advance
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd_1_1Params.html#a8c2618ac16362a8362dcddeed71c41d4">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileIteratorBase_1_1Params.html#a366c41dbc3bb82521db46b6d0db127b9">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
<li>imag_stride_A
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#abb6ffb03518c675cfc1a053cbd99fb21">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexConfiguration.html#a72722870aa853bb9c0418d69aba3fa1f">cutlass::library::GemmPlanarComplexConfiguration</a>
</li>
<li>inc_d
: <a class="el" href="structcutlass_1_1TileIteratorBase_1_1Params.html#a901e9df85e9eee0e89a025b874e1b61b">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
<li>imag_stride_B
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a686433eb8204460768f99693b575ed90">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexConfiguration.html#ad66c23752ee28b8d364487aa6bee4e58">cutlass::library::GemmPlanarComplexConfiguration</a>
</li>
<li>inc_h
: <a class="el" href="structcutlass_1_1gemm_1_1GemmGlobalIteratorCd_1_1Params.html#aed94505e5a269d5f33499e71284104f5">cutlass::gemm::GemmGlobalIteratorCd&lt; TileTraits_, Index_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileIteratorBase_1_1Params.html#a15227102466522445261b6ea65c89c06">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
<li>imag_stride_C
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a9978b56ab1e2c7df6129c7adb66d8cd0">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexConfiguration.html#a0878decb9bc1f4194e8f029f8a8fdca1">cutlass::library::GemmPlanarComplexConfiguration</a>
</li>
<li>inc_w
: <a class="el" href="structcutlass_1_1TileIteratorBase_1_1Params.html#af0be1271cfe6d6c03a9a76ff992d8a5c">cutlass::TileIteratorBase&lt; Traits_, Scalar_, Advance_, MemorySpace, Index_, FragmentElement_, FragmentElementType_, Skew_ &gt;::Params</a>
<li>imag_stride_D
: <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexBatchedConfiguration.html#a766b8458393c7c16d74ce3876925f592">cutlass::library::GemmPlanarComplexBatchedConfiguration</a>
, <a class="el" href="structcutlass_1_1library_1_1GemmPlanarComplexConfiguration.html#aa69b38abf8674a34ad61f2e1f60d3324">cutlass::library::GemmPlanarComplexConfiguration</a>
</li>
<li>IsVector
: <a class="el" href="structcutlass_1_1VectorTraits.html#abf96ea5dfd3212d388cb91e48cc0e6a2">cutlass::VectorTraits&lt; T &gt;</a>
, <a class="el" href="structcutlass_1_1VectorTraits_3_01Vector_3_01T_00_01Lanes_01_4_01_4.html#aead181209c756f25ab5870682670bb99">cutlass::VectorTraits&lt; Vector&lt; T, Lanes &gt; &gt;</a>
, <a class="el" href="structcutlass_1_1VectorTraits_3_01Vector_3_01T_00_01Lanes_01_4_01const_01_4.html#a893488718d8437970c1b4ed4f4056620">cutlass::VectorTraits&lt; Vector&lt; T, Lanes &gt; const &gt;</a>
<li>increment_cluster
: <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1PredicatedTileIterator_1_1Params.html#af3e71c49f5c4830451ba7a70b960b772">cutlass::epilogue::threadblock::PredicatedTileIterator&lt; ThreadMap_, Element_ &gt;::Params</a>
</li>
<li>iterator
: <a class="el" href="structcutlass_1_1gemm_1_1SharedLoadStream.html#a54481a42d4125e3693a086269d9a7b10">cutlass::gemm::SharedLoadStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1gemm_1_1SharedLoadStream_1_1Params.html#ae59f871c06a0ac7b9224f0de923082d7">cutlass::gemm::SharedLoadStream&lt; Iterator_, Transformer_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileLoadStream.html#ab6d8716c166d071615f4e78d9ac6efb8">cutlass::TileLoadStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileLoadStream_1_1Params.html#a0430f377595718291f84ef62eb6f4e57">cutlass::TileLoadStream&lt; Iterator_, Transformer_ &gt;::Params</a>
, <a class="el" href="structcutlass_1_1TileStoreStream.html#a601a296ec830e9b98aca9d5cf4b4010c">cutlass::TileStoreStream&lt; Iterator_, Transformer_ &gt;</a>
, <a class="el" href="structcutlass_1_1TileStoreStream_1_1Params.html#acd106661221997d7c5943daac8eb5088">cutlass::TileStoreStream&lt; Iterator_, Transformer_ &gt;::Params</a>
<li>increment_group
: <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1PredicatedTileIterator_1_1Params.html#a5234c0bbe10bc907f90776dbce50d504">cutlass::epilogue::threadblock::PredicatedTileIterator&lt; ThreadMap_, Element_ &gt;::Params</a>
</li>
<li>iterator_c
: <a class="el" href="structcutlass_1_1gemm_1_1GemmEpilogueTraits_1_1Params.html#a0745d33dd881f6ca78b168e05b133ff8">cutlass::gemm::GemmEpilogueTraits&lt; OutputTile_, Accumulators_, GlobalLoadIteratorC_, GlobalTransformerC_, GlobalTransformerD_, GlobalStoreIteratorD_, SharedStoreIteratorD_, SharedStoreTransformerD_, SharedLoadStreamD_, Iterations_, Delta_, Functor_, Index_ &gt;::Params</a>
<li>increment_row
: <a class="el" href="structcutlass_1_1epilogue_1_1threadblock_1_1PredicatedTileIterator_1_1Params.html#aca9106ffd4fe4e3d139cf01f3916bcba">cutlass::epilogue::threadblock::PredicatedTileIterator&lt; ThreadMap_, Element_ &gt;::Params</a>
</li>
<li>iterator_d
: <a class="el" href="structcutlass_1_1gemm_1_1GemmEpilogueTraits_1_1Params.html#abbcccb203f9823e621caa4475aa3d346">cutlass::gemm::GemmEpilogueTraits&lt; OutputTile_, Accumulators_, GlobalLoadIteratorC_, GlobalTransformerC_, GlobalTransformerD_, GlobalStoreIteratorD_, SharedStoreIteratorD_, SharedStoreTransformerD_, SharedLoadStreamD_, Iterations_, Delta_, Functor_, Index_ &gt;::Params</a>
<li>instruction_shape
: <a class="el" href="structcutlass_1_1library_1_1MathInstructionDescription.html#ab6c56bb228a4ba93619bf69971dcc82e">cutlass::library::MathInstructionDescription</a>
</li>
<li>int_scale
: <a class="el" href="structcutlass_1_1Distribution.html#a676b1d8b87691b4218f6ed308e6adfc1">cutlass::Distribution</a>
, <a class="el" href="structcutlass_1_1reference_1_1device_1_1detail_1_1RandomGaussianFunc_1_1Params.html#a0f5b0c8508cd6d143da7bbe20b68a60c">cutlass::reference::device::detail::RandomGaussianFunc&lt; Element &gt;::Params</a>
, <a class="el" href="structcutlass_1_1reference_1_1device_1_1detail_1_1RandomUniformFunc_1_1Params.html#afe8637b103e25ec2e9b731389fa049be">cutlass::reference::device::detail::RandomUniformFunc&lt; Element &gt;::Params</a>
, <a class="el" href="structcutlass_1_1reference_1_1host_1_1detail_1_1RandomGaussianFunc.html#a4c9943f36faab7d4928b1f130d0b784c">cutlass::reference::host::detail::RandomGaussianFunc&lt; Element &gt;</a>
, <a class="el" href="structcutlass_1_1reference_1_1host_1_1detail_1_1RandomGaussianFunc_3_01complex_3_01Element_01_4_01_4.html#a6a906b7ae9c17b6ebe2063d652f3ab50">cutlass::reference::host::detail::RandomGaussianFunc&lt; complex&lt; Element &gt; &gt;</a>
, <a class="el" href="structcutlass_1_1reference_1_1host_1_1detail_1_1RandomUniformFunc.html#a9b410cf9a05a34317a83cce730f9a348">cutlass::reference::host::detail::RandomUniformFunc&lt; Element &gt;</a>
, <a class="el" href="structcutlass_1_1reference_1_1host_1_1detail_1_1RandomUniformFunc_3_01complex_3_01Element_01_4_01_4.html#ad0de7d4946af855288d7f9cccb9a18eb">cutlass::reference::host::detail::RandomUniformFunc&lt; complex&lt; Element &gt; &gt;</a>
</li>
<li>is_bounded
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#a59737f49161b87c259683c26737f42c2">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_exact
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#a7413e9cd24eb03a86cc5f2d47c49db3e">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_iec559
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#afc86b85a1fe209658a50d8c06e54cb77">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_integer
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#a2a2ec168a6f0e9f55dc42d3b3e5fff25">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_modulo
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#a640a034527a3577039053113bc1c5e46">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_signed
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#ab3a169117baca2e7fae33846caa5dbfd">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
<li>is_specialized
: <a class="el" href="structstd_1_1numeric__limits_3_01cutlass_1_1half__t_01_4.html#ade4affb586360c5356a7939c1b343a40">std::numeric_limits&lt; cutlass::half_t &gt;</a>
</li>
</ul>
</div><!-- contents -->
<!-- start footer part -->
<hr class="footer"/><address class="footer"><small>
Generated on Fri Oct 26 2018 14:53:41 for Cutlass by &#160;<a href="http://www.doxygen.org/index.html">
Generated by &#160;<a href="http://www.doxygen.org/index.html">
<img class="footer" src="doxygen.png" alt="doxygen"/>
</a> 1.8.14
</a> 1.8.11
</small></address>
</body>
</html>