leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 28 Packages Projects Releases Wiki Activity

CUTLASS 2.0 (#62)

Browse Source 
CUTLASS 2.0

Substantially refactored for

- Better performance, particularly for native Turing Tensor Cores
- Robust and durable templates spanning the design space
- Encapsulated functionality embodying modern C++11 programming techniques
- Optimized containers and data types for efficient, generic, portable device code

Updates to:
- Quick start guide
- Documentation
- Utilities
- CUTLASS Profiler

Native Turing Tensor Cores
- Efficient GEMM kernels targeting Turing Tensor Cores
- Mixed-precision floating point, 8-bit integer, 4-bit integer, and binarized operands

Coverage of existing CUTLASS functionality:
- GEMM kernels targeting CUDA and Tensor Cores in NVIDIA GPUs
- Volta Tensor Cores through native mma.sync and through WMMA API
- Optimizations such as parallel reductions, threadblock rasterization, and intra-threadblock reductions
- Batched GEMM operations
- Complex-valued GEMMs

Note: this commit and all that follow require a host compiler supporting C++11 or greater.
This commit is contained in:
Andrew Kerr
2019-11-19 16:55:34 -08:00
committed by GitHub
parent b5cab177a9
commit fb335f6a5f
5434 changed files with 599799 additions and 250176 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/search/classes_13.js
+6 -4
View File
@@ -1,7 +1,9 @@
var searchData=
[
['wmmagemmglobaliteratorcd',['WmmaGemmGlobalIteratorCd',['../structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCd.html',1,'cutlass::gemm']]],
['wmmagemmglobaliteratorcdtraits',['WmmaGemmGlobalIteratorCdTraits',['../structcutlass_1_1gemm_1_1WmmaGemmGlobalIteratorCdTraits.html',1,'cutlass::gemm']]],
['wmmareshapetile',['WmmaReshapeTile',['../structcutlass_1_1WmmaReshapeTile.html',1,'cutlass']]],
['wmmareshapetile_3c_20tile_5f_2c_20kaccesssize_5f_2c_20kldsperaccess_5f_2c_20true_20_3e',['WmmaReshapeTile< Tile_, kAccessSize_, kLdsPerAccess_, true >',['../structcutlass_1_1WmmaReshapeTile_3_01Tile___00_01kAccessSize___00_01kLdsPerAccess___00_01true_01_4.html',1,'cutlass']]]
['voltatensoropmultiplicandbcongruous',['VoltaTensorOpMultiplicandBCongruous',['../structcutlass_1_1layout_1_1VoltaTensorOpMultiplicandBCongruous.html',1,'cutlass::layout']]],
['voltatensoropmultiplicandcongruous',['VoltaTensorOpMultiplicandCongruous',['../structcutlass_1_1layout_1_1VoltaTensorOpMultiplicandCongruous.html',1,'cutlass::layout']]],
['voltatensoropmultiplicandcrosswise',['VoltaTensorOpMultiplicandCrosswise',['../structcutlass_1_1layout_1_1VoltaTensorOpMultiplicandCrosswise.html',1,'cutlass::layout']]],
['voltatensoroppolicy',['VoltaTensorOpPolicy',['../structcutlass_1_1epilogue_1_1warp_1_1VoltaTensorOpPolicy.html',1,'cutlass::epilogue::warp']]],
['voltatensoroppolicy_3c_20warpshape_5f_2c_20gemm_3a_3agemmshape_3c_2032_2c_2032_2c_204_20_3e_2c_20float_2c_20layout_3a_3arowmajor_20_3e',['VoltaTensorOpPolicy< WarpShape_, gemm::GemmShape< 32, 32, 4 >, float, layout::RowMajor >',['../structcutlass_1_1epilogue_1_1warp_1_1VoltaTensorOpPolicy_3_01WarpShape___00_01gemm_1_1GemmShape_136ce744d4c1c6e8707f5a9785196194.html',1,'cutlass::epilogue::warp']]],
['voltatensoroppolicy_3c_20warpshape_5f_2c_20gemm_3a_3agemmshape_3c_2032_2c_2032_2c_204_20_3e_2c_20half_5ft_2c_20layout_3a_3arowmajor_20_3e',['VoltaTensorOpPolicy< WarpShape_, gemm::GemmShape< 32, 32, 4 >, half_t, layout::RowMajor >',['../structcutlass_1_1epilogue_1_1warp_1_1VoltaTensorOpPolicy_3_01WarpShape___00_01gemm_1_1GemmShape_1d48185f49e4d066f8e9327bf0856b7f.html',1,'cutlass::epilogue::warp']]]
];