cutlass

324 Commits 1 Branch 1 Tag

3 Commits

Author	SHA1	Message	Date
dan_the_3rddanthe3rd <danthe3rd>Haicheng Wu	1b4e24470a	Example 43 - DualGemm (#670 ) * Ex50 wip * IS_PROFILING mode * MultiStage2 - but is slower * Add SwiGLU * Support SplitKSerial reduction Support not storing D0/D1 Cleanup code * Option to disable bias * Renumber example * Fix build * Remove references to pb_size_0 / pb_size_1 * Add support for bf16 inputs with float accum * small changes Co-authored-by: danthe3rd <danthe3rd> Co-authored-by: Haicheng Wu <haichengw@nvidia.com>	2022-10-26 14:04:42 -04:00
dan_the_3rdanddanthe3rd <danthe3rd>	4db6a6140e	ex42: Fused MHA imported from xFormers (#662 ) * ex42: Fused MHA imported from xFormers * Remove std:: references * Support K>128 in the example * Support causal option * Support different head size for V, and different seqlength for KV * Update FLOPS counter * Remove bit_cast * fix build: Replace M_LOG2E * Add doc * Revert "Remove bit_cast" This reverts commit 9662fa86bb7c57c1a015ac0bf52cb52940fbbf80. * Explicit casts to int32_t for windows build Co-authored-by: danthe3rd <danthe3rd>	2022-10-17 10:49:33 -04:00
dan_the_3rdanddanthe3rd	25ebf15d02	Ensure all arch::Mma specializations have ElementC set (#576 ) Co-authored-by: danthe3rd <danthe3rd@users.noreply.github.com>	2022-07-22 23:53:03 -04:00

Author

SHA1

Message

Date

1b4e24470a

Example 43 - DualGemm (#670 )

* Ex50 wip

* IS_PROFILING mode

* MultiStage2 - but is slower

* Add SwiGLU

* Support SplitKSerial reduction
Support not storing D0/D1
Cleanup code

* Option to disable bias

* Renumber example

* Fix build

* Remove references to pb_size_0 / pb_size_1

* Add support for bf16 inputs with float accum

* small changes

Co-authored-by: danthe3rd <danthe3rd>
Co-authored-by: Haicheng Wu <haichengw@nvidia.com>

2022-10-26 14:04:42 -04:00

dan_the_3rdanddanthe3rd <danthe3rd>

4db6a6140e

ex42: Fused MHA imported from xFormers (#662 )

* ex42: Fused MHA imported from xFormers

* Remove std:: references

* Support K>128 in the example

* Support causal option

* Support different head size for V, and different seqlength for KV

* Update FLOPS counter

* Remove bit_cast

* fix build: Replace M_LOG2E

* Add doc

* Revert "Remove bit_cast"

This reverts commit 9662fa86bb7c57c1a015ac0bf52cb52940fbbf80.

* Explicit casts to int32_t for windows build

Co-authored-by: danthe3rd <danthe3rd>

2022-10-17 10:49:33 -04:00

dan_the_3rdanddanthe3rd

25ebf15d02

Ensure all arch::Mma specializations have ElementC set (#576 )

Co-authored-by: danthe3rd <danthe3rd@users.noreply.github.com>

2022-07-22 23:53:03 -04:00