leavelet/cutlass
1
0
Fork 0
Code Issues Pull Requests Actions 26 Packages Projects Releases Wiki Activity
741 Commits 1 Branch 1 Tag
afe2f7152206de3dc48c9355f653f1761a050b1c
Commit Graph
741 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Fung Xie afe2f71522 reorganize examples for tvm-ffi 2025-11-27 17:02:26 -08:00
Fung Xie 739fffce27 fix TVM FFI doc and update example 2025-11-27 17:02:26 -08:00
Junkai-Wu 1de3a576cc v4.3.1 update. (#2817) 2025-11-27 09:49:30 -05:00
Shreya GaurandShreya Gaur 2052fd3885 Blockscaled Ragged Contiguous Grouped Gemm for MoEs (#2790) 
* Adding blockscaled ragged contiguous grouped gemm for MoEs

* cleaning up the example

* introduction to example improved

---------

Co-authored-by: Shreya Gaur <shgaur@dc2-container-xterm-012.prd.it.nvidia.com>
 2025-11-26 20:16:49 -05:00
Haicheng Wu e67e63c331 Bump version from 4.2.1 to 4.3.0 2025-11-24 16:36:06 -05:00
Haicheng Wu ddaf12c1b1 Bump version from 4.2.0 to 4.3.0 2025-11-24 16:35:27 -05:00
Haicheng Wu 7967ce5f83 Bump version to 4.3.0 2025-11-24 16:34:45 -05:00
Junkai-Wu 8cd5bef43a v4.3 tag release update. (#2789) 2025-11-20 20:49:44 -05:00
Linfeng Zheng 406e078b29 add a notebook for tour to sol gemm (#2780) 
* add tour to sol gemm notebook

* change some typos

* change some typos
 2025-11-20 09:41:01 -05:00
Zekun Fan a2439551c7 Fixed editable install to depend on CuTeDSL/requirements.txt (#2768) 
To guarantee wheel version alignment of the source code.
 2025-11-14 15:31:49 -08:00
drazi bd96096d58 Merge pull request #2758 from limin2021/delete-pdl-example 
[cute-dsl][fix]remove cute dsl pdl example.
 2025-11-10 22:56:57 +08:00
Mindy Li 06b6bd7d7b remove cute dsl pdl example. 2025-11-09 21:47:00 -08:00
Linfeng Zheng 2252254ce2 Add tutorial fp16_gemm_1 (#2750) 
* Add tutorial fp16_gemm_1

* refine

* refine

* refine

* revert changes in fp16_gemm_0.py
 2025-11-06 22:40:09 -05:00
Ali Hassani d1ef0e87f2 DistGEMM bug fixes (#2713) 
* Blackwell DistGEMM bug fixes

1. If using preferred cluster, there needs to be a branch so that
   the universal GEMM wrapper finds the correct base params.
2. Workspace sizes can change depending on problem shape in Blackwell,
   and DistGEMM was previously using the per-device shape to evaluate
   workspace size instead of the per-gemm shape.
3. Flattened size used to initialize host tensors can overflow (in
   Hopper example as well)
4. Preferred and fallback cluster args need to be set explicitly,
   otherwise if someone modifies the example to use preferred cluster,
   it will just fail.

* Fix example runtimes

* Set default fallback cluster shapes to the static ones
 2025-11-06 13:31:24 -05:00
ANIKET SHIVAM 020c700e97 support for K=0 for sm100 GG (#2746) 2025-11-04 11:25:39 -05:00
Haicheng Wu 8afb19d904 update CITATION.cff 2025-10-28 23:42:37 -04:00
Qi Yuhang b2ca083d2b Fixed compilation error when using StreamK scheduler + PDL. (#2686) 2025-10-21 23:11:14 -04:00
Junkai-WuandLarry Wu b1d6e2c9b3 v4.3 update. (#2709) 
* v4.3 update.

* Update the cute_dsl_api changelog's doc link

* Update version to 4.3.0

* Update the example link

* Update doc to encourage user to install DSL from requirements.txt

---------

Co-authored-by: Larry Wu <larwu@nvidia.com>
 2025-10-21 14:26:30 -04:00
Lain e6e2cc29f5 fix (#2684) 2025-10-15 14:46:38 -04:00
Haicheng Wu c6aeb9179c Update pyproject.toml 
update version to 4.2.1
 2025-09-24 01:18:51 -04:00
Haicheng Wu 95a5ff14c0 Update CHANGELOG.md 
format change
 2025-09-23 17:33:00 -04:00
ANIKET SHIVAM fb8b43ef05 Merge pull request #2669 from NVIDIA/421_update 
4.2.1 update
 2025-09-23 14:02:29 -07:00
Haicheng Wu f874df19ac 4.2.1 update 2025-09-23 13:45:13 -07:00
Junkai-Wu 7a6d4ee099 v4.2.1 update. (#2666) 2025-09-23 13:25:43 -04:00
GTOKonstantinHaicheng Wu
 		2b8dff1f90 Fix bfloat16 epsilon (#2607) 
* Fix bfloat16 epsilon

* just use constants

---------

Co-authored-by: Konstantin <konstantin@MacBook-Air.local>
Co-authored-by: Haicheng Wu <haichengw@nvidia.com>
 2025-09-21 23:43:59 -04:00
103yiran fd0312ddf6 Remove duplicate function calls (#1584) 2025-09-21 23:16:59 -04:00
Aya Z. IbrahimRichard CaiHaicheng Wu
 		64579189ec Feature/add bottom causal mask (#2480) 
* Rebase to latest

* update

* upd

Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:

* Update fmha_fusion.hpp

* Update fmha_fusion.hpp

fixed flipped logic for isQBegin

* Update fmha_fusion.hpp

* Avoid use of booleans

The current expression is confusing

* fmt

* Update fmha_fusion.hpp

Reproduce error/fix with: 
./77_blackwell_fmha_fp16 --verify --b=1 --q=1013 --k=1024 --h=1 --h_k=1 --mask=causal --causal-type=qend

* add test, format

---------

Co-authored-by: Richard Cai <ricai@nvidia.com>
Co-authored-by: Haicheng Wu <57973641+hwu36@users.noreply.github.com>
 2025-09-18 17:11:23 -04:00
Jack Kosaian b234a8c024 Rename python/cutlass to python/cutlass_cppgen (#2652) 2025-09-18 14:26:57 -04:00
Junkai-Wu 74825181f2 Remove old-version dsl examples. (#2644) 2025-09-17 22:23:30 -04:00
Junkai-Wu 8825e8be4f Add required changes for github pipeline. (#2648) 2025-09-17 22:22:45 -04:00
wbn 7817e47154 Fxied a typo in pipeline descript docs. (#2623) 2025-09-15 22:32:27 -04:00
Asuka 25ccb875b8 Fix: a calculation error in the example of dividing out in the 02_layout_algebra doc (#2635) 2025-09-15 22:31:33 -04:00
WansheandHaicheng Wu 29c1ad704a Fix doc cute 03_tensor.md link typo (#2627) 
* Update 03_tensor.md fix link typo

change path to relative path

* Update 03_tensor.md

---------

Co-authored-by: Haicheng Wu <57973641+hwu36@users.noreply.github.com>
 2025-09-15 22:26:43 -04:00
Haicheng Wu 57e3cfb47a doc change for 4.2 (#2639) 
* doc change

* fix broken links

* ragged gemm doc update

* move around texts about moe gemm
 2025-09-15 22:02:45 -04:00
Haicheng Wu e7e0adddac Update version.h 
change version number to 4.2
 2025-09-15 12:40:58 -04:00
Junkai-Wu 6a35b4d22f v4.2 tag release. (#2638) 2025-09-15 12:21:53 -04:00
Richard CaiandHaicheng Wu 56f0718a97 ex77 backwards GQA (#2556) 
* bwd GQA init

* Update examples/77_blackwell_fmha/77_blackwell_fmha_bwd.cu

* ref kernel type conversion fix

---------

Co-authored-by: Haicheng Wu <57973641+hwu36@users.noreply.github.com>
 2025-09-09 12:53:28 -04:00
Lifu Huang 76c96b0be3 Fix incorrect shapes in copy_atom doc comments. (#2575) 2025-09-04 16:57:24 -07:00
ao jia d98e7bf7ce Fix comment in mma_atom.hpp (#2579) 2025-09-04 16:56:39 -07:00
Lifu Huang b6ccf34aef Fix Copy_Atom type mismatch in sgemm_sm80.cu (#2582) 2025-09-04 16:56:17 -07:00
Andrei Alexandrescu 2288c0c901 Fix bugs in matrix.h (#2598) 2025-09-04 16:55:11 -07:00
Harrison Barclay b2dd65dc86 more robust imports in heuristics.py and heuristics_provider.py (#2596) 2025-08-28 22:32:55 -04:00
Javier 496654bf2c Fix sm100 gemm wrong static constexpr that breaks compilation on Windows (#2167) 
* Fix a sm100 gemm wrong defined static constexpr that breaks compilation on Windows

* Fix a sm100 gemm wrong defined static constexpr that breaks compilation on Windows

* More Windows fixes

Signed-off-by: Javier <25750030+SystemPanic@users.noreply.github.com>

* Revert "More Windows fixes"

This reverts commit 2e8cfc13827fbc7e3f2475bbc83694c2e1514107.

---------

Signed-off-by: Javier <25750030+SystemPanic@users.noreply.github.com>
 2025-08-28 22:13:00 -04:00
Linfeng Zheng 9ca7e877b2 fix gqa issue for blackwell fmha.py (#2599) 2025-08-28 11:15:20 -04:00
Junkai-Wu a49a78ffef v4.2 release. (#2587) 
* Fix default cluster callback values to 1 to avoid profiler failure when these values are not set in command line.

* v4.2 release.
 2025-08-22 18:11:24 -04:00
qqwqqw689 11cad1f67b fix a typo. (#2561) 2025-08-19 22:23:09 -04:00
zkyue 931359cec1 Fix typo in functional.h (#2571) 2025-08-19 22:22:31 -04:00
Inoday Yadav 42e7c546c4 Add movmatrix support (movmatrix.sync.aligned.m8n8.trans.b16) (#2562) 2025-08-19 22:22:02 -04:00
melonedo ec18e8043b Make swizzle in pycute work (#2553) 2025-08-19 22:21:00 -04:00
Srinath KailasaCris CeckaHaicheng Wu
 		5b76420d6a [DOC] Add more exposition to composition example (#2536) 
* Add more exposition to composition example

* Apply suggestions from code review

Co-authored-by: Cris Cecka <ccecka@users.noreply.github.com>

---------

Co-authored-by: Haicheng Wu <57973641+hwu36@users.noreply.github.com>
Co-authored-by: Cris Cecka <ccecka@users.noreply.github.com>
 2025-08-11 22:20:36 -04:00