Commit Graph

  • 3e765cd3aa fix: try add wrapper for preload sgl-release leavelet 2025-11-19 14:50:02 +00:00
  • d4ffb6a9bf feat: add support for deepgemm sglang leavelet 2025-11-19 14:37:49 +00:00
  • d763aaf304 feat: add kernel preload leavelet 2025-11-19 14:16:45 +00:00
  • ffe2b6b974 Merge pull request #14 from Sulfur6/sgl.sbo.public Fan Yin 2025-12-01 00:34:35 +08:00
  • 5f99d8d28c rollback. Eric Wong 2025-11-27 17:04:56 +08:00
  • f259a0eaf0 bugfix. Eric Wong 2025-11-13 22:17:36 +08:00
  • 3a297646cd add max_block_n. Eric Wong 2025-11-13 22:15:56 +08:00
  • 5f8a71a864 bugfix. Eric Wong 2025-11-09 15:44:33 +08:00
  • a01ab1aabc feat: add test for signal GEMM. Eric Wong 2025-11-09 14:59:50 +08:00
  • 6635dd2ffd feat: add signal for SBO in SM90 masked gemm. Eric Wong 2025-11-09 14:53:05 +08:00
  • f4adba8a66 feat: support misc kernel launch Rain Jiang 2025-08-29 16:23:39 -07:00
  • 301cbc1d75 feat: support libtorch FlamingoPg 2025-08-26 19:17:08 -07:00
  • 239112cb4c Fix syntax errors and correct the conditional statements (#206) PGFLMG 2025-10-01 20:31:43 +08:00
  • c1bf4cae4b Fix version Chenggang Zhao 2025-10-01 20:31:27 +08:00
  • 07b82fb8cd Fix old CUDA compatibility Chenggang Zhao 2025-10-01 20:29:15 +08:00
  • 594953acce Update version number Chenggang Zhao 2025-09-29 17:12:21 +08:00
  • 0ed3b949d0 Update README Chenggang Zhao 2025-09-29 17:10:12 +08:00
  • 59f2c07cf2 Add SM100 kernels (#201) Simon Mo 2025-09-29 02:07:28 -07:00
  • 80ceeb2c76 Add SM90 kernels (#200) Chenggang Zhao 2025-09-29 17:00:23 +08:00
  • 904b721731 Update README Chenggang Zhao 2025-09-25 16:27:57 +08:00
  • 3f71de7aa9 Make various updates and fixes (#198) Ray Wang 2025-09-25 16:19:07 +08:00
  • 79f48ee15a Fix multicast bug and optimize masked GEMM (#193) yukuai26 2025-09-12 17:12:27 +08:00
  • ea9c5d9270 Use driver API Chenggang Zhao 2025-08-19 11:29:15 +08:00
  • 51d1e9cdd3 Support compilation with CUDA 13.0 (#174) Rain Jiang 2025-08-26 18:30:08 -07:00
  • 0e49c3353b Refactor compiler version checks and arch flags Chenggang Zhao 2025-08-27 09:26:02 +08:00
  • 3a93f4eb28 Fix B200 cu128 NVCC compilation failed (#173) PGFLMG 2025-08-27 09:07:18 +08:00
  • 9c3783beb2 Fix CUBIN symbol name compatibility Chenggang Zhao 2025-08-26 17:42:11 +08:00
  • 89b4089d24 Update test files in README documentation (#169) ZiTian Zhao 2025-08-25 09:43:10 +08:00
  • 2da871e304 Fix grouped gemms performance issue. (#168) zhonghui-J 2025-08-22 17:35:43 +08:00
  • e38c2e3103 Remove comments Chenggang Zhao 2025-08-22 17:32:04 +08:00
  • f20256fd50 Compatible with CUDA 13 Chenggang Zhao 2025-08-22 17:29:10 +08:00
  • affdb1cd90 Add sm_100f support and make nvcc 13 happy (#157) xiweny 2025-08-22 17:19:32 +08:00
  • f85ec649d7 Make various updates and fixes: (#164) Ray Wang 2025-08-15 18:32:35 +08:00
  • 3254b758e2 Polish get_best_configs modeling. (#158) zhonghui-J 2025-08-14 16:50:21 +08:00
  • 6d3717d541 Update test_fp8.py (#159) fzyzcjy 2025-08-14 16:47:57 +08:00
  • 7b6b5563b9 Fix smxx layout assertion (#154) LJC00118 2025-08-05 10:38:06 +08:00
  • 3979c0576e Merge pull request #151 from RayWang96/update_jit Ray Wang 2025-08-03 11:04:02 +08:00
  • d9c363f86f Make various updates and fixes: - Add support for legacy CUDA versions; now compatible with CUDA 12.3 and newer - Add support for NVRTC compilation - Other fixes and code refactoring Ray Wang 2025-08-02 19:52:22 -07:00
  • aff9da0aba Fix SM90 GEMM (#149) yukuai26 2025-08-01 10:36:49 +08:00
  • c50deed14c Code lint Chenggang Zhao 2025-07-30 10:39:30 +08:00
  • 6bc75b549e Fix smxx layout assertion (#141) LJC00118 2025-07-30 10:36:54 +08:00
  • a581263f06 Fix indent LJC00118 2025-07-29 16:14:46 +08:00
  • fb7c687548 Merge pull request #135 from danthe3rd/patch-3 dan_the_3rd 2025-07-29 10:14:15 +02:00
  • dd6ed14acb Add torch as build dependency. (#139) Yuxian Qiu 2025-07-28 17:01:39 +08:00
  • 4b4e4f20dd Update system.hpp (#133) dan_the_3rd 2025-07-28 11:01:05 +02:00
  • 8987798502 Update setup.py (#134) dan_the_3rd 2025-07-28 10:58:23 +02:00
  • 187656694f Code lint Chenggang Zhao 2025-07-21 11:00:50 +08:00
  • 436a56314c Use std::filesystem::directory_iterator instead of std::filesystem::recursive_directory_iterator to avoid an ABI breakage we met (#131) Ray Wang 2025-07-21 10:44:20 +08:00
  • c1db17e2e3 Updated submodules to use https:// vs git@ (#129) Clayton Coleman 2025-07-20 21:05:15 -04:00
  • 4ca3cdffd2 fix: update .gitmodules (#130) Yineng Zhang 2025-07-19 19:23:58 -07:00
  • 6c9558ed04 Update CUDA toolkits requirement (#128) Ray Wang 2025-07-18 16:40:47 +08:00
  • 9da4a23561 Add more GPU architectures support (#112) Ray Wang 2025-07-18 11:32:22 +08:00
  • 03d0be3d2d Simplify expression Chenggang Zhao 2025-07-02 14:07:05 +08:00
  • 3fc6728dee [add] fix smem_barrier size in wgrad way (#122) fy1214 2025-07-02 14:05:36 +08:00
  • e82c4139da Revert "Fixed the bug in get_swizzle_mode function related to elem_size setting. (#115)" yukuai 2025-06-23 17:13:36 +08:00
  • ac428e25e0 Fixed the bug in get_swizzle_mode function related to elem_size setting. (#115) TherLF 2025-06-23 09:37:10 +08:00
  • 0c88cd0139 Fix illegal memory address when skipping -1 m indices (#113) shixianc 2025-06-15 19:44:31 -07:00
  • 8dfa329827 Grouped GEMM skip useless computation for unaligned Ms (#103) yukuai26 2025-05-27 13:43:38 +08:00
  • 391755ada0 Fix JIT tests Chenggang Zhao 2025-05-16 14:39:58 +08:00
  • 78d8362e7a Add a missing #pragma once Chenggang Zhao 2025-05-15 18:10:05 +08:00
  • ec426b9d66 Merge pull request #100 from deepseek-ai/remove-tuner Chenggang Zhao 2025-05-15 17:05:42 +08:00
  • 104a6ec109 Add __assertfail Chenggang Zhao 2025-05-15 17:04:21 +08:00
  • 3b412f458a Unify kwargs usages Chenggang Zhao 2025-05-15 16:53:52 +08:00
  • 350989eef3 Unify ceil_divs Chenggang Zhao 2025-05-15 16:48:32 +08:00
  • 4373af2e82 Add DG_PRINT_CONFIGS Chenggang Zhao 2025-05-15 16:36:40 +08:00
  • 816b39053a Refactor launch-related structures Chenggang Zhao 2025-05-15 16:14:21 +08:00
  • e2d6a107ef Cleanup some useless staffs Chenggang Zhao 2025-05-14 15:46:45 +08:00
  • ebf3d2f916 Update plans Chenggang Zhao 2025-05-14 15:05:24 +08:00
  • 04278f6dee Weight gradient kernels for dense and MoE models (#95) Zhean Xu 2025-05-14 14:47:58 +08:00
  • d75b218b7b Update README with NVRTC news Chenggang Zhao 2025-05-07 13:26:58 +08:00
  • 8702f910e3 Fix 12.9 compatibility Chenggang Zhao 2025-05-07 13:23:40 +08:00
  • 085b4a1532 Add DG_PRINT_AUTOTUNE to README Chenggang Zhao 2025-05-07 11:46:52 +08:00
  • daec8fd2fc Fix pipeline stage edge cases Chenggang Zhao 2025-05-07 11:40:34 +08:00
  • bfe983c4c2 Refactor JIT compilation (+NVRTC support) (#94) Gabriel Wu 2025-05-07 11:38:14 +08:00
  • d374456787 Less stages for small shape K Chenggang Zhao 2025-04-28 10:36:08 +08:00
  • 86afd0c212 Add two more optimization TODOs Chenggang Zhao 2025-04-27 17:51:11 +08:00
  • 33e0c3ce40 Update plans Chenggang Zhao 2025-04-24 14:37:53 +08:00
  • 95e81b3dd6 Indivisible TMA (#90) yukuai26 2025-04-23 14:55:14 +08:00
  • 891f35adf5 Support TMA multicast on B with m_grouped_gemm_contiguous. (#88) yukuai26 2025-04-21 09:43:17 +08:00
  • 83aa960b9b Fix bugs Chenggang Zhao 2025-04-18 11:55:51 +08:00
  • fea9309c1e Update README Chenggang Zhao 2025-04-18 11:38:52 +08:00
  • 340d9880f4 Overlap TMA store Chenggang Zhao 2025-04-18 11:18:23 +08:00
  • 4499c4ccbb Refactor MMA template with CUTLASS (#87) Zhean Xu 2025-04-14 17:06:49 +08:00
  • 37aa127451 Use swizzling instead of padding (#86) Chenggang Zhao 2025-04-14 15:20:58 +08:00
  • 2e7e58011b Merge pull request #83 from deepseek-ai/tma-1d-store Chenggang Zhao 2025-04-11 11:25:01 +08:00
  • b0d64817a7 OOB bugs fixed Chenggang Zhao 2025-04-11 11:00:47 +08:00
  • 99eb6ec563 Remove useless STSM Chenggang Zhao 2025-04-11 10:45:36 +08:00
  • 8041ed7164 Use 1D TMA store Chenggang Zhao 2025-04-11 10:42:01 +08:00
  • a77009cb14 Make partition pipelined Chenggang Zhao 2025-04-10 18:07:25 +08:00
  • 5bda27244b Add CMake support for CLion indexing Chenggang Zhao 2025-04-10 09:52:15 +08:00
  • 327ec92f69 Update roadmap Chenggang Zhao 2025-04-09 11:44:30 +08:00
  • 677143be64 Update roadmap Chenggang Zhao 2025-04-09 11:41:36 +08:00
  • fed3e4d701 Merge pull request #81 from deepseek-ai/blocktile-256x128 Chenggang Zhao 2025-04-09 11:26:40 +08:00
  • 989c9e3694 Update README Chenggang Zhao 2025-04-09 11:17:47 +08:00
  • a9967bc27c Update README Chenggang Zhao 2025-04-09 11:14:45 +08:00
  • 5a80e4bb96 Fix indent x2 Chenggang Zhao 2025-04-09 11:00:10 +08:00
  • bdca8b0624 Fix indent Chenggang Zhao 2025-04-09 10:59:07 +08:00
  • 4c0cc290c7 Refactor M repetition with loops Chenggang Zhao 2025-04-09 10:50:44 +08:00
  • a6524d411a Larger block N candidates Chenggang Zhao 2025-04-09 10:11:43 +08:00
  • 48a5f071be Clean up config heuristics Chenggang Zhao 2025-04-09 10:01:15 +08:00