Commit Graph

8 Commits

Author SHA1 Message Date
LuminolT
79fcfd6abf feat(megamoe): add nvfp4 group16 capability gate
Allow SM100 FP4 scale layout transforms to accept group16 and thread weight granularity through the MegaMoE Python wrapper, API checks, and synthetic benchmark entrypoint.

Keep fused SM100 MegaMoE compute behind an explicit group16 capability gate until the SFB/TMEM/MMA scale path is updated and validated.

Tested: PYTHONPYCACHEPREFIX=/private/tmp/deepgemm_pycache python3 -m py_compile deep_gemm/mega/__init__.py tests/test_mega_moe.py tests/generators.py

Tested: git diff --check

Not-tested: CUDA build and SM100/B300 runtime validation are not available locally.
2026-07-08 18:29:09 +08:00
Xinyi Liu
9bd0519605 feat: implement sm90 megamoe phase5 l2 scatter 2026-06-18 15:17:20 +08:00
Xinyi Liu
f3553f976c feat: implement sm90 megamoe phase4 l1 epilogue 2026-06-18 01:09:45 +08:00
Xinyi Liu
842124b1c5 feat: implement sm90 megamoe phase3 l1 wgmma 2026-06-18 00:46:41 +08:00
Xinyi Liu
540e5aeadc feat: implement sm90 megamoe phase2 dispatch-only 2026-06-18 00:00:36 +08:00
Xinyi Liu
1dafd0f173 feat: add sm90 megamoe phase1 interfaces 2026-06-17 23:54:49 +08:00
Zhean Xu
891d57b4db Add various optimizations and Mega MoE benchmarks (#316)
* Merge with private repo

* Add Mega MoE Benchmark

* Minor fix

* Update

---------

Co-authored-by: Chenggang Zhao <chenggangz@deepseek.com>
2026-04-24 18:41:37 +08:00
Chenggang Zhao
7f2a703ed5 [Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)
* Merge with private repo

* Update README

* Update README

* Update README

* Add PyTorch requirements

* Fix sync scopes for MQA logits (#256)

* Update README
2026-04-17 09:45:14 +08:00