Xinyi Liu 062cb160cf Phase 0: SM90 MegaMoE design doc, reference baseline, nsys script ...

- MEGAMOE_SM90_DESIGN.md: complete design document with finalized decisions
  (fused single kernel, cooperative + single-WG, dynamic BLOCK_M, etc.)
- tests/test_mega_moe_sm90.py: PyTorch FP32/BF16 reference implementation
  for dispatch → L1 GEMM → SwiGLU → L2 GEMM → combine pipeline
- scripts/run_nsys_mega_moe_sm90.sh: nsys profiling wrapper script
- megamoe-research-reports/: research analysis of PR304/323/347/352/357/360

2026-06-16 18:01:12 +08:00

..

generators.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_attention.py

Add various optimizations and Mega MoE benchmarks (#316)

2026-04-24 18:41:37 +08:00

test_bf16.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_einsum.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_fp8_fp4.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_hyperconnection.py

Multiple updates and refactorings (#280)

2026-01-16 17:06:52 +08:00

test_layout.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_lazy_init.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00

test_legacy.py

Multiple updates and refactorings (#280)

2026-01-16 17:06:52 +08:00

test_mega_moe_sm90.py

Phase 0: SM90 MegaMoE design doc, reference baseline, nsys script

2026-06-16 18:01:12 +08:00

test_mega_moe.py

Update test_mega_moe.py

2026-05-11 19:20:18 +08:00

test_sanitizer.py

[Public release 26/04] Introducing Mega MoE, FP4 Indexer and other features/fixes (#304)

2026-04-17 09:45:14 +08:00