LuminolT
89ba17ad05
feat(moe): add fp8 megamoe fused path and nvfp4 layout guards
Wire MegaMoE FP8 through DeepGEMM's fused fp8_mega_moe path, preserve fallback runner layouts, and add explicit NVFP4 group-size guardrails for unsupported DeepGEMM scale transforms.
Tested: PYTHONPYCACHEPREFIX=/private/tmp/sglang_pycache python3 -m py_compile python/sglang/srt/layers/moe/mega_moe.py python/sglang/srt/layers/moe/moe_runner/flashinfer_trtllm.py python/sglang/srt/layers/quantization/fp8.py python/sglang/srt/layers/quantization/modelopt_quant.py test/registered/unit/moe/test_glm_megamoe.py
Tested: git diff --check
Not-tested: python3 -m unittest test/registered/unit/moe/test_glm_megamoe.py (local Python environments do not have torch installed).
2026-07-08 11:42:51 +08:00
..
2026-07-08 11:42:51 +08:00
2026-03-18 13:50:43 -07:00
2026-03-18 13:50:43 -07:00
2026-03-19 10:39:16 +08:00
2026-03-18 13:50:43 -07:00
2026-06-10 05:54:43 +08:00