LuminolT eb7f44a8ee fix(moe): pass megamoe fp4 weights as int8 to deepgemm ...

DeepGEMM's TVM FFI binding rejects PyTorch FP4x2 DLPack lanes, while the MegaMoE kernel expects the same packed bytes. Convert FP4 packed expert weights to int8 views immediately before fp8_fp4_mega_moe without changing storage or scale tensors.

Tested: python3 -m pytest -q test/registered/unit/moe/test_glm_megamoe.py on remote B300 container (5 passed).

Tested: 1x B300 synthetic forward_mega_moe smoke passed.

Tested: 8x B300 synthetic direct DeepGEMM MegaMoE and forward_mega_moe wrapper smoke passed.

2026-07-07 14:31:03 +08:00

..

sglang

fix(moe): pass megamoe fp4 weights as int8 to deepgemm

2026-07-07 14:31:03 +08:00

pyproject_cpu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject_npu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject_other.toml

chore: extract diffusion_common in python/pyproject_other.toml (#20803)

2026-03-19 10:39:16 +08:00

pyproject_xpu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject.toml

new pyprojectoml

2026-06-10 05:54:43 +08:00