leavelet a3d0c2394b B300 NextN fp4: also honor speculative MoE runner backend in keep-decision (+ debug log) ...

The NextN/MTP draft is built by the EAGLE draft worker, where get_moe_runner_backend() didn't resolve
to flashinfer_trtllm, so the fp4 drop fired anyway -> 6144-vs-3072 crash in draft load. Check both the
main and speculative runner backends (spec is AUTO when --speculative-moe-runner-backend unset); keep
fp4 if either is a flashinfer fp4 backend. Temporary [NextN-fp4] warning logs the resolved backends.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-21 16:32:59 +00:00

..

sglang

B300 NextN fp4: also honor speculative MoE runner backend in keep-decision (+ debug log)

2026-06-21 16:32:59 +00:00

pyproject_cpu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject_npu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject_other.toml

chore: extract diffusion_common in python/pyproject_other.toml (#20803)

2026-03-19 10:39:16 +08:00

pyproject_xpu.toml

Upgrade transformers==5.3.0 (#17784)

2026-03-18 13:50:43 -07:00

pyproject.toml

new pyprojectoml

2026-06-10 05:54:43 +08:00