Stefan HeandStefan He e0917e6bd0 Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215) ...

Co-authored-by: Stefan He <bhe@linkedin.com>

2025-03-12 00:08:03 -07:00

..

sglang

Remove vllm ops scaled fp8 quant and accelerate per token quant by 20-28% (#4215)

2025-03-12 00:08:03 -07:00

pyproject.toml

upgrade flashinfer 0.2.3 (#4317)

2025-03-11 15:37:17 -07:00