 Lucas Wilkinson
|
df18f5e4f5
|
Improvements for: Groupwise scaling along M for FP8 gemm (#2095)
* fix blockwise fp8 kernels
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* wip, < 128 not working
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* fix < 128
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* reduce diff
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* review comments
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* support partial n blocks
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
* fix build errors
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
---------
Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>
|
2025-02-27 22:39:29 -05:00 |
|