3 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Chunan Zeng	6a384d5c01	Speed up per token and per tensor quant by 15% (#4639)	2025-03-22 00:37:57 -07:00
Rex	07f944631e	Add awq dequantize kernel to sgl with 1x to 3x speedup (#4104)	2025-03-12 00:10:02 -07:00
Rex	90bb2be27e	Minor improvement to per_tensor_quant_fp8 (#4197)	2025-03-07 22:52:12 -08:00