4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
lambert0312	2e0f94ab79	[Fix] fix output_top_logprobs is not exist (#4597)	2025-03-27 21:45:57 -07:00
lambert0312	481f608b8e	Add INT8 support MTP NextN function (#3911)	2025-03-12 01:37:16 -07:00
lambert0312	7140ba3573	Add A800 tuning configs for DeepSeek R1/V3 channel-wise INT8 (#4323)	2025-03-11 18:25:56 -07:00
lambert0312	d3ecd63204	Add A800 tuning configs support DeepSeek V3/R1 BF16 and INT8(block-wise) (#4136)	2025-03-11 00:32:25 -07:00