4 people c7f254468f [Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise) (#3888) ...

Co-authored-by: yych0745 <1398089567@qq.com>
Co-authored-by: sleepcoo <sleepcoo@gmail.com>
Co-authored-by: b0urnee <2769086541@qq.com>

2025-03-06 20:54:52 -08:00

..

configs

Tuning Script for Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3922)

2025-02-27 10:59:46 +00:00

__init__.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

base_config.py

…

blockwise_int8.py

Fix: #3988 using blockwise_int8 (#4023)

2025-03-03 23:49:58 -08:00

fp8_kernel.py

Revert "[ROCm] Use tl.range() in block GEMM kernels with `num_stage… (#3632)

2025-02-17 18:01:21 +08:00

fp8_utils.py

ROCM: AITER BLOCK GEMM (#4075)

2025-03-05 03:10:49 -08:00

fp8.py

ROCm: enable trillion-parameter MoE models with INT4-FP8 single node (#4152)

2025-03-06 15:33:02 -08:00

gptq.py

[QUANT] Add GPTQModel Dynamic Quantization + lm_head Quantization (#3790)

2025-03-05 01:11:00 -08:00

int8_kernel.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

modelopt_quant.py

Misc clean up; Remove the support of jump forward (#4032)

2025-03-03 07:02:14 -08:00

w8a8_int8.py

[Feature] DeepSeek V3/R1 INT8 Quantization (channel-wise) (#3888)

2025-03-06 20:54:52 -08:00