Trevor Morris a91e90d9a3 [2/2] Fuse routed scaling factor into select_experts (#8690)

2025-08-20 15:10:16 -07:00

..

compressed_tensors

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

configs

Add H20 tuning configs support DeepSeek V3/R1 INT8(block-wise) (#4220)

2025-03-11 12:32:33 -07:00

deep_gemm_wrapper

Fix deepgemm masked grouped gemm jit compile (#8679)

2025-08-01 15:37:59 -07:00

quark

Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049)

2025-08-16 19:01:54 -07:00

__init__.py

Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049)

2025-08-16 19:01:54 -07:00

awq_triton.py

[AMD] Add triton awq_dequantize kernel to support AWQ on ROCm (#7661)

2025-07-18 14:27:25 -07:00

awq.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

base_config.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

blockwise_int8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

fp8_kernel.py

Support Triton FP8 Gemm can handle hidden_dim not divisible by 16 (#9093)

2025-08-12 21:21:55 -07:00

fp8_utils.py

enable marlin fp8 blockwise (#8990)

2025-08-18 18:53:15 -07:00

fp8.py

[2/2] Fuse routed scaling factor into select_experts (#8690)

2025-08-20 15:10:16 -07:00

gptq.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

int8_kernel.py

[2/2] Support Qserve (#6521)

2025-05-23 12:39:18 -07:00

int8_utils.py

Feature DeepSeek V3/R1 INT8 Quantization (block-wise) (#3730)

2025-02-24 05:43:35 -08:00

kv_cache.py

[refactor] slightly tidy fp8 module (#5993)

2025-05-07 17:28:24 -07:00

marlin_utils.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

modelopt_quant.py

[2/2] Fuse routed scaling factor into select_experts (#8690)

2025-08-20 15:10:16 -07:00

moe_wna16.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

mxfp4_tensor.py

Add initial support for gpt-oss (#8824)

2025-08-05 13:42:01 -07:00

mxfp4.py

Combine fp4.py and mxfp4.py into one file and support dynamic mxfp4 quantization in mxfp4.py (#9049)

2025-08-16 19:01:54 -07:00

petit_utils.py

Support NVFP4 quantized dense models on AMD CDNA2/CDNA3 GPUs (#7302)

2025-07-18 19:59:39 -07:00

petit.py

[fix] fix modelopt fp4 on b200 (#8195)

2025-07-20 17:39:57 -07:00

qoq.py

Refactor: move all quantization-related code to srt/layer/quantization (#7989)

2025-07-17 00:47:07 -07:00

unquant.py

[CPU] Fix TP padding issue on Phi-4 (#8289)

2025-08-17 16:25:26 -07:00

utils.py

[Fix] Add undefined update_tensor_inplace function (#6307)

2025-08-18 11:11:00 +08:00

w4afp8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

w8a8_fp8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00

w8a8_int8.py

[6/N] MoE Refactor: Cleanup MoE-related configs (#8849)

2025-08-14 21:14:53 -07:00