Xiaoyu Zhang f0e15dc6ab [HotFix] fix fp8 scale load failed in tp>1 (#2837)

2025-01-11 14:34:26 +08:00

..

attention

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

moe

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

quantization

Update modelopt config and fix running issue (#2792)

2025-01-08 18:04:30 +08:00

activation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

layernorm.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

linear.py

[HotFix] fix fp8 scale load failed in tp>1 (#2837)

2025-01-11 14:34:26 +08:00

logits_processor.py

Misc fix for min_p_sampling, --cuda-graph-bs (#2761)

2025-01-07 02:52:53 -08:00

parameter.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

[Minor] Improve code style (#2422)

2024-12-09 06:30:35 -08:00

rotary_embedding.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampler.py

Minor follow-up fixes for the logprob refactor (#2670)

2024-12-30 05:42:08 -08:00

torchao_utils.py

Add GemLite caching after each capture (#2669)

2024-12-30 05:27:29 -08:00

vocab_parallel_embedding.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00