Yineng Zhang 6128f7cff5 fix: specify dtype with begin_forward aka plan (#2404)

2024-12-08 20:07:30 +08:00

..

attention

fix: specify dtype with begin_forward aka plan (#2404)

2024-12-08 20:07:30 +08:00

ep_moe

Resubmit MoE-EP (#2371)

2024-12-06 15:05:21 +08:00

fused_moe_triton

Fp8 MoE optimizations on AMD (#2388)

2024-12-07 21:18:26 +08:00

quantization

Fp8 MoE optimizations on AMD (#2388)

2024-12-07 21:18:26 +08:00

activation.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

custom_op_util.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

fused_moe_patch.py

Improve torch compile for fused moe (#2327)

2024-12-03 01:58:25 -08:00

layernorm.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

linear.py

Update model_loader deps and qqq quantization deps (#2220) (#2318)

2024-12-02 23:22:13 +08:00

logits_processor.py

Revert "Revert "[FEAT] Support GGUF format"" (#2287)

2024-11-30 22:14:48 -08:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

MLA prefill w/o weight absorption (#2349)

2024-12-05 01:50:28 +08:00

rotary_embedding.py

docs: fix module docstrings and copyright headers (#2077)

2024-11-22 22:16:53 +08:00

sampler.py

Add more support for intel Gaudi accelerators (#2357)

2024-12-06 01:16:33 -08:00

torchao_utils.py

[Minor] Code style improvements (#2355)

2024-12-04 19:02:08 -08:00

vocab_parallel_embedding.py

Revert "Revert "[FEAT] Support GGUF format"" (#2287)

2024-11-30 22:14:48 -08:00