liwenju0 4d1e52abea Add an assertion to enhance the robustness of the operator (#5736)

2025-04-26 18:09:12 -07:00

..

attention

Add an assertion to enhance the robustness of the operator (#5736)

2025-04-26 18:09:12 -07:00

moe

update triton 3.2.0 h200 fused moe triton config and add warning about triton fused_moe_kernel performance degradation due to different Triton versions. (#5740)

2025-04-25 16:24:59 -07:00

quantization

fix awq_dequantize import (#5669)

2025-04-23 01:36:26 -07:00

activation.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

dp_attention.py

[Feat] upgrade pytorch2.6 (#5417)

2025-04-20 16:06:34 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

Fix: deepseek forward absorb (#5723)

2025-04-25 13:48:55 -07:00

linear.py

[Model Support] unsloth/Phi-4-mini bnb model (#4982)

2025-04-16 19:58:20 -07:00

logits_processor.py

Reduce computation and communication in DP attention (#4521)

2025-03-18 13:41:36 -07:00

parameter.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

pooler.py

Rename InputMetadata -> ForwardBatch (#1543)

2024-09-30 02:41:11 -07:00

radix_attention.py

Remove q concat in FA3 backend for DeepSeek decode (#5638)

2025-04-22 11:43:12 -07:00

rotary_embedding.py

fix: fix one more bug from merging mm_inputs (#5718)

2025-04-25 17:28:33 -07:00

sampler.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

vocab_parallel_embedding.py

Clean up fp8 support (#4230)

2025-03-09 21:46:35 -07:00