fzyzcjy 32cd707002 Support TP in attention for two batch overlap (#6634)

2025-05-26 20:28:12 -07:00

..

attention

Support overlapping two batches (#4068)

2025-05-24 17:39:07 -07:00

moe

Support fake perfectly balanced EP dispatch algorithm (#6571)

2025-05-25 22:35:51 -07:00

quantization

Support overlapping two batches (#4068)

2025-05-24 17:39:07 -07:00

activation.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

communicator.py

Support TP in attention for two batch overlap (#6634)

2025-05-26 20:28:12 -07:00

dp_attention.py

feat: add dp attention support for Qwen 2/3 MoE models, fixes #6088 (#6121)

2025-05-16 14:44:10 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

Add typo checker in pre-commit (#6179)

2025-05-11 12:55:00 +08:00

linear.py

[Model Support] unsloth/Phi-4-mini bnb model (#4982)

2025-04-16 19:58:20 -07:00

logits_processor.py

Fix two issues related to --moe-dense-tp-size=1 (#5657)

2025-05-12 23:51:39 -07:00

multimodal.py

vlm: tensor hash kernel (#5974)

2025-05-18 15:38:16 -07:00

parameter.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

pooler.py

[feature] support for roberta embedding models (#5730)

2025-04-26 18:47:06 -07:00

radix_attention.py

Fuse MLA set kv cache kernel (#5748)

2025-04-26 18:42:22 -07:00

rotary_embedding.py

Revert "fix some typos" (#6244)

2025-05-12 12:53:26 -07:00

sampler.py

Tiny fix sampler error when prob is not contiguous (#6639)

2025-05-26 19:19:08 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

utils.py

[PP] Add pipeline parallelism (#5724)

2025-04-30 18:18:07 -07:00

vocab_parallel_embedding.py

Performing Vocabulary Parallelism for LM Head across Attention TP Groups (#5558)

2025-05-11 23:36:29 -07:00