Wenxuan Tan 22da3d978f Fix "Avoid computing lse in Ragged Prefill when there's no prefix match" (#5555)

2025-05-05 10:32:17 -07:00

..

attention

Fix "Avoid computing lse in Ragged Prefill when there's no prefix match" (#5555)

2025-05-05 10:32:17 -07:00

moe

[perf] H100 DeepSeek-V3 fused moe tuned config (#5998)

2025-05-03 14:02:26 -07:00

quantization

chore: upgrade sgl-kernel 0.1.1 (#5933)

2025-04-30 16:13:30 -07:00

activation.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

dp_attention.py

[PP] Add pipeline parallelism (#5724)

2025-04-30 18:18:07 -07:00

elementwise.py

Fix run time error in ROCm platform (#5147)

2025-04-07 22:49:40 -07:00

layernorm.py

Fix: deepseek forward absorb (#5723)

2025-04-25 13:48:55 -07:00

linear.py

[Model Support] unsloth/Phi-4-mini bnb model (#4982)

2025-04-16 19:58:20 -07:00

logits_processor.py

fix(srt): check if sample_indices is not None before usage. (#5633)

2025-04-26 19:51:01 -07:00

parameter.py

Clean up imports (#5467)

2025-04-16 15:26:49 -07:00

pooler.py

[feature] support for roberta embedding models (#5730)

2025-04-26 18:47:06 -07:00

radix_attention.py

Fuse MLA set kv cache kernel (#5748)

2025-04-26 18:42:22 -07:00

rotary_embedding.py

Revert "Revert "fix: import vllm_rotary_embedding error when head_size not in 64, 128, 256, 512"" (#5777)

2025-04-27 01:04:15 -07:00

sampler.py

[misc] remove is_cuda_available (#5319)

2025-04-20 18:16:51 -07:00

torchao_utils.py

Support loading of larger models with on-the-fly quantization (#3061)

2025-01-22 21:33:17 -08:00

utils.py

[PP] Add pipeline parallelism (#5724)

2025-04-30 18:18:07 -07:00

vocab_parallel_embedding.py

Clean up fp8 support (#4230)

2025-03-09 21:46:35 -07:00