 Yubo WangandLiangsheng Yin
|
762846531f
|
Fix Illegal Memory Access when fa3 + spec + topk + page_size > 1 (#15469)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-24 00:13:57 +08:00 |
|
|
Yubo Wang
|
18fb51583f
|
Support FlashAttention3 page_size > 1 and topk > 1 case with paged attn and spec decode (#7725)
|
2025-11-26 11:44:41 +08:00 |
|
|
Yubo Wang
|
20f1c8e374
|
Fix sampler nan check when calling top_k_top_p_sampling_from_probs (#5546)
|
2025-04-19 21:47:23 -07:00 |
|
|
Yubo Wang
|
fd5a55cfd3
|
Use public model for FA3 speculative decode testing (#5152)
|
2025-04-08 00:08:25 -07:00 |
|
|
Yubo Wang
|
804d9f2e4c
|
Add unit test on page_size > 1 and mla and integration test for Flash Attention 3 (#4760)
|
2025-04-07 23:20:51 -07:00 |
|