Commit Graph
9 Commits
Author SHA1 Message Date
fzyzcjyandispobock defede5073 Fix DeepSeek DP Attention + torch compile (#5367)
Co-authored-by: ispobock <ispobaoke@163.com>
2025-04-14 01:07:58 -07:00
Lianmin Zheng 4ede6770cd Fix retract for page size > 1 (#4914) 2025-03-30 02:57:15 -07:00
fzyzcjy 15ddd84322 Add retry for flaky tests in CI (#4755) 2025-03-25 16:53:12 -07:00
Cheng Wan 3196999f63 Reduce computation and communication in DP attention (#4521) 2025-03-18 13:41:36 -07:00
8e66fbecee Improve DP attention (#4390)
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
2025-03-13 08:23:56 -07:00
Lianmin Zheng c76040e31b Support page size > 1 (#4356) 2025-03-12 22:22:39 -07:00
Lianmin Zheng d4fc1a70e3 Crash the server correctly during error (#2231) 2024-11-28 00:22:39 -08:00
Lianmin ZhengandHaotian Liu f719d9aebc Launch dp ranks in parallel (#2053)
Co-authored-by: Haotian Liu <6631389+haotian-liu@users.noreply.github.com>
2024-11-16 17:39:39 -08:00
Ke Bao 976bc302e5 Support DP MLA (#1970) 2024-11-16 09:01:43 +00:00