 Ke Bao
|
2406ddfdb8
|
Add ut guide to test skills (#21130)
|
2026-03-22 20:55:37 +08:00 |
|
|
Ke Bao
|
05c00088e3
|
Cleanup broken dist-info directories in ci deps install (#20817)
|
2026-03-18 17:09:23 +08:00 |
|
|
Ke Bao
|
1b690836fa
|
Add ut coverage workflow (#20804)
|
2026-03-18 13:25:53 +08:00 |
|
|
Ke Bao
|
c42da50289
|
Update test guide to contribution guide (#20805)
|
2026-03-18 13:25:16 +08:00 |
|
|
Ke Bao
|
7f99319c56
|
Add evict policy ut (#20787)
|
2026-03-17 22:06:14 +08:00 |
|
|
Ke Bao
|
39336f5812
|
Precompute swa cache location (#20449)
|
2026-03-16 14:38:08 +08:00 |
|
|
Ke Bao
|
c3483e8e97
|
[CI] Move existing unit tests into unit directory (#20631)
|
2026-03-15 23:25:18 +08:00 |
|
|
Ke Bao
|
e2be31824f
|
[CI] Add ut coverage tool (#20628)
|
2026-03-15 21:13:45 +08:00 |
|
|
Ke Bao
|
0cff070828
|
[CI] Add READMEs for unit test directory structure (#20626)
|
2026-03-15 20:27:05 +08:00 |
|
|
Ke Bao
|
287dc12b05
|
Fix hicache log metrics (#20504)
|
2026-03-13 16:29:58 +08:00 |
|
|
Ke Bao
|
ae7c2397b9
|
Fix FA3 swa spec pg_size > 1 (#20369)
|
2026-03-12 11:42:01 +08:00 |
|
|
Ke Bao
|
4011065c65
|
Update CODEOWNERS (#20320)
|
2026-03-11 14:08:07 +08:00 |
|
|
Ke Bao
|
f947bcbd89
|
Move stop words to args in send one (#20193)
|
2026-03-09 23:05:47 +08:00 |
|
|
Ke Bao
|
2e444bdced
|
Move stop words to args in send one (#20193)
|
2026-03-09 23:05:32 +08:00 |
|
|
Ke Bao
|
07359efce9
|
Fix missing clone in hicache (#20130)
|
2026-03-08 23:21:18 +08:00 |
|
|
Ke Baoandhzh0425
|
5867c3fa80
|
Support HiCache for MambaRadixCache (#19663)
Co-authored-by: hzh0425 <hzh0425@apache.org>
|
2026-03-08 00:36:25 +08:00 |
|
|
Ke Bao
|
4726073865
|
Fix mamba2 mixer ci test (#19658)
|
2026-03-02 14:55:15 +08:00 |
|
|
Ke Bao
|
f51e9d9ca1
|
Add ci test for ring model (#18829)
|
2026-02-14 22:20:23 +08:00 |
|
|
Ke Bao
|
a0ebaa6498
|
Cleanup debug log for Ring model (#18793)
|
2026-02-13 18:36:20 +08:00 |
|
|
Ke Bao
|
a9d59776cc
|
Enhence gsm8k test (#18791)
|
2026-02-13 18:08:57 +08:00 |
|
|
Ke Bao
|
eacab2868a
|
Adjust mamba cache allocation (#18786)
|
2026-02-13 18:06:23 +08:00 |
|
|
Ke Bao
|
a6c4b52ac5
|
Cleanup unused rerun stages (#18788)
|
2026-02-13 17:44:42 +08:00 |
|
|
Ke Bao
|
93ede0db19
|
Update ci permission (#18693)
|
2026-02-12 13:25:43 +08:00 |
|
|
Ke Bao
|
5d185efb78
|
Fix prefill stats for dllm (#18632)
|
2026-02-12 01:00:30 +08:00 |
|
|
Ke Bao
|
d9050b4a9c
|
Reset evict swa status when retract (#18059)
|
2026-02-01 17:17:37 +08:00 |
|
|
Ke Bao
|
d396650bd2
|
Fix swa kv cache memory allocation (#18039)
|
2026-02-01 14:26:51 +08:00 |
|
|
Ke Bao
|
77a27e728c
|
Add cuda graph status to prefill log (#17836)
|
2026-01-30 16:56:53 +08:00 |
|
|
Ke Bao
|
30ece5e1d6
|
Fix swa memory pool size with spec (#17630)
|
2026-01-25 14:10:43 +08:00 |
|
|
Ke Bao
|
fb683be6eb
|
Use attn tp group in embedding for more models (#17570)
|
2026-01-24 13:37:44 +08:00 |
|
|
Ke Bao
|
7ace64d1d8
|
Update mamba env setting (#17566)
|
2026-01-23 11:02:32 +08:00 |
|
|
Ke Bao
|
d725487dc8
|
Disable swa memory for gpt-oss with spec (#17517)
|
2026-01-22 01:04:19 +08:00 |
|
|
Ke Bao
|
a618202fc7
|
Tiny refine swa kv cache free (#17417)
|
2026-01-21 19:20:05 +08:00 |
|
|
Ke Bao
|
d97066d209
|
Use attn_tp_group for all reduce in token embedding (#17403)
|
2026-01-20 23:56:21 +08:00 |
|
|
Ke Bao
|
ce2d686e94
|
Disable swa memory for trtllm-mha backend (#17429)
|
2026-01-20 23:55:00 +08:00 |
|
|
Ke Bao
|
91a4cd8648
|
Update default attn backend to fa3 for mimo model (#17419)
|
2026-01-20 21:22:27 +08:00 |
|
|
Ke Bao
|
ce8a6ac690
|
Evict swa kv cache during decoding (#17220)
|
2026-01-19 22:36:52 +08:00 |
|
|
Ke Bao
|
f3a7c7dcd9
|
Move radix cache related tests (#17295)
|
2026-01-18 17:47:32 +08:00 |
|
|
Ke Bao
|
1fe0c82f67
|
Add kl test for swa radix cache (#17281)
|
2026-01-18 16:19:57 +08:00 |
|
|
Ke Bao
|
f78201f3a9
|
Tiny fix comment typo (#17287)
|
2026-01-18 15:06:33 +08:00 |
|
|
Ke Bao
|
e499258e97
|
Use swa radix cache and memory pool for gpt-oss model (#17261)
|
2026-01-18 13:47:07 +08:00 |
|
|
Ke Bao
|
7f8a58fffb
|
Refactor prefix cache type checking (#17028)
|
2026-01-15 11:28:13 +08:00 |
|
|
Ke Bao
|
02722b9113
|
Fix evict swa for overlap scheduler and page size > 1 (#16507)
|
2026-01-06 22:29:40 +08:00 |
|
|
Ke Bao
|
3aa11ca722
|
Remove hybrid_kvcache_ratio in server args (#16399)
|
2026-01-06 13:13:13 +08:00 |
|
|
Ke Bao
|
76bc07a335
|
Move swa memory pool to a seperate file (#16347)
|
2026-01-04 22:39:30 +08:00 |
|
|
Ke Bao
|
b328cd20bb
|
Skip local attn init metadata for mimo swa model (#16349)
|
2026-01-04 22:38:36 +08:00 |
|
|
Ke Bao
|
7c1b4b1c4c
|
Support swa allocator page size > 1 (#16296)
|
2026-01-03 08:49:47 +08:00 |
|
|
Ke Bao
|
c483a5f45f
|
Tiny adjust hybrid swa handling (#16292)
|
2026-01-02 23:11:23 +08:00 |
|
|
Ke Bao
|
698629d1f2
|
Add swa page table to FA3 backend forward metadata (#16267)
|
2026-01-02 20:00:43 +08:00 |
|
|
Ke Bao
|
b6267de5ae
|
Upgrade python version in lint ci (#16221)
|
2025-12-31 18:22:53 +08:00 |
|
|
Ke Bao
|
b973202526
|
Split tp model worker init (#16165)
|
2025-12-30 23:36:03 +08:00 |
|
|
Ke Bao
|
b3817fa93b
|
Split model_worker init function (#16160)
|
2025-12-30 21:39:11 +08:00 |
|
|
Ke Bao
|
059428bd8a
|
Tiny remove additional args in init_memory_pool (#16158)
|
2025-12-30 21:38:06 +08:00 |
|
|
Ke Bao
|
3de23274ee
|
Clean up swa handling in fa3 backend (#15877)
|
2025-12-30 08:51:40 +08:00 |
|
|
Ke Bao
|
faecd37ed4
|
Add Mimo-v2-flash model to ci test (#15887)
|
2025-12-27 14:18:08 +08:00 |
|
|
Ke Bao
|
c28c536c91
|
Fix swa available memory check (#15867)
|
2025-12-26 13:19:01 +08:00 |
|
|
Ke Bao
|
7b7e357f61
|
Separate swa and local attention chunk cache eviction (#15820)
|
2025-12-26 09:34:22 +08:00 |
|
|
Ke Bao
|
2f66b0671b
|
Fix chunk_kda_fwd missing argument (#15851)
|
2025-12-26 09:32:35 +08:00 |
|
|
Ke BaoandLiangsheng Yin
|
cbf9f13493
|
Adjust server args for Mimo-v2-flash model (#15803)
Co-authored-by: Liangsheng Yin <lsyincs@gmail.com>
|
2025-12-25 16:04:39 +08:00 |
|
|
Ke Bao
|
8fe3e37468
|
Support piecewise cuda graph for dsv3 fp4 (#15531)
|
2025-12-21 14:50:32 +08:00 |
|
|
Ke Bao
|
b399e3ac4f
|
Support piecewise cuda graph for fused marlin moe (#15100)
|
2025-12-16 20:05:32 +08:00 |
|
|
Ke Bao
|
5b5571a8da
|
Apply back moe_sum_reduce for fused_marlin_moe (#14829)
|
2025-12-11 00:39:41 +08:00 |
|
|
Ke Bao
|
0b3f002daf
|
Update release-whl-kernel.yml (#13921)
|
2025-11-25 19:05:38 +08:00 |
|
|
Ke Bao
|
0d41ddfbd0
|
Temporarily disable test_vision_openai_server_a CI (#13331)
|
2025-11-15 19:46:49 +08:00 |
|
|
Ke Bao
|
8e9f05ece1
|
Update marlin moe kernel interface (#13322)
|
2025-11-15 17:10:39 +08:00 |
|
|
Ke Bao
|
2a96e302cb
|
Revert moe sum reduce for marlin moe (#13314)
|
2025-11-15 15:57:41 +08:00 |
|
|
Ke Bao
|
4edb240112
|
Fuse routed_scaling_factor to fused_marlin_moe (#12998)
|
2025-11-13 00:18:58 +08:00 |
|
|
Ke Bao
|
a7cc02e36e
|
Fix run suite sanity check (#13133)
|
2025-11-12 15:29:10 +08:00 |
|
|
Ke Bao
|
e38994dd71
|
Update rope dtype config (#13037)
|
2025-11-11 22:47:29 +08:00 |
|
|
Ke Bao
|
58b12ccb46
|
Support piecewise cuda graph for deepseek v3 (#12996)
|
2025-11-10 23:18:03 +08:00 |
|
|
Ke Bao
|
db24d34603
|
Support piecewise cuda graph for MLA (#11812)
|
2025-11-10 09:13:48 +08:00 |
|
|
Ke Bao
|
bb00e24f87
|
Adjust server launch time in ci (#12917)
|
2025-11-09 20:41:29 +08:00 |
|
|
Ke Bao
|
b5e0417392
|
Add kimi k2 thinking to ci (#12907)
|
2025-11-09 16:10:32 +08:00 |
|
|
Ke Bao
|
b142831a26
|
Fix empty server args in marlin moe test (#12904)
|
2025-11-09 13:30:47 +08:00 |
|
|
Ke Bao
|
5236290399
|
Update CODEOWNERS (#12897)
|
2025-11-09 09:37:11 +08:00 |
|
|
Ke Bao
|
44f594d832
|
Apply moe_reduce_sum kernel for fused_marlin_moe (#12888)
|
2025-11-09 01:31:05 +08:00 |
|
|
Ke Bao
|
0fe9c1f70b
|
Fix piecewise cuda graph ci test (#12836)
|
2025-11-08 00:25:00 +08:00 |
|
|
Ke Bao
|
cd135bfe30
|
Update dsv3 quantization auto setting for sm100 (#12778)
|
2025-11-06 22:39:13 +08:00 |
|
|
Ke Bao
|
7cee07a067
|
Fix skip layer in get_quant_method (#12632)
|
2025-11-04 23:27:46 +08:00 |
|
|
Ke Bao
|
69193f7122
|
Filter tokenizer warning for kimi models (#12485)
|
2025-11-01 16:27:31 +08:00 |
|
|
Ke Baoandyizhang2077
|
a4bf5c6ad2
|
Support Kimi Linear (#12469)
Co-authored-by: yizhang2077 <1109276519@qq.com>
|
2025-10-31 14:03:35 -07:00 |
|
|
Ke Bao
|
f7f9e41b36
|
Fix run benchmark (#12473)
|
2025-11-01 02:39:48 +08:00 |
|
|
Ke Bao
|
0095e01874
|
Fix lint in deepseek-ocr (#12470)
|
2025-11-01 00:08:19 +08:00 |
|
|
Ke BaoandHanming Lu
|
24bc3fb0f9
|
EAGLE cache fix for SWARadixCache (#11231)
Co-authored-by: Hanming Lu <69857889+hanming-lu@users.noreply.github.com>
|
2025-10-07 18:21:37 +08:00 |
|
|
Ke Bao
|
31b49c0b51
|
EAGLE cache fix for HiCache (#11215)
|
2025-10-04 16:53:53 -07:00 |
|
|
Ke Bao
|
91847e382a
|
Fix eagle radix cache (#10846)
|
2025-09-30 22:59:20 +08:00 |
|
|
Ke Bao
|
424591d53d
|
Fix spec filter batch when target extend (#10991)
|
2025-09-30 14:44:02 +08:00 |
|
|
Ke Bao
|
60d7beda6b
|
Add split tile size for Triton attention (#10425)
|
2025-09-14 17:35:49 -07:00 |
|
|
Ke Bao
|
603b3446dc
|
Fix FA3 swa spec verify topk>1 (#9658)
|
2025-08-26 15:03:14 -07:00 |
|
|
Ke Bao
|
e0ce171d79
|
Fix triton backend eagle illegal memory access (#9344)
|
2025-08-19 20:16:26 -07:00 |
|
|
Ke Bao
|
be1a3cd9b4
|
Fix swa eagle verify accuracy for Triton backend (#9279)
|
2025-08-17 12:52:02 -07:00 |
|
|
Ke Bao
|
0ff6d1fce1
|
Support FA3 backend for gpt-oss (#9028)
|
2025-08-13 10:41:50 -07:00 |
|
|
Ke Bao
|
94f44b88d1
|
Update fa3 interface and add unit test (#9150)
|
2025-08-13 20:05:02 +08:00 |
|
|
Ke Bao
|
0475448ee3
|
Optimize triton swa kernel by skipping computation (#8860)
|
2025-08-06 21:37:50 +08:00 |
|
|
Ke Bao
|
399e7ec8b3
|
Refine naming (#8868)
|
2025-08-06 21:37:02 +08:00 |
|
|
Ke Bao
|
4fc5f2f977
|
Add unit test for triton swa kernel (#8853)
|
2025-08-06 16:10:38 +08:00 |
|
|
Ke Bao
|
8128e08d36
|
Turn off hybrid cache by default (#8839)
|
2025-08-06 09:53:45 +08:00 |
|
|
Ke Bao
|
0242bb9c74
|
Fix triton kernels topk with keyword arguments (#8732)
|
2025-08-03 10:45:15 -07:00 |
|
|
Ke Bao
|
e252192679
|
Fix deepgemm masked grouped gemm jit compile (#8679)
|
2025-08-01 15:37:59 -07:00 |
|
|
Ke Bao
|
33f0de337d
|
chore: bump v0.4.10.post1 (#8652)
|
2025-08-01 12:07:30 +08:00 |
|
|
Ke Bao
|
8fbcfd0723
|
Update step3v default config (#8626)
|
2025-08-01 00:49:26 +08:00 |
|