Commit Graph
85 Commits
Author SHA1 Message Date
Yineng Zhang 16267d4fa7 chore: bump v0.4.6.post4 (#6245) 2025-05-13 01:57:51 -07:00
Lianmin Zheng e8e18dcdcc Revert "fix some typos" (#6244) 2025-05-12 12:53:26 -07:00
applesaucethebunandBrayden Zhong d738ab52f8 fix some typos (#6209)
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
2025-05-13 01:42:38 +08:00
Yineng Zhang 678d8cc987 chore: bump v0.4.6.post3 (#6165) 2025-05-09 15:38:47 -07:00
Yineng Zhang 9858113c33 chore: bump v0.4.6.post2 (#5939) 2025-04-30 22:04:40 -07:00
Baizhou ZhangandYuhao Chen 799789afed Bump Flashinfer to 0.2.5 (#5870)
Co-authored-by: Yuhao Chen <yxckeis8@gmail.com>
2025-04-29 19:50:57 -07:00
Yineng Zhang dcae1fb2cd chore: bump v0.4.6.post1 (#5845) 2025-04-28 12:57:08 -07:00
Baizhou Zhang 84022c0e56 Release v0.4.6 (#5795) 2025-04-27 14:07:05 -07:00
Yineng Zhang b9c87e781d chore: bump v0.4.5.post3 (#5611) 2025-04-21 18:16:20 -07:00
lukec 417b44eba8 [Feat] upgrade pytorch2.6 (#5417) 2025-04-20 16:06:34 -07:00
Lianmin Zheng fbdc94ba59 Release v0.4.5.post2 (#5582) 2025-04-20 14:12:37 -07:00
Yineng Zhang 0961feefca feat: use flashinfer jit package (#5547) 2025-04-19 00:28:39 -07:00
Yineng Zhang 5b5c7237c8 chore: bump v0.4.5.post1 (#5445) 2025-04-15 23:00:07 -07:00
Michael Yao b64b88e738 [Docs] Update start/install.md (#5398) 2025-04-15 18:12:26 -07:00
Yineng Zhang 57f99608f4 bump v0.4.5 (#5117) 2025-04-07 00:35:00 -07:00
Yineng Zhang 35e0856b90 bump v0.4.4.post4 (#5091) 2025-04-05 15:36:17 -07:00
Yineng Zhang 19e96e5923 bump v0.4.4.post3 (#4878) 2025-03-28 23:21:24 -07:00
Yineng Zhang 1099f6c974 bump v0.4.4.post2 (#4669) 2025-03-26 19:58:00 -07:00
Yineng Zhang ba80c102f9 bump v0.4.4.post1 (#4402) 2025-03-13 17:53:46 -07:00
Yineng Zhang 6aaeb84872 chore: bump v0.4.4 (#4041) 2025-03-13 02:49:58 -07:00
Lianmin Zheng 45de89719c Revert "[XPU][CPU] Enable the native path of DeepSeek" (#4367) 2025-03-12 23:45:52 -07:00
Meng, HengyuandZhang, Liangang <liangang.zhang@intel.com> 71046fcd71 [XPU][CPU] Enable the native path of DeepSeek (#4086)
Co-authored-by: Zhang, Liangang <liangang.zhang@intel.com>
2025-03-12 22:26:29 -07:00
Yineng Zhangandqingquansong 1cf63485c1 upgrade flashinfer 0.2.3 (#4317)
Co-authored-by:  qingquansong <qsong@linkedin.com>
2025-03-11 15:37:17 -07:00
Peter PanandKebe 0e90ae628a [docker] Distributed Serving with k8s Statefulset ( good example for DeepSeek-R1) (#3631)
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Co-authored-by: Kebe <kebe.liu@daocloud.io>
2025-03-08 23:41:20 -08:00
Lianmin Zheng 9c58e68b4c Release v0.4.3.post4 (#4140) 2025-03-06 12:50:28 -08:00
Yineng Zhang fc671f66c1 chore: bump v0.4.3.post3 (#4114) 2025-03-05 17:26:10 -08:00
Lianmin Zheng 935cda944b Misc clean up; Remove the support of jump forward (#4032) 2025-03-03 07:02:14 -08:00
Yineng Zhang 564bdf29f7 upgrade flashinfer v0.2.2.post1 (#3934) 2025-02-27 09:53:48 -08:00
simveit c9fc4a9d26 Docs: delete sgl-kernel install in docs (#3845) 2025-02-26 09:25:43 -08:00
Lianmin Zheng d7934cde45 Fix CI and install docs (#3821) 2025-02-24 16:17:38 -08:00
55de40f782 [Docs]: Fix Multi-User Port Allocation Conflicts (#3601)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
Co-authored-by: simveit <simp.veitner@gmail.com>
2025-02-19 11:15:44 -08:00
Yineng Zhangandpankajroark a5375adc3a chore: bump v0.4.3.post2 (#3645)
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
2025-02-18 02:48:30 +08:00
Yineng Zhang 75d171a9c5 chore: update flashinfer v0.2.1.post2 (#3644) 2025-02-18 02:47:42 +08:00
Yineng Zhang e782eb7e6a chore: bump v0.4.3.post1 (#3638) 2025-02-17 21:58:19 +08:00
Shi Shuaiandzhaochenyang20 7443197a63 [CI] Improve Docs CI Efficiency (#3587)
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
2025-02-14 19:57:00 -08:00
Yineng Zhang 4e23c961e8 docs: update install (#3581) 2025-02-14 18:54:50 +08:00
Yineng Zhang ac963be234 update flashinfer-python (#3557) 2025-02-14 09:52:56 +08:00
Yineng Zhang e0b9a423c8 chore: bump v0.4.3 (#3556) 2025-02-14 09:43:14 +08:00
simveitandChayenne 368de3661e Update install docs (#3553)
Co-authored-by: Chayenne <zhaochen20@outlook.com>
2025-02-13 13:42:51 -08:00
Yineng Zhang 2f48221033 docs: update install 2025-02-12 03:13:31 +08:00
Yineng Zhang cddb1cdf8f chore: bump v0.4.2.post4 (#3459) 2025-02-10 14:12:16 +08:00
Yineng Zhang 27c4c9cf52 remove _grouped_size_compiled_for_decode_kernels (#3453) 2025-02-10 13:01:21 +08:00
Yineng Zhang c1f5f99f60 chore: bump v0.4.2.post3 (#3369) 2025-02-07 08:20:03 -08:00
Yineng Zhang 7aad8d1854 chore: bump v0.4.2.post2 (#3313) 2025-02-05 17:35:02 +08:00
Yineng Zhang 6186a8f889 update flashinfer install index url (#3293) 2025-02-05 00:44:35 +08:00
HAI 2c1a695ff1 ROCm: sgl-kernel enablement starting with sgl_moe_align_block (#3287) 2025-02-04 21:44:44 +08:00
HAI 566d61d90f ROCm: bump 6.3.0 (#3259) 2025-02-03 04:13:40 +08:00
Yineng Zhang cf0f7eafe6 chore: bump v0.4.2.post1 (#3233) 2025-01-31 20:35:55 +08:00
7b9b4f4426 Docs fix about EAGLE and streaming output (#3166)
Co-authored-by: Chayenne <zhaochenyang@ucla.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Jhin <jhinpan@umich.edu>
2025-01-27 18:10:45 -08:00
Yineng Zhang 4ab43cfb3e chore: bump v0.4.2 (#3180) 2025-01-27 21:42:05 +08:00