 JieXin Liang
|
a995a773a0
|
[fix] remove cuda_device_count_stateless (#5060)
|
2025-04-04 00:18:26 -07:00 |
|
|
JieXin Liang
|
51ac297ace
|
[feat] interface for platforms abstraction (#4928)
|
2025-03-31 00:04:21 -07:00 |
|
|
JieXin Liang
|
9e93ef3f8e
|
[fix] fix illegal mem access and clean up triton attention backend (#4571)
|
2025-03-20 02:01:52 -07:00 |
|
|
JieXin Liang
|
4942074174
|
[fix] fix initialization of _ENABLE_TORCH_INFERENCE_MODE (#4549)
|
2025-03-19 09:57:59 -07:00 |
|
|
JieXin Liang
|
c0e9a36c5f
|
Optimize Triton decoding kernel for dynamic workload (#4553)
|
2025-03-18 21:25:38 -07:00 |
|
|
JieXin Liang
|
0212d2e288
|
[Fix] use torch.inference_mode() instead of torch.no_grad() (#4372)
|
2025-03-16 22:54:16 -07:00 |
|
|
JieXin Liang
|
1a3fa75f2f
|
[Fix] use torch.cat instead of torch.concat to prevent entering the Autograd backends. (#4466)
|
2025-03-16 00:02:47 -07:00 |
|
|
JieXin Liang
|
0540fef7a1
|
[Fix] fix _yarn_linear_ramp_mask with device parameter (#4337)
|
2025-03-12 02:28:19 -07:00 |
|