Ke Bao 2c615d120f [Feature] Support fp8 e5m2 kv cache with flashinfer (#1204) ...

Co-authored-by: Yineng Zhang <me@zhyncs.com>

2024-08-25 17:38:11 -07:00

..

cuda_graph_runner.py

Improve multi-node stability (#1171)

2024-08-20 22:35:05 -07:00

forward_batch_info.py

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00

model_runner.py

[Feature] Support fp8 e5m2 kv cache with flashinfer (#1204)

2024-08-25 17:38:11 -07:00