Lianmin Zheng f64eae3a29 [Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00

..

cuda_graph_runner.py

Fix bugs in sampler with CUDA graph / torch.compile (#1306)

2024-09-02 23:18:48 +00:00

forward_batch_info.py

Optimize the update flashinfer indices (#1262)

2024-08-31 23:40:28 -07:00

model_runner.py

[Fix] Reduce memory usage for loading llava model & Remove EntryClassRemapping (#1308)

2024-09-02 21:44:45 -07:00