Lianmin Zheng bc6915e3b9 Improve type annotation and styles (#2926)

2025-01-16 12:51:11 -08:00

..

cuda_graph_runner.py

Support multi-node DP attention (#2925)

2025-01-16 11:15:00 -08:00

forward_batch_info.py

Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784)

2025-01-07 23:29:10 -08:00

model_runner.py

Improve type annotation and styles (#2926)

2025-01-16 12:51:11 -08:00