4 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Ke Wen	862bcff833	Support loading of larger models with on-the-fly quantization (#3061)	2025-01-22 21:33:17 -08:00
Ke Wen	ece724910a	Make torch TP composable with torchao (#2436)	2024-12-11 04:21:42 -08:00
Ke Wen	d693ec0427	Make torch TP composable with torch.compile (#2352)	2024-12-04 17:26:00 -08:00
Ke Wen	cf2489762b	Add Tensor Parallel to torch_native_llama (#1876)	2024-11-15 21:26:00 -08:00