# pretrain_kaiyuan2b

The repository hosts scripts and configurations for the Kaiyuan-2B model reproduction