yi_lu dcabce8c07 Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

..

build_rebalanced_pretrain_dataset.py

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

download_rebalanced_sources.py

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

start_rebalanced_pretrain_dataset.sh

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

start_rebalanced_source_download.sh

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

wait_and_build_rebalanced_pretrain_200b.sh

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00