yi_lu 5609b1f8e4 Add Megatron data manifest and g0050 setup

2026-07-02 20:50:24 +08:00

..

build_rebalanced_pretrain_dataset.py

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

convert_pretrain_parquet_to_megatron.py

Add Megatron data manifest and g0050 setup

2026-07-02 20:50:24 +08:00

download_rebalanced_sources.py

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

export_pretrain_parquet_text_jsonl.py

Add Megatron-Bridge pretrain launcher

2026-07-01 23:10:37 +08:00

start_rebalanced_pretrain_dataset.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

start_rebalanced_source_download.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

wait_and_build_rebalanced_pretrain_200b.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00