Tom Lu 98c159679b Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

..

audit_stage2_normalized.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

audit_stage2_raw_sources.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

build_rebalanced_pretrain_dataset.py

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

build_stage2_curriculum_dataset.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

build_text_hash_index.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

convert_pretrain_parquet_to_megatron.py

Sync g0050 training and inference tooling

2026-07-09 08:02:25 +08:00

download_rebalanced_sources.py

Initialize rebalanced 2B MoE project

2026-07-01 16:41:54 +08:00

download_stage2_curriculum_sources.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

drop_malformed_stage2_qa.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

export_pretrain_parquet_text_jsonl.py

Add Megatron-Bridge pretrain launcher

2026-07-01 23:10:37 +08:00

extract_stage2_archives.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

inspect_stage2_sources.py

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00

start_rebalanced_pretrain_dataset.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

start_rebalanced_source_download.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

wait_and_build_rebalanced_pretrain_200b.sh

Add proof-pile logic inputs to pretrain builder

2026-07-01 22:42:18 +08:00

wait_and_extract_stage2_archives.sh

Add Stage 2 curriculum and graceful checkpoint shutdown

2026-07-23 19:30:09 +08:00