19 Commits
Author SHA1 Message Date
yi_lu 2cd0007685 Add state-based training resume command 2026-07-23 19:48:41 +08:00
yi_lu 54ac00152a Use a fixed training container and runtime state 2026-07-23 19:39:07 +08:00
yi_lu 98c159679b Add Stage 2 curriculum and graceful checkpoint shutdown 2026-07-23 19:30:09 +08:00
yi_lu 1329bb9506 Support stage1-2 MoE resume on g0050 2026-07-16 09:23:10 +08:00
yi_lu 07e108388d Add heldout HF evaluation workflow 2026-07-09 08:39:02 +08:00
yi_lu e1e880cadf Add agent operating guide 2026-07-09 08:16:37 +08:00
yi_lu 2b0588ad17 Sync g0050 training and inference tooling 2026-07-09 08:02:25 +08:00
yi_lu 0e8c2a554d Support g0050 SSD preprocessing path 2026-07-02 21:59:02 +08:00
yi_lu b8b5c3ffe0 Use vLLM triton kernels for MoE backend 2026-07-02 21:29:10 +08:00
yi_lu 323452b9bd Add g0050 NeMo flash-attn4 training image 2026-07-02 21:10:58 +08:00
yi_lu 5698a9cc21 Add ModelScope parquet upload helper 2026-07-02 20:55:21 +08:00
yi_lu 5609b1f8e4 Add Megatron data manifest and g0050 setup 2026-07-02 20:50:24 +08:00
yi_lu 816eccb5b5 Tie embeddings for small MoE config 2026-07-01 23:27:56 +08:00
yi_lu 2c2b7ccc24 Add Megatron-Bridge pretrain launcher 2026-07-01 23:10:37 +08:00
yi_lu f0f72767f5 Add proof-pile logic inputs to pretrain builder 2026-07-01 22:42:18 +08:00
yi_lu cdd8e2f85b Add NeMo backend probe and architecture validator 2026-07-01 20:46:45 +08:00
yi_lu 11308f95c4 Use verified GLM-5.2 tokenizer from ModelScope 2026-07-01 19:48:17 +08:00
yi_lu e7ebb30e1f Use GLM-5.2 tokenizer vocabulary 2026-07-01 19:35:57 +08:00
yi_lu dcabce8c07 Initialize rebalanced 2B MoE project 2026-07-01 16:41:54 +08:00