Commit Graph
5 Commits
Author SHA1 Message Date
yi_lu 816eccb5b5 Tie embeddings for small MoE config 2026-07-01 23:27:56 +08:00
yi_lu 2c2b7ccc24 Add Megatron-Bridge pretrain launcher 2026-07-01 23:10:37 +08:00
yi_lu 11308f95c4 Use verified GLM-5.2 tokenizer from ModelScope 2026-07-01 19:48:17 +08:00
yi_lu e7ebb30e1f Use GLM-5.2 tokenizer vocabulary 2026-07-01 19:35:57 +08:00
yi_lu dcabce8c07 Initialize rebalanced 2B MoE project 2026-07-01 16:41:54 +08:00