yi_lu/laoyao_2b_moe
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
19 Commits 1 Branch 0 Tags
main
Commit Graph
5 Commits
Author SHA1 Message Date
yi_lu 816eccb5b5 Tie embeddings for small MoE config 2026-07-01 23:27:56 +08:00
yi_lu 2c2b7ccc24 Add Megatron-Bridge pretrain launcher 2026-07-01 23:10:37 +08:00
yi_lu 11308f95c4 Use verified GLM-5.2 tokenizer from ModelScope 2026-07-01 19:48:17 +08:00
yi_lu e7ebb30e1f Use GLM-5.2 tokenizer vocabulary 2026-07-01 19:35:57 +08:00
yi_lu dcabce8c07 Initialize rebalanced 2B MoE project 2026-07-01 16:41:54 +08:00