路易 yi_lu
  • Joined on 2026-05-01
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-02 21:11:01 +08:00
323452b9bd Add g0050 NeMo flash-attn4 training image
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-02 20:55:24 +08:00
5698a9cc21 Add ModelScope parquet upload helper
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-02 20:50:59 +08:00
5609b1f8e4 Add Megatron data manifest and g0050 setup
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-01 23:27:59 +08:00
816eccb5b5 Tie embeddings for small MoE config
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-01 23:10:40 +08:00
2c2b7ccc24 Add Megatron-Bridge pretrain launcher
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-01 22:42:53 +08:00
f0f72767f5 Add proof-pile logic inputs to pretrain builder
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-01 20:46:47 +08:00
cdd8e2f85b Add NeMo backend probe and architecture validator
yi_lu pushed to main at yi_lu/laoyao_2b_moe 2026-07-01 19:48:48 +08:00
11308f95c4 Use verified GLM-5.2 tokenizer from ModelScope
e7ebb30e1f Use GLM-5.2 tokenizer vocabulary
dcabce8c07 Initialize rebalanced 2B MoE project
yi_lu created branch main in yi_lu/laoyao_2b_moe 2026-07-01 19:48:48 +08:00
yi_lu created repository yi_lu/laoyao_2b_moe 2026-07-01 19:33:19 +08:00
yi_lu pushed to main at yi_lu/Tokenizer_Swap 2026-07-01 15:33:08 +08:00
9b584742c4 Support Laoyao BPE tokenizer in SFT heldout builder
yi_lu pushed to main at yi_lu/Tokenizer_Swap 2026-07-01 15:24:08 +08:00
069f891ceb Add SFT heldout 2.8K build entrypoint
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-25 20:35:00 +08:00
d2cafeb8a0 Add eight GPU SWIFT and Megatron training scripts
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-25 15:34:24 +08:00
4f9e0a30a9 Update Hugging Face model download CLI
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-24 23:26:17 +08:00
e79c7ea9bf Tune default SFT and LoRA hyperparameters
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-24 23:11:07 +08:00
0b1a05cff5 Ignore Python package metadata
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-24 23:10:53 +08:00
03d6326e26 Document mirror and proxy defaults
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-24 23:03:38 +08:00
65153eb4f6 Add ModelScope dataset download support
yi_lu pushed to main at yi_lu/ti_coding_agent_probe 2026-06-24 23:02:19 +08:00
533adfa256 Add ModelScope dataset download support
yi_lu pushed to main at yi_lu/ti_coding_agent_data_prep 2026-06-24 22:43:15 +08:00
28b839eff0 Document audit policy and add full kept export