Clean tokenizer swap migration

This commit is contained in:
Codex
2026-06-18 10:10:57 +00:00
commit 5d1e9c4bc3
37 changed files with 9574 additions and 0 deletions

34
.gitignore vendored Normal file
View File

@@ -0,0 +1,34 @@
# Runtime outputs and experiment artifacts inside the four workflow folders
model_building/generated_models/
model_training/checkpoints/
evaluation_reporting/outputs/
evaluation_reporting/reports/
dataset_building/generated/
*/logs/
logs/
# Large model/data artifacts
*.safetensors
*.bin
*.pt
*.pth
*.ckpt
*.npy
*.npz
*.arrow
*.parquet
*.jsonl.gz
*.pkl
*.pickle
# Caches
__pycache__/
*.py[cod]
.cache/
.hf_cache/
wandb/
# Local/editor noise
.DS_Store
.vscode/
.idea/