Document audit policy and add full kept export

2026-06-24 22:43:04 +08:00
parent f06e573b04
commit 28b839eff0
4 changed files with 454 additions and 4 deletions
@@ -90,6 +90,15 @@ Build the balanced 500-row validation probe:
 python scripts/repurposing/build_swift_validation_500.py
 ```

+Build the full hard-filter-kept SWIFT training set, approximately 190k rows with the current audit policy:
+
+```bash
+python scripts/repurposing/build_swift_full_kept.py --input-root data/Open-SWE-Traces --output-dir runs/training_full_kept_swift
+```
+
+Use `build_swift_full_kept.py` for real full-data SFT preparation. Use
+`build_swift_training_probe_5k.py` plus `build_swift_validation_500.py` only for small probe runs and pipeline tests.
+
 Try pi-mono-style conversion:

 ```bash
@@ -107,4 +116,3 @@ For SWIFT exports:
 - MiniMax trajectories are treated as thinking-mode data and `reasoning_content` is wrapped with `<think>...</think>`.
 - Qwen trajectories are treated as non-thinking-mode data.
 - `system`, `user`, and `tool` messages use `loss=false`; assistant messages use `loss=true`.
-