From 05e8a1b398f154d36830b910e0153165e71db80e Mon Sep 17 00:00:00 2001 From: Josh Creek <8179928+jcreek@users.noreply.github.com> Date: Tue, 1 Sep 2026 19:08:52 +0100 Subject: [PATCH] docs(training): record stage six league evidence --- TRAINING.md | 22 ++++++++++++++++++---- 1 file changed, 18 insertions(+), 4 deletions(-) diff --git a/TRAINING.md b/TRAINING.md index c3b4eced..3e02b942 100644 --- a/TRAINING.md +++ b/TRAINING.md @@ -142,10 +142,24 @@ early reference to see absolute progress over time. The evaluator launches Godot with the explicit headless display driver, Compatibility renderer, dummy audio driver, and a temporary writable log path so evaluation is reproducible on machines where the default renderer or -`user://` log location is unavailable. A two-seed smoke check on 2026-09-01 -completed 10 paired episodes per seed for the current Stage 6 export versus -`hard.json` (both runs finished 3–5 with 2 draws); this is only a runtime -smoke and is not promotion evidence for the Stage 6 gate. +`user://` log location is unavailable. On 2026-09-01, the current Stage 6 +export completed the full 100-episode paired evaluation against each of its +three league references on the independent seeds 19 and 43 (seed 1 was already +recorded in `eval_history.json`): + +| Seed | Stage 3 reference | Stage 4 reference | Stage 5 reference | +| --- | ---: | ---: | ---: | +| 1 | 79–17–4 | 60–31–9 | 32–51–17 | +| 19 | 82–13–5 | 65–21–14 | 40–42–18 | +| 43 | 74–17–9 | 58–27–15 | 36–54–10 | + +Cells are candidate wins–reference wins–draws. The candidate clears the +documented 15% reference-regression margin against Stage 3 and Stage 4 on all +three seeds, but fails against Stage 5 on seeds 1 and 43 and is effectively +even on seed 19. The physical-team splits stayed within the 20% diagnostic +ceiling. This is independent runtime evidence, not promotion evidence: Stage 6 +remains open and requires another training attempt or an explicit human +decision after reviewing the Stage 5 regression. If a model was trained with the locomotion mask on (curriculum stages 1, 2, and 5 — see below), pass `--grounded-a`/`--grounded-b` for whichever side it's on.