docs(training): record stage six league evidence

This commit is contained in:
Josh Creek
2026-09-01 19:08:52 +01:00
parent e56850a236
commit 05e8a1b398
+18 -4
View File
@@ -142,10 +142,24 @@ early reference to see absolute progress over time.
The evaluator launches Godot with the explicit headless display driver, The evaluator launches Godot with the explicit headless display driver,
Compatibility renderer, dummy audio driver, and a temporary writable log path Compatibility renderer, dummy audio driver, and a temporary writable log path
so evaluation is reproducible on machines where the default renderer or so evaluation is reproducible on machines where the default renderer or
`user://` log location is unavailable. A two-seed smoke check on 2026-09-01 `user://` log location is unavailable. On 2026-09-01, the current Stage 6
completed 10 paired episodes per seed for the current Stage 6 export versus export completed the full 100-episode paired evaluation against each of its
`hard.json` (both runs finished 35 with 2 draws); this is only a runtime three league references on the independent seeds 19 and 43 (seed 1 was already
smoke and is not promotion evidence for the Stage 6 gate. recorded in `eval_history.json`):
| Seed | Stage 3 reference | Stage 4 reference | Stage 5 reference |
| --- | ---: | ---: | ---: |
| 1 | 79174 | 60319 | 325117 |
| 19 | 82135 | 652114 | 404218 |
| 43 | 74179 | 582715 | 365410 |
Cells are candidate winsreference winsdraws. The candidate clears the
documented 15% reference-regression margin against Stage 3 and Stage 4 on all
three seeds, but fails against Stage 5 on seeds 1 and 43 and is effectively
even on seed 19. The physical-team splits stayed within the 20% diagnostic
ceiling. This is independent runtime evidence, not promotion evidence: Stage 6
remains open and requires another training attempt or an explicit human
decision after reviewing the Stage 5 regression.
If a model was trained with the locomotion mask on (curriculum stages 1, 2, If a model was trained with the locomotion mask on (curriculum stages 1, 2,
and 5 — see below), pass `--grounded-a`/`--grounded-b` for whichever side it's on. and 5 — see below), pass `--grounded-a`/`--grounded-b` for whichever side it's on.