docs(training): record stage six league evidence

This commit is contained in:
Josh Creek
2026-09-01 19:08:52 +01:00
parent e56850a236
commit 05e8a1b398
+18 -4
View File
@@ -142,10 +142,24 @@ early reference to see absolute progress over time.
The evaluator launches Godot with the explicit headless display driver,
Compatibility renderer, dummy audio driver, and a temporary writable log path
so evaluation is reproducible on machines where the default renderer or
`user://` log location is unavailable. A two-seed smoke check on 2026-09-01
completed 10 paired episodes per seed for the current Stage 6 export versus
`hard.json` (both runs finished 35 with 2 draws); this is only a runtime
smoke and is not promotion evidence for the Stage 6 gate.
`user://` log location is unavailable. On 2026-09-01, the current Stage 6
export completed the full 100-episode paired evaluation against each of its
three league references on the independent seeds 19 and 43 (seed 1 was already
recorded in `eval_history.json`):
| Seed | Stage 3 reference | Stage 4 reference | Stage 5 reference |
| --- | ---: | ---: | ---: |
| 1 | 79174 | 60319 | 325117 |
| 19 | 82135 | 652114 | 404218 |
| 43 | 74179 | 582715 | 365410 |
Cells are candidate winsreference winsdraws. The candidate clears the
documented 15% reference-regression margin against Stage 3 and Stage 4 on all
three seeds, but fails against Stage 5 on seeds 1 and 43 and is effectively
even on seed 19. The physical-team splits stayed within the 20% diagnostic
ceiling. This is independent runtime evidence, not promotion evidence: Stage 6
remains open and requires another training attempt or an explicit human
decision after reviewing the Stage 5 regression.
If a model was trained with the locomotion mask on (curriculum stages 1, 2,
and 5 — see below), pass `--grounded-a`/`--grounded-b` for whichever side it's on.