jcreek/Sarpy
1
0
Fork 0
mirror of https://github.com/jcreek/Sarpy.git synced 2026-07-13 03:03:43 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat(*): Update at 1 billion timesteps

Browse Source
This commit is contained in:
Josh Creek
2023-10-12 21:27:13 +01:00
parent a427c1f58d
commit 88addb1cf5
2 changed files with 10 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+8 -2
View File
@@ -80,7 +80,7 @@ This is to try to get the bot to gain experience in other areas of the game now
#### ~500 million steps
After 528 million steps I changed things again, switching to 1v1 instead of 3v3, and changing the rewards as below:
After 528 million steps I changed things again, changing the rewards as below:
- VelocityBallToGoalReward -> 10
- EventReward -> 10
@@ -90,7 +90,13 @@ After 528 million steps I changed things again, switching to 1v1 instead of 3v3,
#### ~1 billion steps
The bot should now have acceptable mechanics and a vague understanding of 1v1 strategies.
The bot should now have acceptable mechanics and a vague understanding of 3v3 strategies.
However, I noticed that there's a lot of dead time, where it's not necessarily driving towards the ball or preparing to defend or receive a pass, so I changed things again, changing the rewards as below:
- VelocityPlayerToBallReward -> 50
- LiuDistanceBallToGoalReward -> 20
- RewardIfClosestToBall -> 10
### Stage 2