Video – https://youtu.be/ynMYVdb7mO8

It was always my little dream to do exactly this project. I know people have done it before, but being a beginner in both Unity and Reinforcement Learning I thought I share the results of my little dream 😛

​

The agent taught itself how to land, no human taught it or shown how to do it. Trained for 500k steps (ca. 1h), could have ended sooner – image

​

Maximum reward/score is 20, its almost impossible to reach. It would mean 0 landing speed + 0 horizontal offset from the target. Needless to say, humans have no chance to land like that 😛

Reward function – click me

​

Will retrain with different parameters. Right now batch_size: 10 and buffer_size: 100, rest default.

​

Todo:

– Add fuel consumption

– Lessen the thrust of sideways engines

– Simulate something more similar to a SpaceX landing, where a rocket falls for a period of time before landing

– Add human controlled rocket for competitive play

– Host the game on the web

– ???

​

ps. Elon Musk, hire me! 😀