When looking at RL training, it’s often frustrating to see the agent taking so long to discover simple things you could code up yourself for parts of the task. This work takes that idea as it basis – if you code up some solutions to parts of the problem, how do you incorporate that into RL training? Turns out it’s a little tricky…

Arxiv: https://arxiv.org/abs/1909.04121 (CORL 2019)

Blog post: http://ai.stanford.edu/blog/acteach/

(hope posting own papers is kosher, open to answering any questions!)