New article written by Andrej Karpathy distilling a bunch of useful heuristics for training neural nets. I think the blog post is full of the kind of real-world knowledge and how-to details that are not taught in books and often take endless hours to learn the hard way.

Have a look:

https://karpathy.github.io/2019/04/25/recipe/