In this blog post, the author introduces a bag of standard and not-so-standard tricks to reduce training time to 34s of a Resnet model on CIFAR10 dataset, or 26s with test-time augmentation.

Blog post: https://myrtle.ai/how-to-train-your-resnet-8-bag-of-tricks/

Colab notebook: https://colab.research.google.com/github/davidcpage/cifar10-fast/blob/master/bag_of_tricks.ipynb

Author: David Page

Original tweet: https://twitter.com/dcpage3/status/1163563850442182657