Schmidhuber’s new blog post about deep learning papers from 1990-1991.

The Deep Learning (DL) Neural Networks (NNs) of our team have revolutionised Pattern Recognition and Machine Learning, and are now heavily used in academia and industry. In 2020, we will celebrate that many of the basic ideas behind this revolution were published three decades ago within fewer than 12 months in our “Annus Mirabilis” or “Miraculous Year” 1990-1991 at TU Munich. Back then, few people were interested, but a quarter century later, NNs based on these ideas were on over 3 billion devices such as smartphones, and used many billions of times per day, consuming a significant fraction of the world’s compute.

The following summary of what happened in 1990-91 not only contains some high-level context for laymen, but also references for experts who know enough about the field to evaluate the original sources. I also mention selected later work which further developed the ideas of 1990-91 (at TU Munich, the Swiss AI Lab IDSIA, and other places), as well as related work by others.

http://people.idsia.ch/~juergen/deep-learning-miraculous-year-1990-1991.html