Obviously deep learning is now very popular that employ neural networks as its substrate. But what are some of unpopular neural networks and their training techniques or even neural networks that are not trained in its mainstream meaning.

Off the top we have following which are not as popular as DNNs but still are well known,

• RBM and Hopfield nets
• SOM
• SOINN
• CPPN
• GNG
• NEAT/HyperNEAT
• Evolution strategies

One I could think of that is buried under is a string matching NN – Optimal neural network algorithm for on-line string matching

Please share some of the interesting networks from the past.