I would like to start a discussion about solving deep networks without backprop. I have invented a mechanism in 2016 that uses no backprop at all and that can solve any network topology. The algorithm also scales almost lineary so you can double the performance using two machines.

Anyone interested?