[D] How much progress have we really made in the past decade?
I’m an undergrad about to graduate and debating on doing Graduate school on some form of AI. What I fear is that, every bit of progress that was made in the past decade was either hype or due to faster computation or using relu rather than sigmoid.
IMO AI can be broken down to 3 parts, the algorithm for inference, knowledge representation, and computational speed. Of these 3, have we really made any progress in representation and algorithms in the past decade? Besides getting better GPU’s , everything else was already discover decades ago. Can anyone change my mind? Are we going to have AI winter 2.0 soon?