Hi all,

I am reading about Natural gradient descent. Usually I find it quite helpful if I can get to read quite a bunch of papers concerning the topic, I am figuring out good papers online, but if someone from the community can point me to some good papers, it would be great.

​

Can some one point me to a list of good natural gradient descent papers which would address the following:

1. Starting from the S Amari’s paper to the recent papers.
2. Natural gradient descent fisher approximation papers
3. Natural gradient descent papers which highlight benefits in preventing saddle points/ achieving local minima.
4. Hessian matrix approximation papers
5. Other good papers covering techniques like KFAC, hessian matrices, fisher matrices, their approximations, NSGD

​

Thanks !!