[P][OC] An Empirical Comparison of Optimizers for Machine Learning Models
There are so many different optimizers to choose from when doing ML projects and it was never clear to me which one should be used. So I decided to do a little research project and see for myself how they compared. I’ve written up the results here. Code: https://github.com/rickwierenga/BenchmarkingMLOptimizers
Let me know if you have any questions/thoughts.