There are so many different optimizers to choose from when doing ML projects and it was never clear to me which one should be used. So I decided to do a little research project and see for myself how they compared. I’ve written up the results here. Code: https://github.com/rickwierenga/BenchmarkingMLOptimizers

Let me know if you have any questions/thoughts.