[D] If you get lucky with a good model, do you keep it?
Let’s say the random weights allow you to dodge a local optimum and you get a pretty good model, but it was just lucky. You can’t easily reproduce it. What would be your focus? Trying to get a reproduction going or just working further with the model you have?