[D] How to differentiate between your idea or implementation being wrong?
As the title says, I’m curious as to what is the most efficient way to figure out if your idea is junk or your implementation messed up somewhere. Especially if your implementation failed due to strange autograd quirks of the framework you’re using (which has bit me in the past sometimes). I guess the common sense ones are:
- Test it on toy cases (takes a long time to design)
- Get advisor / someone else in the lab to take a look (often they agree with the general idea, but won’t have the inclination/time to study the implementation very deeply, understandably)
- Git gud (pretty hard)