Stumbled upon the paper on the learning schedule for super-convergence by using very large learning rates by Leslie Smith and it blew my mind, and I was immediately thinking about what other papers exist that’ve made wonderous experimental discoveries in ML/DL that were never published due to them being, well, experimental in nature – and apparently these sort of papers are a no-no in the DL scientific community (at least for publication purposes).

Thus wondering; does anyone know what’s the best place to find more of these sort of papers / discoveries?