[R] Spectral Analysis of Latent Representations
Layer saturation is proportion of eigenvalues needed to explain variance of representations over training. Saturation is a useful proxy for model over/under-parameterization.
PyTorch/Keras implementation: https://github.com/delve-team/delve
Metric for analyzing deep neural network layers and fine-tuning architecture. Contributors to code/next paper are welcome!
submitted by /u/justinshenk