​

Layer saturation is proportion of eigenvalues needed to explain variance of representations over training. Saturation is a useful proxy for model over/under-parameterization.

arXiv: https://arxiv.org/abs/1907.08589

PyTorch/Keras implementation: https://github.com/delve-team/delve

Metric for analyzing deep neural network layers and fine-tuning architecture. Contributors to code/next paper are welcome!