Last week there was a paper published in Science describing a new (Gaussian-ish) activation function found only in human cortical neurons (specifically human cortical L2/3 neuron) – never before seen in other species. Just curious if anyone has yet to try implementing the new function in an artificial neural network yet? The authors claim it allows for what would otherwise take multiple layers of typical monotonic activation functions. In theory, if that’s true, you could learn more complex functions with fewer parameters.