I need to learn a function that happens to have periodic components (along with non-periodic stuff) . I’d like to use only deep learning for reasons. Simple feed-forward networks suffer from this problem:

https://i.redd.it/6xfltw3xs6d21.png

Is there some standard way of doing so? It seems like sine activations are really hard to train, and the Fourier transform is afflicted with the curse of dimensionality, so learning on the frequency domain is not going to work either. Thanks in advance!