[R] Measuring Arithmetic Extrapolation Performance
Extrapolation on math is hard for NNs. We propose a new set of benchmarks and find current methods are fragile https://arxiv.org/abs/1910.01888.
So how should we build NNs that can learn the logic behind math? Inductive bias? More data does not seem to solve this problem!