We have analyzed abstracts and keywords of ICLR submissions over the last three years and observed interesting patterns, such as decreasing fraction of papers about GANs and increasing interest in attention/transformer and neural architecture search.

For more details see: https://deepsense.ai/key-findings-from-the-international-conference-on-learning-representations-iclr/