Hello guys,

I have recently implemented two papers about attention-based BatchNormalization.

​

2) Attentive Normalization :

Arxiv link : https://arxiv.org/abs/1908.01259

Official Pytorch implementation : Not yet released but will be available here https://github.com/ivMCL/AttentiveNorm

My Keras implementation : https://github.com/Cyril9227/Keras_AttentiveNormalization

​

2) Instance Enhancement Batch Normalization :

Arxiv link : https://arxiv.org/abs/1908.01259

Official Pytorch implementation : https://github.com/gbup-group/IEBN

My Keras implementation : https://github.com/Cyril9227/Keras_IEBN

​

Both implementations work as a simple droppin replacement of standard BatchNorm layer. Any feedbacks are welcome !

Thank’s 🙂