Application US15/009,647 events

2015-01-28 Priority to US201562108984P

2016-01-28 Application filed by Google LLC

2016-07-28 Publication of US20160217368A1

2019-09-17 Publication of US10417562B2

2019-09-17 Application granted

2019-10-15 Application status is Active

2038-01-01 Adjusted expiration

Abstract

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing inputs using a neural network system that includes a batch normalization layer. One of the methods includes receiving a respective first layer output for each training example in the batch; computing a plurality of normalization statistics for the batch from the first layer outputs; normalizing each component of each first layer output using the normalization statistics to generate a respective normalized layer output for each training example in the batch; generating a respective batch normalization layer output for each of the training examples from the normalized layer outputs; and providing the batch normalization layer output as an input to the second neural

https://patents.google.com/patent/US20160217368A1/en