Machine Learning & Training

What Is Batch Normalization?

Batch normalization is a technique that normalizes the inputs of a neural network layer using statistics computed over a mini-batch. This helps stabilize and accelerate training by reducing internal shifts in the distribution of activations. It can also have a mild regularizing effect.