Machine Learning & Training

What Is the Adam Optimizer?

Adam is a widely used optimization algorithm for training neural networks. It adapts the learning rate for each parameter using estimates of the first and second moments of the gradients. By combining ideas from momentum and adaptive learning rate methods, Adam often converges quickly and requires little manual tuning.