Machine Learning & Training

What Is Learning Rate?

The learning rate is a hyperparameter that determines the size of the steps taken when updating model parameters during optimization. A rate that is too high can cause training to diverge, while one that is too low can make training slow. Choosing an appropriate learning rate is a key part of tuning machine learning models.