Machine Learning & Training

What Is a Learning Rate Schedule?

A learning rate schedule is a strategy for changing the learning rate as training progresses. Common approaches gradually reduce the rate over time, allowing large steps early and finer adjustments later. Well-designed schedules can improve convergence and final model performance.

Further reading

Read more about learning rate schedule — articles and blogs from around the web: