Machine Learning & Training

What Is the Tanh Activation Function?

The tanh, or hyperbolic tangent, activation function maps inputs to values between -1 and 1. Because its output is zero-centered, it can help gradients flow more effectively than the sigmoid function in some networks. Like sigmoid, it can still suffer from vanishing gradients at extreme input values.