Activation Functions : Why “tanh” outperforms “logistic sigmoid”

Activation Functions: Why does “tanh” outperform “logistic sigmoid”? Recently, I was trying to build a CNN-LeNet with an MNIST dataset using the sigmoid activation function, I was really shocked by the results it gave, then I tried it using the tanh activation function. It gave the best result,…#activationfunctions #cnnlenet #mainobjective #dropouts #laerdstatistics #nonlinearity #dataset #deeplearning #batchnormalization #hyperbolic

Source: Reuters: Health - May 26, 2023 Category: Consumer Health News Source Type: news