5

In artificial neural networks, the sigmoid and complementary log log activation functions are similar in shape when plotted on a graph. I would like to know when to use the two functions and their pros and cons. Thanks in advance :)

amoeba
  • 93,463
  • 28
  • 275
  • 317
  • "Sigmoid" just means [s-shaped curve](https://en.wikipedia.org/wiki/Sigmoid_function). I gather you are referring to the [logit function](https://en.wikipedia.org/wiki/Logit) here. You may want to read: [Difference between logit and probit models](https://stats.stackexchange.com/q/20523/7290). – gung - Reinstate Monica Apr 21 '17 at 16:57

1 Answers1

3

This paper is behind a pay-wall but is one of the only references that I've found.

Gecynalda S. da S. Gomes & Teresa B. Ludermir. "Complementary Log-Log and Probit: Activation Functions Implemented in Artificial Neural Networks"

The types of activation functions most often used in artificial neural networks are logistic and hyperbolic tangent. Activation functions used in ANN have been said to play an important role in the convergence of the algorithms used. This paper uses sigmoid functions in the processing units of neural networks. Such functions are commonly applied in statistical regression models. The nonlinear functions implemented here are the inverse of complementary log-log and probit link functions. A Monte Carlo framework is presented to evaluate the results of prediction power with these nonlinear functions.

Glorfindel
  • 700
  • 1
  • 9
  • 18
Sycorax
  • 76,417
  • 20
  • 189
  • 313