One of the most commonly used activation functions is the logistic or sigmoid function. When used in a cost function, we
Posted: Tue May 10, 2022 5:32 pm
One of the most commonly used activation functions is the logistic or sigmoid function. When used in a cost function, we must take the derivative of it during optimization. In this problem, calculate the derivative of the sigmoid function 1 $(z)= 1+e? and show that: 402)= d -(z) = $(z)(1-€(z)) dz HINT: Use the quotient rule for derivatives and note that we can use a trick to write e? =1+2 -1