Skip to content
Lanme edited this page Feb 22, 2019 · 5 revisions

sigmod求导

sigmod公式: $$ y = \frac{1}{1+e^{-x}} $$ sigmod求导: $$ y' = \frac{\partial y}{\partial x} = \frac{0*(1+e^{-x})-{1*(1+e^{-x})}^{'}}{(1+e^{-x})^{2}} \ =\frac{e^{-x}}{(1+e^{-x})^{2}} \ = y*(1-y) $$

softmax求导

softmax公式: $$ a_j = \frac{e^{z_j}}{\sum _k e^{z_k}} $$ softmax求导: $$ a_j' = \frac{\partial a_j}{\partial z_i} \ $$ 这里公式是对$z_i$求导 pic

Clone this wiki locally