diff --git a/_posts/2024-05-07-sigmoid-and-softmax.md b/_posts/2024-05-07-sigmoid-and-softmax.md index 6b93040..e83532e 100644 --- a/_posts/2024-05-07-sigmoid-and-softmax.md +++ b/_posts/2024-05-07-sigmoid-and-softmax.md @@ -142,7 +142,11 @@ $$ \mathbf{\hat{p}} &= \mathbf{w}^\star \end{align} $$ + + ![Sigmoid with entropy](https://github.com/sigmoidandsoftmax/sigmoidandsoftmax.github.io/blob/main/assets/img/sigmoid_and_softmax/sigmoid_neg_entropy.png?raw=true) + + ![Softmax with entropy](https://github.com/sigmoidandsoftmax/sigmoidandsoftmax.github.io/blob/main/assets/img/sigmoid_and_softmax/softmax_neg_entropy.png?raw=true) Figure 1. Effect of the entropy term in values of the objective function of sigmoid and softmax.