Skip to content

Commit

Permalink
Small fixes to lectures
Browse files Browse the repository at this point in the history
  • Loading branch information
mrava87 committed Jan 28, 2024
1 parent 5ca8f3f commit f4f8f71
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions docs/lectures/03_gradopt.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,10 +94,10 @@ $$
\theta_{i+1} = \theta_i - \frac{J(\theta)|_{\theta_i}}{J'(\theta)|_{\theta_i}}
$$

which can be easily derived from the Taylor expansion of $f(\theta)$ around $\theta_{i+1}$.
which can be easily derived from the Taylor expansion of $J(\theta)$ around $\theta_{i+1}$.

If we remember that finding the minimum (or maximum) of a function is equivalent to find the zeros of its first derivative
($\theta: min_\theta f(\theta) \leftrightarrow \theta: f'(\theta)=0$), the Newton's method can be written as:
($\theta: min_\theta J(\theta) \leftrightarrow \theta: J'(\theta)=0$), the Newton's method can be written as:

$$
\theta_{i+1} = \theta_i - \frac{J'(\theta)|_{\theta_i}}{J''(\theta)|_{\theta_i}}
Expand Down
2 changes: 1 addition & 1 deletion docs/lectures/04_linreg.md
Original file line number Diff line number Diff line change
Expand Up @@ -188,7 +188,7 @@ $$
which we can combine together to obtain a simplified formula for the derivative of the loss function of the output of the weighted summation ($z$)

$$
\frac{\partial \mathscr{L}}{\partial z} = \frac{\partial \mathscr{L}}{\partial a} \frac{\partial a}{\partial \sigma} =
\frac{\partial \mathscr{L}}{\partial z} = \frac{\partial \mathscr{L}}{\partial a} \frac{\partial a}{\partial z} =
-y(1-a) + (1-y)a = a - y = dz
$$

Expand Down

0 comments on commit f4f8f71

Please sign in to comment.