Skip to content

Commit

Permalink
Fix typo 2023-05-01-hitchhikers-momentum.md
Browse files Browse the repository at this point in the history
  • Loading branch information
Velythyl authored Oct 11, 2023
1 parent 0e21987 commit d7ec47f
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions _posts/2023-05-01-hitchhikers-momentum.md
Original file line number Diff line number Diff line change
Expand Up @@ -265,7 +265,7 @@ difference between the current and the previous iterate $$(\xx_{t} - \xx_{t-1})$

Despite its simplicity, gradient descent with momentum exhibits unexpectedly rich dynamics that we'll explore on this post.

### History and relatex work
### History and related work

The origins of momentum can be traced back to Frankel's method in the 1950s for solving linear system of equations.<d-cite key="frankel1950convergence"></d-cite> It was later generalized by Boris Polyak to non-quadratic objectives<d-cite key="polyak1964some"></d-cite>.
While the quadratic case is by now well understood, the general strongly convex case has instead had some fascinating developments in the last years.
Expand Down Expand Up @@ -564,4 +564,4 @@ Plotting the asymptotic rates for all regions we can see that Polyak momentum (t

## Reproducibility

All plots in this post were generated using the following Jupyer notebook: [[HTML]]({{'assets/html/2023-05-01-hitchhikers-momentum/hitchhikers-momentum.html' | relative_url}}) [[IPYNB]]({{'assets/html/2023-05-01-hitchhikers-momentum/hitchhikers-momentum.ipynb' | relative_url}})
All plots in this post were generated using the following Jupyer notebook: [[HTML]]({{'assets/html/2023-05-01-hitchhikers-momentum/hitchhikers-momentum.html' | relative_url}}) [[IPYNB]]({{'assets/html/2023-05-01-hitchhikers-momentum/hitchhikers-momentum.ipynb' | relative_url}})

0 comments on commit d7ec47f

Please sign in to comment.