Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
kazukiosawa authored Oct 31, 2019
1 parent 223839c commit 8c45f26
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,6 +14,7 @@ Scalable Second-Order methods in PyTorch.
- [[paper (preprint)](https://arxiv.org/abs/1906.02506)]

## Scalable Second-Order Optimization
![](docs/overview.png)

### Optimizers

Expand Down Expand Up @@ -46,8 +47,6 @@ Refer Section 6 of [Optimization Methods for Large-Scale Machine Learning](https

### Approximation Methods

![](docs/overview.png)

PyTorch-SSO calculates the curvature as a layer-wise block-diagonal matrix.

You can specify the approximation method for the curvatures in each layer from the follwing.
Expand Down

0 comments on commit 8c45f26

Please sign in to comment.