-
Notifications
You must be signed in to change notification settings - Fork 0
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
6839ca1
commit 524db51
Showing
1 changed file
with
27 additions
and
0 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,27 @@ | ||
# Rusty-KAN | ||
|
||
Kolmogorov-Arnold Networks are a type of neural network that is based on the [Kolmogorov-Arnold representation theorem](https://en.wikipedia.org/wiki/Kolmogorov%E2%80%93Arnold_representation_theorem). Essentially, it states that any continuous function can be represented as a composition of a finite number of univariate functions. | ||
|
||
Therefore, a KAN is a neural network where the activation functions are placed on the edges and act as learnable weights for the network. The nodes simply sum the incoming activations. | ||
|
||
For example, see the following image, which shows how functions are composed in a KAN to approximate continuous functions: | ||
![alt text](image.png) | ||
|
||
This is the basis of the Rusty-KAN library, which is a Rust implementation of the KAN. | ||
|
||
## Installation | ||
|
||
To install Rusty-KAN, simply add the following line to your `Cargo.toml` file: | ||
|
||
```toml | ||
[dependencies] | ||
rusty-kan = "0.1.0" | ||
``` | ||
|
||
## References | ||
|
||
- [Kolmogorov-Arnold representation theorem](https://en.wikipedia.org/wiki/Kolmogorov%E2%80%93Arnold_representation_theorem) | ||
|
||
- [KAN: Kolmogorov-Arnold Networks](https://arxiv.org/abs/2404.19756) | ||
|
||
- [pykan](https://github.com/KindXiaoming/pykan) |