Skip to content

Commit 8a4ddbe

Browse files
committed
Fixed tex environment.
1 parent be7bcbf commit 8a4ddbe

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

docs/src/layers/attention_layer.md

+1-1
Original file line numberDiff line numberDiff line change
@@ -77,7 +77,7 @@ The Cayley transform maps from skew-symmetric matrices to orthonormal matrices[^
7777
We can easily check that ``\mathrm{Cayley}(A)`` is orthogonal if ``A`` is skew-symmetric. For this consider ``\varepsilon \mapsto A(\varepsilon)\in\mathcal{S}_\mathrm{skew}`` with ``A(0) = \mathbb{I}`` and ``A'(0) = B``. Then we have:
7878

7979
```math
80-
\frac{\delta\mathrm{Cayley}}{\delta{}A} \big \frac{d}{d\varepsilon}\big|_{\varepsilon=0} \mathrm{Cayley}(A(\varepsilon))^T \mathrm{Cayley}(A(\varepsilon)) = \mathbb{O}.
80+
\frac{\delta\mathrm{Cayley}}{\delta{}A} = \frac{d}{d\varepsilon}|_{\varepsilon=0} \mathrm{Cayley}(A(\varepsilon))^T \mathrm{Cayley}(A(\varepsilon)) = \mathbb{O}.
8181
```
8282

8383
In order to use the Cayley transform as an activation function we further need a mapping from the input ``Z`` to a skew-symmetric matrix. This is realized in two ways in `GeometricMachineLearning`: via a scalar-product with a skew-symmetric weighting and via a scalar-product with an arbitrary weighting.

0 commit comments

Comments
 (0)