Skip to content

Commit

Permalink
Update 12-3.md
Browse files Browse the repository at this point in the history
Self-Attention Paragraph Typos: Issues Atcold#779
  • Loading branch information
PeppeSaccardi authored May 6, 2021
1 parent d967d82 commit a9c2450
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/en/week12/12-3.md
Original file line number Diff line number Diff line change
Expand Up @@ -36,7 +36,7 @@ $$
\boldsymbol{h} = \boldsymbol{X} \boldsymbol{a}
$$

where $\boldsymbol{a} \in \mathbb{R}^n$ is a column vector with components $\alpha_i$.
where $\boldsymbol{a} \in \mathbb{R}^t$ is a column vector with components $\alpha_i$.

Note that this differs from the hidden representation we have seen so far, where the inputs are multiplied by a matrix of weights.

Expand Down

0 comments on commit a9c2450

Please sign in to comment.