Skip to content

Commit

Permalink
new pages
Browse files Browse the repository at this point in the history
  • Loading branch information
jonah-ramponi committed Apr 3, 2024
1 parent d2549d9 commit ea7fddb
Show file tree
Hide file tree
Showing 3 changed files with 23 additions and 1 deletion.
2 changes: 1 addition & 1 deletion content/posts/intro_to_attention.md
Original file line number Diff line number Diff line change
Expand Up @@ -198,7 +198,7 @@ The overall output of the process is then simply
Concat() simply concatenates our output matrices. The output matrix of size $(n \times d_v)$ for each head is simply our matrices stacked on top of one another like so

\begin{equation*}
\text{Concat}(\text{head}_1, \dots, \text{head}_h) = \begin{pmatrix}
\text{Concat}(head_1, \dots, head_h) = \begin{pmatrix}
head_{1_{11}} & \dots & head_{1_{1d_v}} & \dots & head_{H_{11}} & \dots & head_{H_{1d_v}} \\
head_{1_{21}} & \dots & head_{1_{2d_v}} & \dots & head_{H_{21}} & \dots & head_{H_{2d_v}} \\
\vdots & \ddots & \vdots & \dots & \vdots & \ddots & \vdots \\
Expand Down
11 changes: 11 additions & 0 deletions content/posts/knowledge_graphs.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: Knowledge Graphs
description: A brief introduction to knowledge graphs
date: 2024-01-30
tldr: A brief introduction to knowledge graphs
draft: false
tags: [RAG]
---

Please check back later, this section is in progress :)

11 changes: 11 additions & 0 deletions content/posts/vector_databases.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
---
title: Vector Databases
description: A brief introduction to vector databases
date: 2024-01-30
tldr: A brief introduction to vector databases
draft: false
tags: [RAG]
---

Please check back later, this section is in progress :)

0 comments on commit ea7fddb

Please sign in to comment.