Skip to content

Commit

Permalink
add tokenization, embeddings, quantization
Browse files Browse the repository at this point in the history
  • Loading branch information
aishaeldeeb committed Aug 21, 2024
1 parent 21b5210 commit 93cef83
Show file tree
Hide file tree
Showing 5 changed files with 47 additions and 1 deletion.
Binary file added slides/embeddings.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
48 changes: 47 additions & 1 deletion slides/introduction.html
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,7 @@ <h3>Pre-workshop setup</h3>
</p>
</aside>
</section>


<section data-background="#e6f7ff">
<h3>Background</h3>
Expand Down Expand Up @@ -321,6 +321,52 @@ <h3>Open Jupyter Notebooks</h3>
</aside>
</section>

<section data-background="#e6f7ff">
<h3>Tokenization: Types </h3>
<img height="400px" src="tokenization_types.png">
<p style="color:blue;font-size:11px;"> From https://medium.com/@abdallahashraf90x/tokenization-in-nlp-all-you-need-to-know-45c00cfa2df7</p>
<aside class="notes">
<p>

</p>
</aside>
</section>

<section data-background="#e6f7ff">
<h3>Tokenization: Example </h3>
<img height="400px" src="tokenization_example.png">
<p style="color:blue;font-size:11px;"> From https://towardsdatascience.com/why-are-there-so-many-tokenization-methods-for-transformers-a340e493b3a8</p>
<aside class="notes">
<p>

</p>
</aside>
</section>

<section data-background="#e6f7ff">
<h3>Embeddings </h3>
<img height="400px" src="embeddings.png">
<p style="color:blue;font-size:11px;"> From https://medium.com/@hari4om/word-embedding-d816f643140</p>
<aside class="notes">
<p>

</p>
</aside>
</section>

<section data-background="#e6f7ff">
<h3>Quantization </h3>
<img height="400px" src="quantization.png">
<p style="color:blue;font-size:11px;"> From https://www.tensorops.ai/post/what-are-quantized-llms</p>
<aside class="notes">
<p>

</p>
</aside>
</section>



<section data-background="#e6f7ff">
<h3>Fine tuning LLMs</h3>
<ul>
Expand Down
Binary file added slides/quantization.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added slides/tokenization_example.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added slides/tokenization_types.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit 93cef83

Please sign in to comment.