From 3705b2891ec2b8a05462740fea2588b454820d85 Mon Sep 17 00:00:00 2001 From: naderlikeladder Date: Wed, 11 Dec 2024 09:38:48 -0800 Subject: [PATCH] updated the table --- README.md | 30 +++++++++++++++--------------- 1 file changed, 15 insertions(+), 15 deletions(-) diff --git a/README.md b/README.md index 910b4cb..586c47f 100644 --- a/README.md +++ b/README.md @@ -23,21 +23,21 @@ We've split the notebooks into categories based on the type of task they're desi ### LLM Finetuning/Training -| Notebook | Description | Min. GPU | Deploy | -| -------------------------------------------------------------------------------------------------------------------------- | --------------------------------------------------------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | --- | -| [Fine-tune Llama3 using Direct Preference Optimization](https://github.com/brevdev/notebooks/blob/main/llama3dpo.ipynb) | Fine-tune Llama3 using DPO | 1x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama3dpo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama3dpo) | -| [Fine-tune Llama3 using SFT](https://github.com/brevdev/notebooks/blob/main/llama3_finetune_inference.ipynb) | Fine-tune and deploy Llama 3 | 2x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama3_finetune_inference.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama3_finetune_inference) | -| [Fine-tune Llama 2](https://github.com/brevdev/notebooks/blob/main/llama2-finetune.ipynb) | A Guide to Fine-tuning Llama 2 | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama2-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama2-finetune) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=lPLrODJjHUE) | -| [Fine-tune Llama 2 - Own Data](https://github.com/brevdev/notebooks/blob/main/llama2-finetune-own-data.ipynb) | Fine-tune Llama 2 on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama2-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=lPLrODJjHUE) | -| [Fine-tune Mistral](https://github.com/brevdev/notebooks/blob/main/mistral-finetune.ipynb) | A Guide to Fine-tuning Mistral | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral-finetune) | -| [Fine-tune Mistral using NVIDIA NeMO and PEFT](https://github.com/brevdev/notebooks/blob/main/mistral-finetune-nemo.ipynb) | Fine-tune Mistral using NVIDIA NeMO and PEFT | 1x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune-nemo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral_nemo_finetune) | -| [Fine-tune Mistral - Own Data](https://github.com/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb) | Fine-tune Mistral on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=kmkcNVvEz-k) | -| [Fine-tune Mixtral (8x7B MoE)](https://github.com/brevdev/notebooks/blob/main/mixtral-finetune.ipynb) | A Guide to Fine-tuning Mixtral, Mistral's 8x7B MoE | 4x T4 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mixtral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mixtral-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=zbKz4g100SQ) | | -| [Fine-tune Mixtral (8x7B MoE) - Own Data](https://github.com/brevdev/notebooks/blob/main/mixtral-finetune-own-data.ipynb) | A Guide to Fine-tuning Mixtral on your own dataset | 4x T4 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mixtral-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mixtral-finetune-own-data) | -| [Fine-tune BioMistral](https://github.com/brevdev/notebooks/blob/main/biomistral-finetune.ipynb) | A Guide to Fine-tuning BioMistral | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/biomistral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/environment/new?instance=A10G:g5.xlarge&name=biomistral-finetune&file=https://github.com/brevdev/notebooks/raw/main/biomistral-finetune.ipynb&python=3.10&cuda=12.0.1) | -| [Fine-tune Phi-2](https://github.com/brevdev/notebooks/blob/main/phi2-finetune.ipynb) | A Guide to Fine-tuning Phi-2 | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/phi2-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/phi2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=t55XrJddjLA) | -| [Fine-tune Phi-2 - Own Data](https://github.com/brevdev/notebooks/blob/main/phi2-finetune-own-data.ipynb) | Fine-tune Phi-2 on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/phi2-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/phi2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=t55XrJddjLA) | -| [Training Question/Answer models using NVIDIA NeMo ](https://github.com/brevdev/notebooks/blob/main/gguf-export.ipynb) | Use NeMo to train BERT, GPT, and S2S models for Q&A tasks | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/question_answer_nemo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/question_answer_nemo) | +| Notebook | Description | Min. GPU | Deploy | +| ------------------------------------------------------------------------------------------------------------------------------ | --------------------------------------------------------- | -------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- | +| [Fine-tune Llama3 using Direct Preference Optimization](https://github.com/brevdev/notebooks/blob/main/llama3dpo.ipynb) | Fine-tune Llama3 using DPO | 1x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama3dpo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama3dpo) | +| [Fine-tune Llama3 using SFT](https://github.com/brevdev/notebooks/blob/main/llama3_finetune_inference.ipynb) | Fine-tune and deploy Llama 3 | 2x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama3_finetune_inference.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama3_finetune_inference) | +| [Fine-tune Llama 2](https://github.com/brevdev/notebooks/blob/main/llama2-finetune.ipynb) | A Guide to Fine-tuning Llama 2 | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama2-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama2-finetune) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=lPLrODJjHUE) | +| [Fine-tune Llama 2 - Own Data](https://github.com/brevdev/notebooks/blob/main/llama2-finetune-own-data.ipynb) | Fine-tune Llama 2 on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/llama2-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/llama2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=lPLrODJjHUE) | +| [Fine-tune Mistral](https://github.com/brevdev/notebooks/blob/main/mistral-finetune.ipynb) | A Guide to Fine-tuning Mistral | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral-finetune) | +| [Fine-tune Mistral using NVIDIA NeMO and PEFT](https://github.com/brevdev/notebooks/blob/main/mistral-finetune-nemo.ipynb) | Fine-tune Mistral using NVIDIA NeMO and PEFT | 1x A100 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune-nemo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral_nemo_finetune) | +| [Fine-tune Mistral - Own Data](https://github.com/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb) | Fine-tune Mistral on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mistral-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mistral-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=kmkcNVvEz-k) | +| [Fine-tune Mixtral (8x7B MoE)](https://github.com/brevdev/notebooks/blob/main/mixtral-finetune.ipynb) | A Guide to Fine-tuning Mixtral, Mistral's 8x7B MoE | 4x T4 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mixtral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mixtral-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=zbKz4g100SQ) | +| [Fine-tune Mixtral (8x7B MoE) - Own Data](https://github.com/brevdev/notebooks/blob/main/mixtral-finetune-own-data.ipynb) | A Guide to Fine-tuning Mixtral on your own dataset | 4x T4 | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/mixtral-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/mixtral-finetune-own-data) | +| [Fine-tune BioMistral](https://github.com/brevdev/notebooks/blob/main/biomistral-finetune.ipynb) | A Guide to Fine-tuning BioMistral | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/biomistral-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/environment/new?instance=A10G:g5.xlarge&name=biomistral-finetune&file=https://github.com/brevdev/notebooks/raw/main/biomistral-finetune.ipynb&python=3.10&cuda=12.0.1) | +| [Fine-tune Phi-2](https://github.com/brevdev/notebooks/blob/main/phi2-finetune.ipynb) | A Guide to Fine-tuning Phi-2 | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/phi2-finetune.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/phi2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=t55XrJddjLA) | +| [Fine-tune Phi-2 - Own Data](https://github.com/brevdev/notebooks/blob/main/phi2-finetune-own-data.ipynb) | Fine-tune Phi-2 on your own dataset | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/phi2-finetune-own-data.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/phi2-finetune-own-data) [![](https://uohmivykqgnnbiouffke.supabase.co/storage/v1/object/public/landingpage/youtubebadge.svg)](https://www.youtube.com/watch?v=t55XrJddjLA) | +| [Training Question/Answer models using NVIDIA NeMo](https://github.com/brevdev/notebooks/blob/main/question_answer_nemo.ipynb) | Use NeMo to train BERT, GPT, and S2S models for Q&A tasks | 1x A10G | [![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/brevdev/notebooks/blob/main/question_answer_nemo.ipynb) [![ Click here to deploy.](https://brev-assets.s3.us-west-1.amazonaws.com/nv-lb-dark.svg)](https://console.brev.dev/notebook/question_answer_nemo) | ### LLM Inference/Deployment