Skip to content

Latest commit

 

History

History
68 lines (44 loc) · 2.58 KB

common-prerequisites.md

File metadata and controls

68 lines (44 loc) · 2.58 KB
Raw

Common Prerequisites for RAG Examples

Clone the Repository and Install Software

  • Clone the Generative AI examples Git repository using Git LFS:

    sudo apt -y install git-lfs
git clone [email protected]:NVIDIA/GenerativeAIExamples.git
cd GenerativeAIExamples/
git lfs pull

  • Install Docker Engine and Docker Compose. Refer to the instructions for Ubuntu.

    Ensure the Docker Compose plugin version is 2.29.1 or higher. Run docker compose version to confirm. Refer to Install the Compose plugin in the Docker documentation for more information.

  • Optional: You can run some containers with GPU acceleration, such as Milvus and NVIDIA NIM for LLMs. To configure Docker for GPU-accelerated containers, install the NVIDIA Container Toolkit.

Get an API Key for the Accessing Models on the API Catalog

Perform the following steps if you do not already have an API key. You can use different model API endpoints with the same API key.

  1. Navigate to https://build.nvidia.com/explore/discover.

  2. Find the Llama 3 70B Instruct card and click the card.

    Llama 3 70B Instruct model card

  3. Click Get API Key.

    API section of the model page.

  4. Click Generate Key.

    Generate key window.

  5. Click Copy Key and then save the API key. The key begins with the letters nvapi-.

    Key Generated window.

Get an NVIDIA NGC API Key

The NVIDIA NGC API Key is required to log in to the NVIDIA container registry, nvcr.io, and to pull secure base container images used in the RAG examples.

Refer to Generating NGC API Keys in the NVIDIA NGC User Guide for more information.

After you get your NGC API key, you can run docker login nvcr.io to confirm the key is valid.