Skip to content

Commit

Permalink
Merge pull request #18 from RedHatOfficial/markmc-readme-hf-token
Browse files Browse the repository at this point in the history
README.md: define HF_TOKEN to download granite model
  • Loading branch information
russellb authored May 28, 2024
2 parents 2f1b3e3 + 355f98b commit 19ef395
Showing 1 changed file with 10 additions and 3 deletions.
13 changes: 10 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -314,6 +314,15 @@ steps, so it is recommended to do so.
ilab init
```

#### Set up your Hugging Face token

Define an environment variable using the HF token you created in the above section under
Access Tokens.

```shell
export HF_TOKEN=<paste token value here>
````

#### Download Granite-7B (~27GB on disk)

Next, download the IBM Granite base model. Important: Do not download the “lab”
Expand All @@ -326,11 +335,9 @@ ilab download --repository ibm/granite-7b-base

#### Download Mixtral-8x7B-Instruct (~96GB on disk)

Follow the same process, but additionally define an environment variable using
the HF token you created in the above section under Access Tokens.
Follow the same process to download the Mixtral model.

```shell
export HF_TOKEN=<paste token value here>
ilab download --repository mistralai/Mixtral-8x7B-Instruct-v0.1
```

Expand Down

0 comments on commit 19ef395

Please sign in to comment.