Skip to content

Commit

Permalink
set repo_id
Browse files Browse the repository at this point in the history
  • Loading branch information
dannylee1020 committed Dec 15, 2024
1 parent c1801b0 commit 21d17f1
Show file tree
Hide file tree
Showing 2 changed files with 7 additions and 7 deletions.
8 changes: 4 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -166,7 +166,7 @@ To use Prometheus2:

```python
from openpo import Prometheus2
from openpo.resources.provider.vllm import VLLM
from openpo.resources.provider import VLLM

model = VLLM<(model="prometheus-eval/prometheus-7b-v2.0")
pm = Prometheus2(model=model)
Expand All @@ -186,14 +186,14 @@ Use out of the box storage class to easily upload and download data.

```python
from openpo.storage import HuggingFaceStorage
hf_storage = HuggingFaceStorage(repo_id="my-dataset-repo")
hf_storage = HuggingFaceStorage()

# push data to repo
preference = {"prompt": "text", "preferred": "response1", "rejected": "response2"}
hf_storage.push_to_repo(data=preference)
hf_storage.push_to_repo(repo_id="my-hf-repo", data=preference)

# Load data from repo
data = hf_storage.load_from_repo()
data = hf_storage.load_from_repo(path="my-hf-repo")
```


Expand Down
6 changes: 3 additions & 3 deletions docs/storage.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,14 +8,14 @@ OpenPO provides storage class for S3 and HuggingFace Dataset repository out of t
```python
from openpo.storage import HuggingFaceStorage

hf_storage = HuggingFaceStorage(repo_id="my-dataset-repo", api_key="hf-token") # api_key can also be set as environment variable.
hf_storage = HuggingFaceStorage(api_key="hf-token") # api_key can also be set as environment variable.

# push data to repo
preference = [{"prompt": "text", "preferred": "response1", "rejected": "response2"}]
hf_storage.push_to_repo(data=preference)
hf_storage.push_to_repo(repo_id="my-hf-repo", data=preference)

# Load data from repo
data = hf_storage.load_from_repo()
data = hf_storage.load_from_repo(path="my-hf-repo")
```

## S3 Storage
Expand Down

0 comments on commit 21d17f1

Please sign in to comment.