Skip to content

Commit

Permalink
Update README.md (#429)
Browse files Browse the repository at this point in the history
Co-authored-by: Niklas Muennighoff <[email protected]>
Co-authored-by: Pete <[email protected]>
  • Loading branch information
3 people authored Feb 5, 2024
1 parent 15af668 commit cf12108
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -51,7 +51,7 @@ The core models in the OLMo family released so far are (all trained on the [Dolm
## Inference

You can utilize our HuggingFace integration to run inference on the olmo checkpoints:
You can utilize our Hugging Face integration to run inference on the olmo checkpoints:

```python
from hf_olmo import * # registers the Auto* classes
Expand All @@ -67,7 +67,7 @@ response = olmo.generate(**inputs, max_new_tokens=100, do_sample=True, top_k=50,
print(tokenizer.batch_decode(response, skip_special_tokens=True)[0])
```

Alternatively, with the huggingface pipeline abstraction:
Alternatively, with the Hugging Face pipeline abstraction:

```python
from transformers import pipeline
Expand All @@ -77,7 +77,7 @@ print(olmo_pipe("Language modeling is"))

### Inference on finetuned checkpoints

If you finetune the model using the code above, you can use the conversion script to convert a native OLMo checkpoint to a HuggingFace-compatible checkpoint
If you finetune the model using the code above, you can use the conversion script to convert a native OLMo checkpoint to a Hugging Face-compatible checkpoint

```bash
python hf_olmo/convert_olmo_to_hf.py --checkpoint-dir /path/to/checkpoint
Expand Down

0 comments on commit cf12108

Please sign in to comment.