Skip to content

Commit

Permalink
Clarify completions v1
Browse files Browse the repository at this point in the history
  • Loading branch information
tgaddair committed Jan 10, 2024
1 parent 64739ad commit a5f89f5
Showing 1 changed file with 6 additions and 2 deletions.
8 changes: 6 additions & 2 deletions docs/guides/openai_api.md
Original file line number Diff line number Diff line change
Expand Up @@ -82,9 +82,13 @@ If the adapter selected with the `model` parameter has its own tokenizer and cha
to the request during inference. If, however, the adapter does not have its own chat template, LoRAX will fallback to using the base model
chat template. If this does not exist, an error will be raised, as chat templates are required for multi-turn conversations.

## (Legacy) Completions v1
## Completions v1

The legacy completions v1 API can be used as well:
The legacy completions v1 API can be used as well. This is useful in cases where the model does not have a chat template or you do not wish to
interact with the model in a multi-turn conversation.

Note, howevr, that you will need to provide any template boilerplate as part of the `prompt` as unlike the `v1/chat/completions` API, it will not
be inserted automatically.

```python
from openai import OpenAI
Expand Down

0 comments on commit a5f89f5

Please sign in to comment.