Skip to content

Commit

Permalink
Update vllm/lora readme
Browse files Browse the repository at this point in the history
  • Loading branch information
mreso committed Sep 18, 2024
1 parent 0a13ab0 commit e1f00f6
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/large_models/vllm/lora/Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ The vllm integration uses an OpenAI compatible interface which lets you perform

Curl:
```bash
curl --header "Content-Type: application/json" --request POST --data @prompt.json http://localhost:8080/predictions/llama-8b-lora/1.0/v1
curl --header "Content-Type: application/json" --request POST --data @prompt.json http://localhost:8080/predictions/llama-8b-lora/1.0/v1/completions
```

Python + Request:
Expand Down

0 comments on commit e1f00f6

Please sign in to comment.