Skip to content

Commit

Permalink
Update Popular_Models_Guide/Llama2/trtllm_guide.md
Browse files Browse the repository at this point in the history
Co-authored-by: Olga Andreeva <[email protected]>
  • Loading branch information
KrishnanPrash and oandreeva-nv authored Aug 8, 2024
1 parent e26e3d0 commit 55d7428
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion Popular_Models_Guide/Llama2/trtllm_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -338,7 +338,7 @@ curl -X POST localhost:8000/v2/models/ensemble/generate -d '{"text_input": "What
> {"context_logits":0.0,...,"text_output":"What is ML?\nML is a branch of AI that allows computers to learn from data, identify patterns, and make predictions. It is a powerful tool that can be used in a variety of industries, including healthcare, finance, and transportation."}
> ```
### Running Gen-AI Perf
### Evaluating performance with Gen-AI Perf
Run the following command within the docker container:
```bash
genai-perf \
Expand Down

0 comments on commit 55d7428

Please sign in to comment.