Skip to content

Commit

Permalink
update table to include notes
Browse files Browse the repository at this point in the history
  • Loading branch information
jbkyang-nvi committed Oct 26, 2023
1 parent f0ad6ca commit a8044ce
Showing 1 changed file with 7 additions and 7 deletions.
14 changes: 7 additions & 7 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -14,17 +14,17 @@ The focus of these examples is to demonstrate deployment for models trained with
| [PyTorch Model](./Quick_Deploy/PyTorch/README.md) | [TensorFlow Model](./Quick_Deploy/TensorFlow/README.md) | [ONNX Model](./Quick_Deploy/ONNX/README.md) | [TensorRT Accelerated Model](https://github.com/NVIDIA/TensorRT/tree/main/quickstart/deploy_to_triton) | [vLLM Model](./Quick_Deploy/vLLM/README.md)
| --------------- | ------------ | --------------- | --------------- | --------------- |

#### Supported Model Table
The table below contains a
#### Example models
The table below contains some popular models that are supported in our tutorials
| Model Name | Supported with HuggingFace format | Supported with TensorRT-LLM Backend | Supported with vLLM Backend |
| :-------------: | :------------------------------: | :----------------------------------: | :-------------------------: |
| [Llama2-7B](https://ai.meta.com/llama/) | [Llama-2](https://huggingface.co/meta-llama/Llama-2-7b-hf/tree/main) |[tutorial](Popular_Models_Guide/Llama2/trtllm_guide.md) | :grey_question:|
| [Persimmon-8B](https://www.adept.ai/blog/persimmon-8b) |:white_check_mark: |:grey_question: | :white_check_mark: |
| [Falcon-180B](https://falconllm.tii.ae/index.html) |:white_check_mark: |:grey_question: | :white_check_mark: |
| [Mistral-7B](https://mistral.ai/news/announcing-mistral-7b/)|:white_check_mark: |:grey_question: | :white_check_mark: |


| [Persimmon-8B](https://www.adept.ai/blog/persimmon-8b) | [HuggingFace tutorial](https://github.com/triton-inference-server/tutorials/tree/main/Quick_Deploy/HuggingFaceTransformers) |:grey_question: | :white_check_mark: |
| [Falcon-180B](https://falconllm.tii.ae/index.html) |[HuggingFace tutorial](https://github.com/triton-inference-server/tutorials/tree/main/Quick_Deploy/HuggingFaceTransformers) |:grey_question: | :white_check_mark: |

**Note:**
1. :white_check_mark: indicates that the model has been verified to work with said backend, :grey_question: indicates the model has not been verified to work.
2. This is not an exhausitive list of what Triton supports, just what is included in the tutorials.

## What does this repository contain?
This repository contains the following resources:
Expand Down

0 comments on commit a8044ce

Please sign in to comment.