Skip to content

Commit

Permalink
doc: Formatting
Browse files Browse the repository at this point in the history
  • Loading branch information
Hugoch committed Dec 4, 2024
1 parent 491b572 commit 7788a6b
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/source/multi_backend_support.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,8 +6,8 @@ whether you prioritize performance, ease of use, or compatibility with specific
TGI remains consistent across backends, allowing you to switch between them seamlessly.

**Supported backends:**
* TGI CUDA backend: This high-performance backend is optimized for NVIDIA GPUs and serves as the default option
* **TGI CUDA backend**: This high-performance backend is optimized for NVIDIA GPUs and serves as the default option
within TGI. Developed in-house, it boasts numerous optimizations and is used in production by various projects, including those by Hugging Face.
* [TGI TRTLLM backend](./backends/trtllm): This backend leverages NVIDIA's TensorRT library to accelerate LLM inference.
* **[TGI TRTLLM backend](./backends/trtllm)**: This backend leverages NVIDIA's TensorRT library to accelerate LLM inference.
It utilizes specialized optimizations and custom kernels for enhanced performance.
However, it requires a model-specific compilation step for each GPU architecture.

0 comments on commit 7788a6b

Please sign in to comment.