Skip to content

Commit

Permalink
Merge pull request #2 from noworneverev/update-content
Browse files Browse the repository at this point in the history
Add litellm
  • Loading branch information
noworneverev authored Dec 31, 2024
2 parents 4b006ea + 31dbdc4 commit df86c9f
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/awesome-rag/tools.md
Original file line number Diff line number Diff line change
Expand Up @@ -151,6 +151,7 @@ sidebar_position: 1
| [ollama](https://github.com/ollama/ollama) | Get up and running with Llama 3.3, Mistral, Gemma 2, and other large language models. | [![Stars](https://img.shields.io/github/stars/ollama/ollama?style=flat)](https://github.com/ollama/ollama/stargazers) |
| [vllm](https://github.com/vllm-project/vllm) | A high-throughput and memory-efficient inference and serving engine for LLMs. | [![Stars](https://img.shields.io/github/stars/vllm-project/vllm?style=flat)](https://github.com/vllm-project/vllm/stargazers) |
| [LM Studio](https://lmstudio.ai/) | Discover, download, and run local LLMs. | ![Proprietary](https://img.shields.io/badge/Proprietary-red) |
| [litellm](https://github.com/BerriAI/litellm) | Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq]. | [![Stars](https://img.shields.io/github/stars/BerriAI/litellm?style=flat)](https://github.com/BerriAI/litellm/stargazers) |
| [sglang](https://github.com/sgl-project/sglang) | SGLang is a fast serving framework for large language models and vision language models. | [![Stars](https://img.shields.io/github/stars/sgl-project/sglang?style=flat)](https://github.com/sgl-project/sglang/stargazers) |


Expand Down

0 comments on commit df86c9f

Please sign in to comment.