Skip to content
Change the repository type filter

All

    Repositories list

    • LLM Proxy to call 100+ LLM APIs using the OpenAI format - Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq
      Python
      Other
      2.3k003Updated Mar 7, 2025Mar 7, 2025
    • Python
      GNU Affero General Public License v3.0
      0030Updated Mar 6, 2025Mar 6, 2025
    • llmc

      Public
      [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".
      Python
      Apache License 2.0
      49000Updated Mar 2, 2025Mar 2, 2025
    • Python
      0001Updated Feb 24, 2025Feb 24, 2025
    • modelscan

      Public
      Protection against Model Serialization Attacks
      Python
      Apache License 2.0
      85000Updated Feb 5, 2025Feb 5, 2025
    • llmperf

      Public
      LLMPerf is a library for validating and benchmarking LLMs
      Python
      Apache License 2.0
      136000Updated Jan 27, 2025Jan 27, 2025
    • Jupyter Notebook
      GNU Affero General Public License v3.0
      0000Updated Jan 10, 2025Jan 10, 2025
    • A client package to directly integrate Bud Serve engine to your python application.
      Python
      Apache License 2.0
      1100Updated Oct 28, 2024Oct 28, 2024
    • swiftLLM

      Public
      A tiny yet powerful LLM inference system tailored for researching purpose. vLLM-equivalent performance with only 2k lines of code (2% of vLLM).
      Python
      Apache License 2.0
      11100Updated Aug 27, 2024Aug 27, 2024
    • OpenAI 接口管理 & 分发系统,支持 Azure、Anthropic Claude、Google PaLM 2 & Gemini、智谱 ChatGLM、百度文心一言、讯飞星火认知、阿里通义千问、360 智脑以及腾讯混元,可用于二次分发管理 key,仅单可执行文件,已打包好 Docker 镜像,一键部署,开箱即用. OpenAI key management & redistribution system, using a single API for all LLMs, and features an English UI.
      JavaScript
      MIT License
      4.9k000Updated Jul 29, 2024Jul 29, 2024
    • Python
      2210Updated Jul 16, 2024Jul 16, 2024
    • Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
      Python
      MIT License
      529000Updated Jun 28, 2024Jun 28, 2024
    • boomer

      Public
      1B parameter pretrained model with custom architecture and curated dataset
      Python
      Apache License 2.0
      0100Updated Apr 3, 2024Apr 3, 2024
    • Implementation of Nougat Neural Optical Understanding for Academic Documents
      Python
      MIT License
      600000Updated Feb 8, 2024Feb 8, 2024
    • Utils Package For Bud Framework
      Python
      1000Updated Jan 28, 2024Jan 28, 2024
    • SOTA OpenSource code generation model on par with GPT-4 & Beating Google Gemini Ultra, Claude -2 etc.
      Python
      Apache License 2.0
      42110Updated Jan 10, 2024Jan 10, 2024
    • Home Page
      0000Updated Jan 3, 2024Jan 3, 2024
    • Python
      Apache License 2.0
      0000Updated Oct 27, 2023Oct 27, 2023
    • Dockerfile
      0000Updated Sep 17, 2023Sep 17, 2023
    • Tansen

      Public
      About Democratizing access to generative-ai-models for the open-source community. Let's advance AI, together.
      Jupyter Notebook
      Apache License 2.0
      1600Updated Sep 6, 2023Sep 6, 2023
    • Chhavi

      Public
      Democratizing access to generative-ai-models for the open-source community. Let's advance AI, together.
      Python
      Apache License 2.0
      0300Updated Sep 4, 2023Sep 4, 2023
    • GenZ

      Public
      Democratizing access to LLMs for the open-source community. Let's advance AI, together.
      Python
      Apache License 2.0
      72620Updated Sep 2, 2023Sep 2, 2023
    • Making the world truly Intelligent, one fork at a time.
      TypeScript
      MIT License
      2401Updated Aug 23, 2023Aug 23, 2023
    • Audio to Audio (Whisper+ChatGPT+Bark)
      JavaScript
      31100Updated Apr 30, 2023Apr 30, 2023