[Model] Add BNB quantization support for Mllama#9720
Merged
mgoin merged 10 commits intovllm-project:mainfrom Isotr0py:mllama-bnbOct 29, 2024
+84-12
Commits
Commits on Oct 26, 2024
- committed
- committed
- committed
- committed
Commits on Oct 27, 2024
- committed
- committed
- committed
Commits on Oct 28, 2024
- committed
Commits on Oct 29, 2024
- committed
- committed