Skip to content

[Misc] Add assertion and helpful message for marlin24 compressed models#11388

Merged
DarkLight1337 merged 1 commit intovllm-project:mainfrom neuralmagic:error_dtypeDec 23, 2024
+4

Commits

Commits on Dec 21, 2024