You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The new version of Brevitas may have a bug when you apply intger quantization to a dense layer, I have tryed to quantise different models from torchvision and when you reach the last linear layer the multiplication fail.
Reproducibility
Can be reproduced consistently.
[ x] Difficult to reproduce.
Unable to reproduce.
Screenshots/Code Example/Log Output
RuntimeError: mat1 and mat2 shapes cannot be multiplied (131072x1 and 512x1000)
please complete the following information:
Brevitas version: last
PyTorch version: 2.5
Operating System / platform: Linux
The text was updated successfully, but these errors were encountered:
Describe the bug
The new version of Brevitas may have a bug when you apply intger quantization to a dense layer, I have tryed to quantise different models from torchvision and when you reach the last linear layer the multiplication fail.
Reproducibility
Screenshots/Code Example/Log Output
RuntimeError: mat1 and mat2 shapes cannot be multiplied (131072x1 and 512x1000)
please complete the following information:
The text was updated successfully, but these errors were encountered: