You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
During testing of a hardware implementation of a Convolutional Coalesced TM – for MNIST – I found that setting a maximum/minimum value of the signed weights could give a boost in test accuracy, compared to training with no weight restrictions. In hardware such a limitation is required as a fixed number of bits per weight has to be allocated.
Typically, the weight limit would be rather small compared to the number of clauses and T, and this seems to be beneficial for the performance. It might affect the training time though.
It would be very useful and interesting if such a parameter could be included.
The text was updated successfully, but these errors were encountered:
During testing of a hardware implementation of a Convolutional Coalesced TM – for MNIST – I found that setting a maximum/minimum value of the signed weights could give a boost in test accuracy, compared to training with no weight restrictions. In hardware such a limitation is required as a fixed number of bits per weight has to be allocated.
Typically, the weight limit would be rather small compared to the number of clauses and T, and this seems to be beneficial for the performance. It might affect the training time though.
It would be very useful and interesting if such a parameter could be included.
The text was updated successfully, but these errors were encountered: