Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix _round_nnz #1206

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

francois-rozet
Copy link

@francois-rozet francois-rozet commented Jan 31, 2025

What does this PR do?

Fixes #1124

The PR modifies _round_nnz to round the number of elements up instead of down in the mask. It also modifies SparseCSRTensor to take its values (bias) into account in SparseCSRTensor._masked_matmul.

I modified the tests for SparseCS to also test nnz that would not be divisible by 4, as it should now work for any mask.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 31, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Incorrect attention output with SparseCS mask
2 participants