Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Stress test : sparse features #43

Open
Karim-53 opened this issue Apr 10, 2023 · 0 comments
Open

Add Stress test : sparse features #43

Karim-53 opened this issue Apr 10, 2023 · 0 comments

Comments

@Karim-53
Copy link
Owner

Karim-53 commented Apr 10, 2023

Normal initial state

linear model
BMI dataset with

Expected: local explanation of a datapoint: BMI feature has a larger variation than gender feature.

Issue

Create an explicand x such that every feature value xi is unique, i.e., it does not occur elsewhere in the training data. (local explanation of a datapoint that is unique in all its xi features)
(A practical implication of Example 3.2 is that the attributions would be very sensitive to noise in the data.)

trigger the issue

If we add a tiny amount of noise, and recompute attributions, then all the features (including BMI and Gender)

The wrong result

Therefore all the variables get equal attributions, even if the function is not symmetric in the variables!

source: https://arxiv.org/pdf/1908.08474.pdf

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant