Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

100 image subset for Decision Boundary attack should be deterministic #21

Open
nottombrown opened this issue Sep 13, 2018 · 0 comments
Open
Labels
good first issue Good for newcomers help wanted Extra attention is needed

Comments

@nottombrown
Copy link
Collaborator

Currently we shuffle the test dataset to avoid having all birds or all bicycles in a batch.

We also only run the Decision Boundary attack on 100 images because it is too slow to run on the full 1000 image test set.

However, this results in choosing a different 100 images subset each time we run the Decision Boundary attack.

One solution here would be to get the dataset with bird_or_bicyle.get_iterator('test', shuffle=False) and then deterministically shuffle the dataset.

@nottombrown nottombrown added help wanted Extra attention is needed good first issue Good for newcomers labels Sep 19, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant