Skip to content
This repository has been archived by the owner on Sep 10, 2020. It is now read-only.

Open world cross-validation #64

Open
redshiftzero opened this issue Oct 12, 2016 · 0 comments
Open

Open world cross-validation #64

redshiftzero opened this issue Oct 12, 2016 · 0 comments

Comments

@redshiftzero
Copy link
Contributor

redshiftzero commented Oct 12, 2016

We should implement open-world cross-validation - and the ability to define how much of the world the adversary can see. Both these config options (world: type: 'open' and world: observed_fraction) and corresponding fields to store them in the database (in models.undefended_frontpage_attacks) were created in PR #57. It would be nice if we could use existing code from one of the splitting methods here but writing custom CV may be necessary. If custom CV code is indeed necessary, it should definitely be unit tested.

Also: consider making the observed_fraction in the config take a list of possible values.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants