Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reorganise tests and examples #140

Open
daniel3735928559 opened this issue Sep 13, 2016 · 0 comments
Open

Reorganise tests and examples #140

daniel3735928559 opened this issue Sep 13, 2016 · 0 comments
Milestone

Comments

@daniel3735928559
Copy link
Contributor

One proposal: We have integration tests which consist of only JSON files for dictionaries to send to NEXT (say), that verify that all the plumbing is sound. From these, the initExp JSON can double as a thing used in the example launching scripts. We don't have to write all the e.g. processAnswer dictionaries separately--we could have the JSON for these be a template of some sort and have the test running code know how to interpret them sensibly.

We could then separately have functionality tests that can be more complicated and attempt to supply correct answers so that the resulting embeddings/rankings/whatever should look approximately correct.

We can also add load tests as desired, but it is useful to separate all these things (load tests, functionality tests, and integration tests). When developing, we want mostly to make sure quickly that we have not broken the plumbing. Before launching, we may want to take more time to verify that load will not break things and that the algorithms actually do the right thing.

@daniel3735928559 daniel3735928559 added this to the v1.1 milestone Sep 13, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants