Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve checking for higher scores with other keys #12

Open
mwest1066 opened this issue Jan 8, 2015 · 1 comment
Open

Improve checking for higher scores with other keys #12

mwest1066 opened this issue Jan 8, 2015 · 1 comment

Comments

@mwest1066
Copy link
Owner

Only warn about best matches with different keys if the improvement in points is very significant. Say if the best match points is more than N std dev above random guessing. That is, if (1 - BINOM_CDF) is less than 0.0001 or something.

@mwest1066
Copy link
Owner Author

For N_Q questions with N_A answers each, let F be the binomial CDF with parameters n = N_Q and p = 1/N_A.

The probability of a student answering at least k questions correctly by chance is F(k).

With N_s students taking N_e exams, the probability that some student answers at least k questions correctly when scored against an exam other that their own is:

p = 1 - F(k)^(N_s * (N_e - 1))

We should only print out warnings if this is value is below some threshold, say 0.01.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant