Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Math behind unixbench tests #45

Closed
jbalen opened this issue Nov 27, 2016 · 3 comments
Closed

Math behind unixbench tests #45

jbalen opened this issue Nov 27, 2016 · 3 comments

Comments

@jbalen
Copy link

jbalen commented Nov 27, 2016

I am writing an article on VPS benchmarking so I would like to know is there any document describing the math behind unixbench tests?

@meteorfox
Copy link

The release notes in the README[1] inside the UnixBench directory includes a lot more information about how the score is computed, specifically the v4.0 release note and up. I would start there.

Also, reading the code and the comments in the Run perl script[2], should also help. The results are normalized to a set of baseline results which you can see here.[3] Then to compute the aggregated score, I believe it's a geometric mean of the normalized scores.

As per what the tests are measuring the WRITING_TESTS [4] file explains their output format.

[1] https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench/README
[2] https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench/Run#L942
[3] https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench/pgms/index.base
[4] https://github.com/kdlucas/byte-unixbench/blob/master/UnixBench/WRITING_TESTS

@gstrauss
Copy link
Collaborator

gstrauss commented Dec 5, 2016

Thanks for those pointers, @meteorfox!

@jbalen, you might also look at #23 for a general discussion of some important limitations of using old benchmarks on newer technology, such as VPS.

@gstrauss gstrauss closed this as completed Dec 5, 2016
@jbalen
Copy link
Author

jbalen commented Jan 30, 2017

Sorry for my late reply :(
@meteorfox your comments are really helpful and I appreciate your help a lot!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants