Skip to content

Latest commit

 

History

History
156 lines (126 loc) · 12.9 KB

CHANGELOG.md

File metadata and controls

156 lines (126 loc) · 12.9 KB
Raw

Change Log

v0.6.0 (2020-02-10)

Full Changelog

Right, this isn't the GUI update sadly. I'm kinda struggling with XAML right now, so I'm trying to avoid it. That delayed the whole thing quite a bit though. Codename for this release is: "If I wouldn't want to have a GUI by Version 1.0 then this would have been 1.0".

I've also decided on a name for this application (since CPU-Benchmark is a bit too generic :P). Please say welcome to:

RIALBench

I thought it was a nice relation to "real" and I associate quite a bit with the name "Ria". I'll update the name in the following weeks everywhere.

Either way, here's some updates for the current version:

  • Complementary Repos added to Readme (this is only housekeeping, but you can now go directly to the related repos)
  • Switched to a different rating algorithm. Points are now from 0-10000 rather than all over the place like Geekbench does it. This should simplify interpreting points as well as updating benchmarks in the future
  • Implemented benchmark scaling. Something you see in Cinebench for example. The volume of the benchmark is scaled with the number of cores working on it. Though not linearly, since that would increase the volume way too much. Tests have shown that the results are still representative and it should enable better benchmarks on single cores as well as big CPUs (> 12 Cores).
  • Adjusted the default benchmark volume. Since benchmarks now scale there's no need to have a 5 minutes single-core run just because it would be a 5 second multi-core run. The goal is to keep each benchmark below 1 second on the reference CPU. This cuts down on the time taken to benchmark from roughly ~15 minutes (on my Intel Laptop) to ~3 Minutes.
  • Replaced the on-the-fly generated HTML/JSON with real-world data. While the binary is a bit larger, it cut down on the benchmarking times for those benchmarks, as well as increased the representation value for them.
  • Switched GC Mode from LowLatency to SustainedLowLatency. The former is not available on Windows Server, so this should enable the program working on Windows Server as well.
  • Added an experimental throughput statistic, which is ignored when uploading your results but should give a somewhat accurate representation of the throughput in bytes you achieved per benchmark.
  • Moved most of the communications stuff to the new Common Library (linked in the Readme). This greatly simplifies the communication between Benchmarker, Server and Website and should (theoretically) enable third-party websites as well as third-party benchmarks.
  • Added a pure SHA-256 benchmark
  • Improved the performance of the on-the-fly data generation. Since there's large amounts of data generated for the benchmarks this should improve the overall runtime a bit
  • Added pregenerated random data to decrease the generation time a bit more
  • Added ThreadAffinity and Priority settings which should decrease the fluctuation in results quite a bit
  • Added stress tests for the extension benchmarks. There's more to come and I'm not quite happy with the implementation just yet, but it works.
  • Added more AVX and SSE benchmarks
  • Added new AVX and SSE categories
  • Added new experimental L2CacheLatency benchmark
  • Decreased the memory consumption of the decryption benchmark (it was quite insane)
  • Improved extension benchmarks in general
  • Refactored options parsing to increase code quality in Program.cs
  • Bumped CommandLineParser version to latest
  • Bumped HTMLAgilityPack to latest
  • Bumped Common Library and HardwareInformation to latest
  • Added automated Github and Docker release pipelines, let's see if they work
  • On that note, also added multi-platform Docker images. Currently available are linux-amd64, linux-arm64 and linux-arm32v7

** Bugfixes:**

  • Fixed a bug in the ZIP Benchmark
  • Fixed a bug causing the progress bar to jump around after completion

v0.5.0 (2019-12-23)

Full Changelog

  • Fixed an exception that could occur on older hardware that doesn't support one of the instruction extensions
  • Added SSE2 (128-bit integer), AVX2 (256-bit integer) and FMA (fused multiply-add of 128-bit float) benchmarks
  • Added arithmetic_double benchmark
  • Added arithmetic_fp16 benchmark
  • Added support for multiple categories per benchmark to better group them together
  • Added uploaded field to save data

v0.4.1 (2019-12-22)

Full Changelog

Updates:

  • Fixed exception that could occur when calculating the hash of the current saved data
  • Added "category aggregator" that enables users to run each benchmark separately and if they got all for one category (or "all"), then that category is added (or updated) to the results

v0.4.0 (2019-12-21)

Full Changelog

Updates:

  • Added clear option to clear all (locally) saved data
  • Added upload option to upload last (valid) benchmark run instead of uploading regardless of situation
  • Deprecated the -q / --quick option in favor of the upload option
  • Moved save data to hidden directory "_save" to make it easier managable
  • Switched to only allow uploading once "category:all" (--benchmark all) has been run
  • Added option to view uploaded results in browser
  • Simplified progress reporting
  • Switched reference values to always refer to the all-core performance of the stock 3900X to simplify and unify the point system
  • Reworked the categorization logic to clean up the code and fix some bugs
  • Adjusted volumes of several benchmarks to make the run faster yet still comparable. A full benchmark run now takes ~60 seconds on the 3900X.
  • Added comparisons to benchmarks. These serve as the new "reference" value that is only printed to the user rather than used in calculating the points. These can be easily expanded to more than SC/AC references.
  • Reworked result saving logic to be more concise and easier on the user, while also being stricter and more secure against tampering done on the save
  • Added better error messages
  • Fixed some minor bugs that could pop up in specific situations
  • Fixed memory leak that occurs when saving the results (which should only happen immediately before closing the program, but you never know)

v0.3.0 (2019-10-26)

Full Changelog

Updates:

  • Add decompression benchmarks #81 (L3tum)
  • Update for uploading results to the benchmark database #78 (L3tum)
  • ResultUploader + ResultLister + Bugfixes + Dependency Updates #73 (L3tum)
  • Bump HtmlAgilityPack from 1.11.12 to 1.11.15 #71 (dependabot-preview[bot])

v0.2.0 (2019-09-14)

Full Changelog

Updates:

v0.1.1 (2019-09-03)

Full Changelog

Updates:

  • Switch to AES GCM since AES anything else is insecure #45 (L3tum)
  • Fix SSE only add and not multiplying #44 (L3tum)
  • Fix general benchmarks progress being wrong #43 (L3tum)
  • Fix bug throwing exception when no options given #42 (L3tum)
  • Update issue templates #41 (L3tum)
  • Update Readme.md #30 (L3tum)

v0.1-alpha (2019-09-02)

Updates:

  • Fix docs and naming #29 (L3tum)
  • Add multiplication to avx to better represent common workloads #28 (L3tum)
  • Feature/bnch 21 add crypto #26 (L3tum)
  • Update Readme for Brotli #24 (L3tum)
  • Update build.ps1 with zipping #23 (L3tum)
  • Added brotli benchmark #22 (L3tum)
  • Update Readme.md #20 (L3tum)
  • Add SSE #19 (L3tum)
  • Feature/add build #18 (L3tum)
  • Add floating point benchmark #17 (L3tum)
  • Improved progress reporting and memory usage #16 (L3tum)
  • Feature/add avx #14 (L3tum)
  • Update Benchmark rating to support a wider range #13 (L3tum)
  • Update Readme.md #12 (L3tum)
  • Update runner to support multiple benchmarks #11 (L3tum)
  • Add arithmetic to docs #9 (L3tum)
  • Implement integer arithmetic benchmark #6 (L3tum)
  • Update Readme.md #3 (L3tum)
  • Update readme #2 (L3tum)

* This Change Log was automatically generated by github_changelog_generator