Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add benchmark for different data sizes #1

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

gkowal
Copy link

@gkowal gkowal commented Jul 6, 2020

This benchmark tests the speed of the chunker for different data sizes. The assumed average chunk size is 1MiB.

Example output is

BenchmarkFastCDCSize/1k                      818           1416360 ns/op           0.72 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/4k                      830           1414823 ns/op           2.90 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/16k                     829           1426192 ns/op          11.49 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/32k                     813           1422427 ns/op          23.04 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/64k                     835           1423337 ns/op          46.04 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/128k                    825           1431522 ns/op          91.56 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/256k                    805           1475553 ns/op         177.66 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/512k                    609           1993781 ns/op         262.96 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/1M                      424           2836833 ns/op         369.63 MB/s             1.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/4M                      146           8297601 ns/op         505.48 MB/s             4.00 chunks     8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/16M                      43          27008988 ns/op         621.17 MB/s            15.0 chunks      8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/32M                      21          53433832 ns/op         627.96 MB/s            28.0 chunks      8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/64M                      10         107862732 ns/op         622.17 MB/s            56.0 chunks      8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/128M                      5         209478770 ns/op         640.72 MB/s           116 chunks        8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/512M                      2         846476085 ns/op         634.24 MB/s           454 chunks        8388720 B/op          2 allocs/op
BenchmarkFastCDCSize/1G                        1        1679996392 ns/op         639.13 MB/s           902 chunks        8388720 B/op          2 allocs/op

Signed-off-by: Grzegorz Kowal [email protected]

@codecov-commenter
Copy link

Codecov Report

Merging #1 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master       #1   +/-   ##
=======================================
  Coverage   95.83%   95.83%           
=======================================
  Files           1        1           
  Lines          96       96           
=======================================
  Hits           92       92           
  Misses          2        2           
  Partials        2        2           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f27242f...036ecb5. Read the comment docs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants