Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimize RS encode/decode with Intel ISA-L #18

Open
adammoody opened this issue Aug 28, 2020 · 0 comments
Open

Optimize RS encode/decode with Intel ISA-L #18

adammoody opened this issue Aug 28, 2020 · 0 comments

Comments

@adammoody
Copy link
Contributor

adammoody commented Aug 28, 2020

Intel has an open-source library supporting vectorized functions to compute RS GF(2^8) math:

https://01.org/intel%C2%AE-storage-acceleration-library-open-source-version
https://github.com/intel/isa-l

This is licensed under BSD-3. It looks like it may also support processors other than just Intel, including PowerPC. This could offer a performance boost for our internal RS encoding.

For example, the gf_vect_mul function here:

https://github.com/intel/isa-l/blob/master/include/gf_vect_mul.h

might plug in for:

void redset_rs_reduce_buffer_multadd(

This will take some developer time to make the switch, and it adds a dependency. Also, if we are bottlenecked by storage or network bandwidth, reducing encode/decode time may not improve overall performance by much. So some work should be done to investigate before taking this on.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant