Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add whisper.cpp examples #1

Open
thixotropist opened this issue Jul 28, 2024 · 0 comments
Open

Add whisper.cpp examples #1

thixotropist opened this issue Jul 28, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@thixotropist
Copy link
Owner

Add a set of survey data from the whisper.cpp example plus the framing context to show its relationship to the existing dpdk example.

Initial notes:

  • whisper.cpp uses a lot of vector math, so it is a good example of how GCC will autovectorize vector processing.
  • whisper.cpp uses a lot of 16 bit floating point math, but not in a way that RISC-V processors supporting one of the two common 16 bit floating point formats can yet use. This is likely to change dramatically.
  • whisper.cpp includes explicit RISC-V vector instrinsic C source code - but this code is not necessarily better than that produced by GCC's autovectorizer. The microarchitecture choices have a large impact on the generated instructions.
@thixotropist thixotropist added the enhancement New feature or request label Jul 28, 2024
@thixotropist thixotropist self-assigned this Jul 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant