-
Notifications
You must be signed in to change notification settings - Fork 24
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[feature] add CLAP score metric to compute similarity between text and audio embeddings #28
Conversation
@mcomunita I fixed some merge conflicts in order to pass the unit tests. |
Thanks @gudgud96. A useful extra would be to compute the CLAP score on the AudioCaps and the MusicCaps test sets and include the results in the README for reference. I haven't seen anyone reporting these numbers before, but I think it would give a useful lower bound. |
That is a good idea. I am not working actively on AudioCaps / MusicCaps, but don't mind having a look. |
test/test_clap_score.ipynb
notebook to test new featuretest/clap_score_audio
andtest/clap_score_text
with audio/text examples to run test