upgrade to whisper.cpp 1.5.5

[jwijffels]

https://github.com/ggerganov/whisper.cpp/releases/tag/v1.5.5

[jmgirard]

Any chance we could update to 1.6.2? Happy to help with testing.

[jwijffels]

Yes, I think I will make that effort somewhere in September. Which changes in whisper.cpp are important for you that are newer than 1.5.4

[jmgirard]

Mostly I want to try the Flash Attention added in 1.6.0

[jwijffels]

Yes, that's also the main thing I think is relevant from my end as well.

[jmgirard]

@jwijffels Any chance you know how to compile ffmpeg with CUDA support? Been trying to follow this guide but it always fails.

[jwijffels]

@jwijffels Any chance you know how to compile ffmpeg with CUDA support? Been trying to follow this guide but it always fails.

I've only worked with the av bindings and not with compiling ffmpeg with CUDA support myself. I see you have https://github.com/jmgirard/tidymedia which interfaces with a ffmpeg binary. I haven't looked into compiling ffmpeg myself.

[jmgirard]

It was a hassle but I finally got it working.