Add support for --device mps option for MacOS

[ozio]

Currently, the --device flag only supports two options: cpu and cuda. However, cuda is not available on MacOS, leaving cpu as the only option, which is significantly slower.

MacOS users can leverage the Metal Performance Shaders (MPS) backend for GPU acceleration, which greatly speeds up processing.

Please add support for --device mps to enable GPU acceleration on MacOS.

As a temporary solution, I am manually hardcoding the value in the environment folder, but this is a dirty hack and not maintainable.

Adding mps support natively would improve usability and performance for MacOS users.

[jeeftor]

Can you share your hack? I'd like to try it out.

[ozio]

whisper-ctranslate2/src/whisper_ctranslate2/diarization.py

Line 38 in 1a4b8ee

device = torch.device(self.device)

Here I changed self.device to "mps".

[unclefomotw]

I guess this is because https://github.com/OpenNMT/CTranslate2 does not support mps?