Productionize speech-to-text pipeline

[jmartin-sul]

for the purpose of this ticket, the speech-to-text container covers the speech_to_text.py docker container, the AWS infrastructure it operates in for all 3 SDR envs (qa/stage/prod), and the SDR common-accessioning and workflow-server-rails pieces to get it to fit into our larger accessioning pipeline.

there are other higher level concerns/decisions that may block or otherwise affect deployment of the SDR speech-to-text service as a whole, covered in #1 and in our planning google doc.

@andrewjbtw's Putting the Whisper pipeline into production doc

• https://github.com/sul-dlss/terraform-aws/issues/1170
• https://github.com/sul-dlss/terraform-aws/issues/1177
• add speech-to-text to weekly dependency updates #65
• Build and deploy speech-to-text #46
• write DevOpsDocs for speech-to-text infrastructure #32
• spike: can we notify Honeybadger when the speech-to-text container exits with a non-zero error code? #61
• CI: replace current action for ruff with officially supported version #58
• Wire speech_to_text_generation_service (and speech_to_text_request_service or whatever is used for signalling between SDR and cloud speech_to_text_generation_service deployment) up to workflows. common-accessioning#1363
  • Add the ability to send files to an AWS S3 bucket from fetch-files robot common-accessioning#1350
  • speechToTextWF: notify speech_to_text_generation_service that there is content to be STTed common-accessioning#1356
  • common-accessioning daemon watches SQS for notifications that content has been STTed, or that an error was encountered in processing common-accessioning#1358
  • if speech-to-text generation succeeds, fetch speech-to-text output common-accessioning#1359
  • speechToTextWF stage-files: stage transcription files generated by speech_to_text_generation_service common-accessioning#1360
  • speechToTextWF update-cocina: update cocina structural to reference files generated by speech_to_text_generation_service common-accessioning#1361
  • speechToTextWF end-stt: hand off to accessionWF common-accessioning#1362
  • re-enable systemd mgmt of speech-to-text watcher daemon on QA and prod common-accessioning#1462

[jmartin-sul]

@jmartin-sul retitle this ticket to be more specific