feat:add tts-streaming config and future #5492
Open
+1,165
−347
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dosubot
bot
added
size:XL
|
@charli117 Please review this pr as well. |
|
@crazywoola ic-xu is a colleague of our team, and the version submitted now is the version we are currently using. There is also an optimization point that requires adding a blocking mode output logic for models that are not compatible and do not support streaming tts. We have communicated with each other and merged later |
takatost
requested changes
Jun 23, 2024
4 tasks
takatost
requested changes
Jun 25, 2024
…e of streaming to implement TTS functionality
It has been extracted as a separate module, and processing logic has been added to the corresponding module in GenerateTask Pipeline. process(). At the same time, the expiration time has been set to be small. At the same time, Redis will not store all message objects, but only a portion of the required data, so the data will not be very large
crazywoola
reviewed
Jul 3, 2024
crazywoola
reviewed
Jul 3, 2024
dosubot
bot
added
size:XXL
crazywoola
reviewed
Jul 4, 2024
| @@ -79,6 +79,7 @@ export type TextToSpeechConfig = { | |||
| enabled: boolean | |||
| voice?: string | |||
| language?: string | |||
| autoPlay?: string | |||
There was a problem hiding this comment.
Suggested change
| autoPlay?: string | |
| autoPlay?: ttsAutoPlay |
crazywoola
reviewed
Jul 4, 2024
| @@ -14,6 +14,7 @@ export type SuggestedQuestionsAfterAnswer = EnabledOrDisabled | |||
| export type TextToSpeech = EnabledOrDisabled & { | |||
| language?: string | |||
| voice?: string | |||
| autoPlay?: string | |||
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Add TTS streaming configuration and feature support, add text to speech in the feature configuration options, click on configure to start
Fixes #5251
Type of Change
How Has This Been Tested?
Simply configure the streaming TTS option and test it